Another thing: do you have very limited memory and/or hard disk space? Grepping a file that size should not be a problem on even relatively modest hardware.
This is a basic PATA disk which should be easy to beat if you have SCSI or SATA.
Okay, absolute newbie here...
I'm on a Mac trying to split an almost 2 Gig log file on a Unix box into manageable chunks for my web-based log analysis tool.
What do I need to do, what programs do I need to do it?
All and any help appreciated/needed :-)
Cheers (8 Replies)
Hi All,
Following is the sample file
and following is the op desired
that is the last entry of each unique first field is required.
My solution is as follows
However the original file has around a million entries and around a 100,000 uniques first fields, so this soln.... (6 Replies)
I have a very large (150 megs) IRC log file from 2000-2001 which I want to cut down to individual daily log files. I have a very basic knowledge of the cat, sed and grep commands. The log file is time stamped and each day in the large log file begins with a "Session Start" string like so:
... (11 Replies)
Can someone please help me how do I find a URL from lines of log file and write all the output to a new file?
For e.g - Log file has similar entries,
39.155.67.5 - - "GET /abc/login?service=http://161.120.36.39/CORPHR/TMA2007/default.asp HTTP/1.1" 401 3218
54.155.63.9 - - "GET... (2 Replies)
I wrote head -n1 example.log I grab the first line of the log, but I need to isolate just the date, which is 08/May/2012:09:52:52. I also need to find the reverse of this, which would be tail...
http://i.imgur.com/Lp1eBD0.png
Thanks in advance (4 Replies)
I have a directory with daily logs that have records like this:
Date: 04/17/13 Time: 09:29:15
IP: 123.123.123.123
URL: usr/local/file1
and I want to only count how many times each file was accessed (e.g. file1 in that example above), and I want to also look in all the logs in the current... (3 Replies)
I have a 1.2G file that contains no newline characters. This is essentially a log file with each entry being exactly 78bits long. The basic format is /DATE/USER/MISC/. The single uniform thing about the file is that that the 8 character is always ":"
I worked with smaller files of the same... (8 Replies)
I do have a large matrix of the following format and it is tab delimited
ch-ab1-20 ch-bb2-23 ch-ab1-34 ch-ab1-24 er-cc1-45 bv-cc1-78
ch-ab1-20 0 2 3 4 5 6
ch-bb2-23 3 0 5 ... (6 Replies)
Discussion started by: Kanja
6 Replies
LEARN ABOUT OPENSOLARIS
strerr
strerr(1M) System Administration Commands strerr(1M)NAME
strerr - STREAMS error logger daemon
SYNOPSIS
strerr
DESCRIPTION
strerr receives error log messages from the STREAMS-based log driver (see log(7D)) and appends them to a log file. The resultant error log
files reside in the directory /var/adm/streams, and are named error.mm-dd, where mm is the month and dd is the day of the messages con-
tained in each log file.
The format of an error log message is:
<seq> <time> <ticks> <flags> <mid> <sid> <text>
<seq> error sequence number
<time> time of message in hh:mm:ss
<ticks> time of message in machine ticks since boot priority level
<flags> T : the message was also sent to a tracing process F : indicates a fatal error N : send mail to the system administrator (hard-
coded as root)
<mid> module ID number of source
<sid> sub-ID number of source
<text> formatted text of the error message
Messages that appear in the error log are intended to report exceptional conditions that require the attention of the system administrator.
Those messages which indicate the total failure of a STREAMS-based driver or module should have the F flag set. Those messages requiring
the immediate attention of the administrator will have the N flag set, which causes the error logger to send the message to the system
administrator using mail. The priority level usually has no meaning in the error log but will have meaning if the message is also sent to a
tracer process.
Once initiated, strerr continues to execute until terminated by the user. It is commonly executed asynchronously.
FILES
/var/adm/streams/error.mm-dd
error log file.
ATTRIBUTES
See attributes(5) for descriptions of the following attributes:
+-----------------------------+-----------------------------+
| ATTRIBUTE TYPE | ATTRIBUTE VALUE |
+-----------------------------+-----------------------------+
|Availability |SUNWcsu |
+-----------------------------+-----------------------------+
SEE ALSO attributes(5), log(7D)NOTES
There is no restriction to the number of strerr processes opening the STREAMS-based log driver at a time.
If a module or driver is generating a large number of error messages, running the error logger will cause a degradation in STREAMS perfor-
mance. If a large burst of messages are generated in a short time, the log driver may not be able to deliver some of the messages. This
situation is indicated by gaps in the sequence numbering of the messages in the log files.
SunOS 5.11 4 Oct 1994 strerr(1M)