Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Need to script following a noisy log file which rolls over
Top Forums Shell Programming and Scripting Need to script following a noisy log file which rolls over Post 302329593 by drewnix on Monday 29th of June 2009 01:38:42 AM
Old 06-29-2009
Need to script following a noisy log file which rolls over
I'd like to write a script or even a good command line that can follow a very noisy log file looking for specific patterns but can also handle log roll overs in an intelligent way.

I sometimes do something like the following:

# tail -f /var/log/crazy.log | grep 'ailure' > /my/dir/crazy-failures.log

But then after some time the log will automatically roll over due to newsyslog...

Jun 28 00:00:00 qa-arc1-1 newsyslog[36074]: logfile turned over

At which that the server no longer logs messages to that file and my command no longer filters out lines with 'ailure'.

I guess one way to attack it would be to programatically search for 'logfile turned over' and automatically switch to the new log file. Is that the best option? Any suggestions?

Thanks!

---------- Post updated at 10:38 PM ---------- Previous update was at 10:31 PM ----------

I should also mention that I believe there are cases when the log file will roll over for reasons other then just hitting midnight i.e. reaching some size limit. Part of the reason I want to do this is that the default configuration will only roll over a log like 3 times before destructively removing the old log files. And the log file is to noisy to extend beyond that, anyway.
 

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Log file for a Script

Oracle92 on solaris 8. We have a Truncate Script that runs every night to cleanup certain tables , so new data gets loaded into. This Script is run in Unix Shell script where i set Environment varibles, and things like that.. Now, how do i create a log file of the script , to see weather the... (3 Replies)
Discussion started by: vr76413
3 Replies

2. UNIX for Dummies Questions & Answers

Script for parsing details in a log file to a seperate file

Hi Experts, Im a new bee for scripting, I would ned to do the following via linux shell scripting, I have an application which throws a log file, on each action of a particular work with the application, as sson as the action is done, the log file would vanish or stops updating there, the... (2 Replies)
Discussion started by: pingnagan
2 Replies

3. Shell Programming and Scripting

log file script

I have a log which is configured as follows: date time code1 notes: code2 A monthly job is run based on information supplied from this log. The end of each monthly job is clearly indicated by a code within 'code1'. At this time someone is performing a less on the log, moving to the end,... (2 Replies)
Discussion started by: bwatlington
2 Replies

4. HP-UX

Script to monitor /var/opt/resmon/log/event.log file

AM in need of some plugin/script that can monitor HP-UX file "/var/opt/resmon/log/event.log" . Have written a scrip in sh shell that is working fine for syslog.log and mail.log as having standard format, have interrogated that to Nagios and is working as I required . But same script failed to... (3 Replies)
Discussion started by: Shirishlnx
3 Replies

5. Shell Programming and Scripting

Script to monitor log file

Hi, Have written a script to monitor linux non standard log file based on line numbers, so each check store $otalinenum .. then in next check after 10 minutes it compre the current_total_line_num > last_total_line_num then it will parse the log file from last_total_line_num to... (0 Replies)
Discussion started by: Shirishlnx
0 Replies

6. Shell Programming and Scripting

Shell Script to grep Job File name and Log File name from crontab -l

Hello, I am new to shell scripting. I need to write a shell script where i can grep the name of file ie. .sh file and log file from crontab -l. #51 18 * * * /home/oracle/refresh/refresh_ug634.sh > /home/oracle/refresh/refresh_ug634.sh.log 2>&1 #40 17 * * * /home/oracle/refresh/refresh_ux634.sh... (1 Reply)
Discussion started by: guptra
1 Replies

7. Shell Programming and Scripting

Script to read a log file and run 2nd script if the dates match

# cat /tmp/checkdate.log SQL*Plus: Release 11.2.0.1.0 Production on Mon Sep 17 22:49:00 2012 Copyright (c) 1982, 2009, Oracle. All rights reserved. Connected to: Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - 64bit Production FIRST_TIME NEXT_TIME... (1 Reply)
Discussion started by: SarwalR
1 Replies

8. Shell Programming and Scripting

Script to rotate file log

Hi Experts, I have script on crontab and give output quite large. I would like to know how to create rotate log when the size of log maximum 50MB if the test.log is 50MB then create test.0 Thanks Edy (2 Replies)
Discussion started by: edydsuranta
2 Replies

9. Shell Programming and Scripting

Shell Script function to use script name for log file output

Hi Team - I"m very new to Shell Scripting so I have a rather novice question. My forte is Windows Batch Scripting so I was just wondering what the Shell Script equivalent is to the DOS command %~n? %~n is a DOS variable that dispayed the script name. For instance (in DOS): REM... (11 Replies)
Discussion started by: SIMMS7400
11 Replies

LEARN ABOUT SUNOS

nislog

nislog(1M)						  System Administration Commands						nislog(1M)

NAME

       nislog - display the contents of the NIS+ transaction log

SYNOPSIS

       /usr/sbin/nislog [-h num | -t num]  [-v] [directory...]

DESCRIPTION

       nislog  displays  the  contents of the NIS+ server transaction log on the standard output. This command can be used to track changes in the
       namespace. The /var/nis/trans.log file contains the transaction log maintained by the NIS+ server. When updates occur, they are	logged	to
       this  file  and	then  propagated  to replicas as log transactions.  When the log is checkpointed, updates that have been propagated to the
       replicas are removed.

       The nislog command can only be run on an NIS+ server by superuser. It displays the log entries for that server only.

       If directory is not specified, the entire log is searched. Otherwise, only those logs entries that correspond to the specified  directories
       are displayed.

OPTIONS

       -h num	       Display num transactions from the ``head'' of the log. If the numeric parameter is  0, only the log header is displayed.

       -t num	       Display	num transactions from the ``tail'' of the log. If the numeric parameter is  0, only the log header is displayed.

       -v	       Verbose mode.

FILES

       /var/nis/trans.log      transaction log

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWnisu			   |
       +-----------------------------+-----------------------------+

SEE ALSO

       nis+(1), rpc.nisd(1M), nisfiles(4), attributes(5)

NOTES

       NIS+  might  not  be  supported in future releases of the SolarisTM Operating Environment. Tools to aid the migration from NIS+ to LDAP are
       available in the Solaris 9 operating environment. For more information, visit http://www.sun.com/directory/nisplus/transition.html.

SunOS 5.10							    12 Dec 2001 							nislog(1M)
All times are GMT -4. The time now is 03:18 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy