help needed - log file monitoring script Post: 302530434

Sponsored Content

Top Forums Shell Programming and Scripting help needed - log file monitoring script Post 302530434 by kenchen722 on Tuesday 14th of June 2011 03:15:15 AM

06-14-2011

Registered User

help needed - log file monitoring script

hi Gurus,
Need to pick your brains on this minor script project.
I would like to continuously monitor a log file with sample log messages as below, and if PSOldGen percentage is either 99% or 100% for consecutively 10 times, alert someone.

Code:

{Heap before gc invocations=46516:
 PSYoungGen      total 63616K, used 54426K [0xcdc00000, 0xd2c00000, 0xf8800000)
  eden space 48064K, 100% used [0xcdc00000,0xd0af0000,0xd0af0000)
  from space 15552K, 40% used [0xd0d20000,0xd1356b38,0xd1c50000)
  to   space 15040K, 0% used [0xd1d50000,0xd1d50000,0xd2c00000)
 PSOldGen        total 892928K, used 869520K [0x78400000, 0xaec00000, 0xcdc00000)
  object space 892928K, 97% used [0x78400000,0xad5243f8,0xaec00000)
 PSPermGen       total 786432K, used 185250K [0x48400000, 0x78400000, 0x78400000)
  object space 786432K, 23% used [0x48400000,0x538e8b10,0x78400000)
1016119.682: [GC [PSYoungGen: 54426K->6458K(58752K)] 923947K->875979K(951680K), 0.0316028 secs]
Heap after gc invocations=46516:
 PSYoungGen      total 58752K, used 6458K [0xcdc00000, 0xd2800000, 0xf8800000)
  eden space 47808K, 0% used [0xcdc00000,0xcdc00000,0xd0ab0000)
  from space 10944K, 59% used [0xd1d50000,0xd239eb68,0xd2800000)
  to   space 14592K, 0% used [0xd0b80000,0xd0b80000,0xd19c0000)
 PSOldGen        total 892928K, used 869520K [0x78400000, 0xaec00000, 0xcdc00000)
  object space 892928K, 97% used [0x78400000,0xad5243f8,0xaec00000)
 PSPermGen       total 786432K, used 185250K [0x48400000, 0x78400000, 0x78400000)
  object space 786432K, 23% used [0x48400000,0x538e8b10,0x78400000)
}

In the sample above, the percentage I'm interested in is that 97% immediately after the PSOldGen line. I can't grep for "object space" because that would give me PSPermGen, the 23% line as well. I don't care about that.
How can I read a line with the exact text "PSOldGen" and get that percentage on the very next line?
Would I be able to accomplish my objectives in one script? Or should I direct the percentage output to some other file and create another script that monitors that file?
If the script can be done purely in shell (ksh or bash), that'd be great, but other implementations like in python or perl are also cool.
Any pointers would be much appreciated. Thanks in advance.

Last edited by pludi; 06-14-2011 at 08:06 AM..

kenchen722

View Public Profile for kenchen722

Find all posts by kenchen722

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Monitoring log file

Hi, I ned to monitor the tomcat log file called "catalina.out" for "Out of memory" error. the script should monitor this file and send us the mail as soon as it finds the string "Out of memory" in the file. can ypu suggest me which is the best way to do this?

2. Shell Programming and Scripting

Online log monitoring script

#!/bin/bash tail /oracle/app/admin/ABC/bdump/alert_ABC.log >> tempoutput& Error=`egrep 'error|warn|critical|fail|ORA-1683' tempoutput` echo "$Error" |mailx -s "ABC Error " ABCD@domain.lk cat /dev/null > tempoutput I wrote this script and put in to cronjob every 5 min. so every 5...

3. Shell Programming and Scripting

Log folder size monitoring script

Hi All, Can anyone refer to me a readymade script for the purpose of log folder size monitoring script. Example : I have a log folder of size 10 G, and as the logs keep accumulating the folder gets full and i have to manually zip/remove the files in order to keep the server running. Something...

4. Shell Programming and Scripting

WPAR monitoring shell script suggestions needed

Hi All, This is for WPAR monitoring shell script, earlier opened thread was closed, had to open a new thread, as suggested I have used script as below, But am trying to get the output in below format, need suggestions with it. Below is the lswpar output, required output format. ...

5. Shell Programming and Scripting

script to mail monitoring output if required or redirect output to log file

Below script perfectly works, giving below mail output. BUT, I want to make the script mail only if there are any D-Defined/T-Transition/B-Broken State WPARs and also to copy the output generated during monitoring to a temporary log file, which gets cleaned up every week. Need suggestions. ...

6. Shell Programming and Scripting

Help needed: script for timely average from log file

Please repost your query: Help needed: script for timely average from log file - Thank you.

7. Shell Programming and Scripting

Help needed to create a UNIX Space monitoring script

Hi All, Its urgent.. pls help me out.. I want to create a KSH which should generate a report with the list of users and the files larger than 5 GB created by them in a direcorty and send autogenerated e-mail to them. my input would be users list,directory path and the file size (say 5 GB) ...

8. Shell Programming and Scripting

Monitoring script for a log file

Hi, I need to get a script working to monitor a log file and throw an alert via mailx as soon as a particular error is encountered. I do not want repeatative email notifications of same error so simply cat logfile and grepping the error would not work. Here is what i planned but it seems...

9. UNIX for Beginners Questions & Answers

Monitoring script for Log file

Hi, Iam new to unix , plz help me to write below script. I need to write a script for Monitoring log file when any error occurs it has to send a mail to specified users and it should be always pick latest error not the existing one and the script should be able to send mail all errors (more...

10. UNIX for Beginners Questions & Answers

Shell script for continuously monitoring log file

Hi I have written below log monitoring script to egrep multiple words and redirect the output to a text file and its working fine but I want to add some more below given functionality to it, which is very advance and im not very good in it, so please help if you can :) I am egrepping all the...

LEARN ABOUT DEBIAN

netapp::snapshot

NetApp::Snapshot(3pm)					User Contributed Perl Documentation				     NetApp::Snapshot(3pm)

NAME

       NetApp::Snapshot -- OO class for creating and managing snapshots

SYNOPSIS

	   use NetApp::Filer;
	   use NetApp::Snapshot;

	   my $filer   = NetApp::Filer->new( .... );

DESCRIPTION

       This class encapsulates a single NetApp snapshot, and provides methods for querying information about the snapshot, as well as methods for
       managing it.

METHODS

   get_parent
       Returns the NetApp::Aggregate or NetApp::Volume object for the aggregate or volume for which object is a snapshot.

   get_name
       Returns a string representing the name of the snapshot.

   get_date
       Returns the date the snapshot was created.

   get_used
       Returns the percentage of space used by snapshot.

   get_total
       Returns the percentage of total space used by the snapshot.

   get_snapshot_deltas
       Returns an array of NetApp::Snapshot:Delta objects, each representing a single delta for this snapshot.

   get_reclaimable
       Returns the amount of reclaimable space, if the snapshot is deleted.  Note that experimentally, this command has a lot of failure
       scenarios, most of which are reasonable (there are a lot of cases where you can't query this data).  Therefore, unlike most of the methods
       in this API, it doesn't raise a fatal exception if it can't query the information, it simply generates warnings.

   rename( $newname )
       Renames the snapshot to the specified name.

   restore( %args )
       This method is an interface to the "snap restore" command.  The argument syntax is:

	   $snapshot->restore(
	       type	       => 'vol' | 'file', # Defaults to vol
	       from_path       => $from_path,
	       to_path	       => $to_path,
	   );

       The 'type' argument maps to the -t CLI argument, and the 'to_path' argument maps to the -r CLI argument.  Refer to the na_snap(1) man page,
       and the "snap restore" documentation for further information.

perl v5.14.2							    2008-11-26						     NetApp::Snapshot(3pm)