Visit Our UNIX and Linux User Community

Scan log file for errors

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Scan log file for errors
# 1  
Old 12-14-2011
Scan log file for errors

Hi everyone.

I am still new to UNIX, and am having trouble figuring out how to create a script to scan a log file to look for errors based on a string.

We run AIX 5.3, and would like the ability to report all the instances of WebSphere Broker Execution groups crashing. This script would ideally exit with a status of 1 and list the Execution Group names that had crashed if an error was detected. This would then allow our scheduling tool to report the error back to the user.

An example of the error we would be scanning for is contained below:

Oct 22 10:01:53 <server-name> user:warn|warning WebSphere Broker v60011[999480]: (BRK_MQCSPA01)[4370]BIP2060W: The broker has detected that the
Execution Group EXG_CS06, process ID 1048594, has shutdown. : BRK_MQCSPA01.agent: /build/S600_P/src/AdminAgent/ImbAdminAgent.cpp: 4296: ImbA
dminAgent::startAndMonitorADataFlowEngine: :
Any help with this would be greatly appreciated.
# 2  
Old 12-14-2011
How about this
awk '/user:warn/ && /has shutdown/ {a=a","gensub(/.+\((.+)\).+/, "\\1",$0)}
END { if(a){ print substr(a,2); exit 2}}' log_file

Last edited by Chubler_XL; 12-14-2011 at 08:06 PM..
# 3  
Old 12-14-2011
Thanks Chubler_XL,

When I run your suggestion as a script:


awk '/user:warn/ && /has shutdown/ {a=a","gensub(/.+\((.+)\).+/, "\\1",$0)}
END { if(a){ print substr(a,2); exit 2}}' /var/mqsi/logs/CS/hub/user.log

I am getting the following error:

awk: Function gensub is not defined.

The input line number is 2. The file is /var/mqsi/logs/CS/hub/user.log.
The source line number is 1.
I believe that I have given the correct information for the log file, and do not understand what the issue is, would you have any suggesstions for me?
# 4  
Old 12-15-2011
gensub is a GNU awk function, If you have gawk use that otherwise this vanila awk script should do it:
awk '/user:warn/ && /has shutdown/ {sub(/^.*\(/,"");sub(/\).*$/,"");a=a","$0 }
END { if(a){ print substr(a,2); exit 2}}' infile

# 5  
Old 12-15-2011
Thank you Chubler_XL, that is working better now.

Instead of returning the Broker Queue manager name, is it possible to report the time and part of the string from the message?

Something along the lines of:

Oct 22 10:01:53: The broker has detected that the Execution Group EXG_CS06, process ID 1048594, has shutdown.

Thanks again, I really appreciate your help.
# 6  
Old 12-15-2011
awk '/user:warn/ && /has shutdown/ { match($0,"The broker[^.][^.]*[.]");print $1,$2,$3 ":", substr($0, RSTART,RLENGTH)}' myFile

# 7  
Old 12-15-2011
Thank you vgersh99,

That is what I am looking for!

One last question though, is there a way to only return the errors from the date that the code is run on? (ie, run the code today (12/16/2011) only return errors reported since 0000hrs)

Previous Thread | Next Thread
Test Your Knowledge in Computers #46
Difficulty: Easy
Regarding computer networking, the exact meaning of the term VPN is 'virtual protected network.'
True or False?

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Outputting Errors to a Log file

Good Morning, Every so often, I have copy scripts that to don't complete, but I don't immediately know why. It usually ends up being a permissions issue or a length issue. The scripts edit a log file, so I'd like to include any copy errors/issues in that file to check if the copies... (4 Replies)
Discussion started by: Stellaman1977
4 Replies

2. Shell Programming and Scripting

Scan of log file in Linux for entries in last 15 minutes for matching a pattern

Is there any way I can do scan of log file in Linux, where the log file entries for last 15 minutes can be searched for a particular pattern. The log file entries are in below format. 2014-01-27T23:08:53.924-0500 LDAP authentication error 2014-01-27T23:08:53.934-0500 LDAP authentication... (4 Replies)
Discussion started by: anandrudran
4 Replies

3. UNIX for Dummies Questions & Answers

Scan logs for errors in the last hour only.

Hi there. Is there a way to scan a specific log file for errors that occurred in the last hour (time when script is run - 60 minutes)? I have a script that will change to a directory where the log files are kept and will then grep the files for defined strings, but I need to make sure that... (2 Replies)
Discussion started by: jimbojames
2 Replies

4. Red Hat

How to scan hard errors in linux?

how to scan hard errors in linux Thanks&Regards, R.PRAVEEN (1 Reply)
Discussion started by: praveenvikram24
1 Replies

5. Shell Programming and Scripting

Finding errors in log file only in last 10 minutes

Hi there, I have a log file that I need to check every 10 minutes to find if a specific error exists but only in that 10 minute period. The reason is that the log is quite large, and will frequently contain these errors, so I only want alerting if it in the last 10 minutes - I don't want... (3 Replies)
Discussion started by: paul_vf
3 Replies

6. Shell Programming and Scripting

Log File Scan

I need to read the last line of a log file and save it, sleep for X minutes and read the last line again. If the line is the same, exit 1, otherwise sleep for X minutes until the last line contains 'Status: Process completed'. Can anyone offer advice here? Thanks. (2 Replies)
Discussion started by: mode09
2 Replies

7. Shell Programming and Scripting

Shell Script to continuously scan a log file

Hello members, I have some doubts on how to write a script that can reports success / failure of a batch job ? 1. Run a batch job: 2. Wait and search for a particular string in the Log file: tail -f log01*.txt | egrep -v "^SUCCESSFUL" echo "continue with the other tasks" ... (1 Reply)
Discussion started by: novice82
1 Replies

8. Shell Programming and Scripting

track the errors in log file

OS: SuSE Linux Enterprise Server 10 Goal: To track the errors in log file, If they exits users will be notify by email. We have a script below: SrchKey="SRVE0242I:" LogFile=/PATHtemOut.log MailTo=" http:// ! -f PATH/alert.last && touch PATH/alert.last egrep $SrchKey $LogFile... (3 Replies)
Discussion started by: sdhn1900
3 Replies

9. Shell Programming and Scripting

Scan a log file

hi guys, i am very new to scripting & lookin for a shell script/perl script which would scan another file with the keyword "no change" & take a count of the same. Let me know if any further details are required. (3 Replies)
Discussion started by: nhanda
3 Replies

10. Shell Programming and Scripting

redirect errors to log file

I am working on a generic script that will run a shell script with the arguments passed and redirect errors to one file, and all other output to another file. Then if there is anything in the error file it emails the error to me, otherwise it exits. The advantage for this approach is that I... (0 Replies)
Discussion started by: gandolf989
0 Replies

Featured Tech Videos