Script to capture string in a log file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Script to capture string in a log file
# 1  
Old 10-08-2014
Script to capture string in a log file

Dear all,

I have a log file to be analysed. this log file contains vaiours lines of code starting with date timestamp.

if my search string is exception then that resepective log statement starting from the date is required.

example:

Code:
2014/10/01 16:14:44.459|>=|E|X|19202496|2832| |||||||||||||||Uncaught
Exception in SilentScope: CDZServerFactory::newService(const CORBA_WChar *, const CORBA_WChar *): 0.002
cefactory.cpp:163: TraceLog message 2
2014/10/01 16:14:46.475|>=|E|X|19202496|5410| |||||||||||||||Uncaught
Exception in SilentScope: CDZServerFactory::newService(const CORBA_WChar *, const CORBA_WChar *): 0.001
WebIDocAutoSaveMgrImpl.cpp:615: TraceLog message 3
2014/10/01 16:47:00.564|>>|E| |19202496|7731|
|||||||||||||||**ERROR:WebIDocAutoSaveMgrImpl:WebIDocAutoSaveMgrImpl::CreateBackupFolder: Unable
to create Backup folder : [repo_proxy 24] FolderFacade::manageFolder -
(Helpers::InfoStore::Query::getObjectWithWhereClause) ISInfoObject has
not been found [WebIDocAutoSaveMgrImpl.cpp;615]
WebIDocAutoSaveMgrImpl.cpp:541: TraceLog message 4
2014/10/01 16:47:00.564|>=|E|X|19202496|7731| |||||||||||||||Uncaught
Exception in SilentScope: WebIDocAutoSaveMgrImpl:CreateBackupFolder:

out of these 4 logs statements, only the 3 needs to be retrieved.

can you please help me to advise what would be best way to write a script for this.

please note that the word exception should pull in the complete log statement which is contained in 4 lines.

--shravee

Moderator's Comments:
Mod Comment Please simply use code tags for data. Thanks.

Last edited by jim mcnamara; 10-08-2014 at 12:17 AM..
# 2  
Old 10-08-2014
Welcome to forums please show expected output as well
# 3  
Old 10-08-2014
And what code have you tried thus far? Please post it so we can help you.
# 4  
Old 10-08-2014
===== contents in the log file ======

2014/10/01 16:14:44.459|>=|E|X|19202496|2832| |||||||||||||||Uncaught
Exception in SilentScope: CDZServerFactory::newService(const CORBA_WChar *, const CORBA_WChar *): 0.002
cefactory.cpp:163: TraceLog message 2
2014/10/01 16:14:46.475|>=|E|X|19202496|5410| |||||||||||||||Uncaught
Exception in SilentScope: CDZServerFactory::newService(const CORBA_WChar *, const CORBA_WChar *): 0.001
WebIDocAutoSaveMgrImpl.cpp:615: TraceLog message 3
2014/10/01 16:47:00.564|>>|E| |19202496|7731|
|||||||||||||||**ERROR:WebIDocAutoSaveMgrImpl:WebIDocAutoSaveMgrImpl::CreateBackupFolder: Unable
to create Backup folder : [repo_proxy 24] FolderFacade::manageFolder -
(Helpers::InfoStore::Query::getObjectWithWhereClause) ISInfoObject has
not been found [WebIDocAutoSaveMgrImpl.cpp;615]
WebIDocAutoSaveMgrImpl.cpp:541: TraceLog message 4
2014/10/01 16:47:00.564|>=|E|X|19202496|7731| |||||||||||||||Uncaught
Exception in SilentScope: WebIDocAutoSaveMgrImpl:CreateBackupFolder

======== expected output =========

2014/10/01 16:14:44.459|>=|E|X|19202496|2832| |||||||||||||||Uncaught
Exception in SilentScope: CDZServerFactory::newService(const CORBA_WChar *, const CORBA_WChar *): 0.002
cefactory.cpp:163: TraceLog message 2
2014/10/01 16:14:46.475|>=|E|X|19202496|5410| |||||||||||||||Uncaught
Exception in SilentScope: CDZServerFactory::newService(const CORBA_WChar *, const CORBA_WChar *): 0.001
WebIDocAutoSaveMgrImpl.cpp:615: TraceLog message 3
2014/10/01 16:47:00.564|>=|E|X|19202496|7731| |||||||||||||||Uncaught
Exception in SilentScope: WebIDocAutoSaveMgrImpl:CreateBackupFolder


so what i need is a script file that can read the contents of this log file and produce a output as expected.

--shravee
# 5  
Old 10-08-2014
I am not having access to a machine right now so cant test a code but my logic would be something like this:

1. Loop on the file line by line
2. Add the line to an array by default
3. Continue adding the lines until you reach a line that starts with date.
4. At this point analyze if the existing lines in the array have exception word in it or not
5. If yes then print it to output file and flush the array and add next line to it
5. If no then flush the array and add next line to it
# 6  
Old 10-08-2014
if each log record in spanned across multiple lines,
Code:
awk '/^[0-9][0-9][0-9][0-9]\/[0-9][0-9]\/[0-9][0-9] [0-9][0-9]:/ {print "\n" $0}' file.log | awk '/Exception/' RS=

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Help on script to capture info on log file for a particular time frame

Hi I have a system running uname -a Linux cmovel-db01 2.6.32-38-server #83-Ubuntu SMP Wed Jan 4 11:26:59 UTC 2012 x86_64 GNU/Linux I would like to capture the contents of /var/log/syslog from 11:00AM to 11:30AM and sent to this info via email. I was thinking in set a cron entry at that... (2 Replies)
Discussion started by: fretagi
2 Replies

2. Shell Programming and Scripting

String capture from ip file

Dear All From below mention input file I want op file as mention. Kindly help. IP file: "BSCGNR4_IPA17_C" 329 140119 0717 RXOCF-105 KJO001_BASC_NG AC FAULTY DG ON DOOR OPEN Needed OP: 140119 0717 KJO001_BASC_NG AC FAULTY DG ON DOOR OPEN Note that string mark in red as variable in... (3 Replies)
Discussion started by: jaydeep_sadaria
3 Replies

3. Shell Programming and Scripting

How to capture a string enclose by a pattern within a file?

Hi all, My file :test.txt just like this: ........................... From: 333:123<sip:88888888888@bbbb.com To: <sip:123456@aaaaa.com ......................... I want a script to capture the string between sip: & @ Expect output: 88888888888 123456 Please help! (4 Replies)
Discussion started by: Alex Li
4 Replies

4. Shell Programming and Scripting

Shell script to capture ORA errors from Alert Log

Hi, as the title says, I am after a simple script, which will open the Alert log from an 11.2.0.1 Linux environment and mail the error message and description to a recipient email address. I can then schedule this job via cron and let it run every 15 minutes. I have searched online... (16 Replies)
Discussion started by: jnrpeardba
16 Replies

5. Shell Programming and Scripting

Capture all error message in Log file and send the Log file by email

Hi I have a requirement to write a script to capture all errors in a Logfile and send the file in email. If there is any error occurred the subject of email will be ERROR , If there are no error occurred the subject of email will be SUCCESS. So I created a Log file and put the Appropriate... (2 Replies)
Discussion started by: dgmm
2 Replies

6. Shell Programming and Scripting

Need to capture certain text from a string in a different file

Hi, I wanted to know how i could accomplish this in a script using ksh. Lets say there is a file called test.dat and it has a certain input like below : . . Hi = 56 Hi = 67 . . 1 record(s) selected Now i need to capture the numbers after the = sign and store them in a... (3 Replies)
Discussion started by: Siddarth
3 Replies

7. Shell Programming and Scripting

How to capture output to log file

Hi I have a script that will run multiple unix & sql commands. I want to see the output as well as capture it to a log file for further analysis. Is there an easy way to do that instead of adding "tee -a logfile" on everyline or even on the execute line (i.e. script | tee -s logfile). Thanks (1 Reply)
Discussion started by: nimo
1 Replies

8. Shell Programming and Scripting

capture output of file and send last string thereof to new file

Hello, If I run a program from within shell, the output is displayed in the command line terminal. Is there a way I can capture that output and choose only the very last string in it to send it to a new file? Thank you (6 Replies)
Discussion started by: Lorna
6 Replies

9. Shell Programming and Scripting

Capture the command run in the log file

Hi , I have seen some log files where they have captured the command that is being executed, comments present in the scripts and the out put of the command as well, through scripts. could any one of you please let me know how do i do that? Thanks in advance. Cheers, Waseem (4 Replies)
Discussion started by: ahmedwaseem2000
4 Replies

10. Shell Programming and Scripting

capture nohup log file

Hi, I am running my script using nohup, but I am not able to capture the log file for that process could naybody please help... Here is what I am doing.... nohup ./script & 1>/home/user1/log.txt but I am not able to capture the log.....Is there anyother way I can capture the log... (2 Replies)
Discussion started by: mgirinath
2 Replies
Login or Register to Ask a Question