Log File Manipulation


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Log File Manipulation
# 1  
Old 08-10-2011
Log File Manipulation

I have a log file which keeps on updating. What I need to do is write a different script, which could moniter the log file continously, and email some stakeholders if some error has occured..

log file gets a message from various sources, and after getting/processing the message, prints an sucess or a Error whatever the case may be..

its like..
Code:
 
...
New Message
log...
log...
log...
<Messagefrom source1>
log..
log..
Insert Success
...
New Message
log...
log...
log...
<Message from source2>
log..
log..
Insert Error

Now I need to keep listening to this log file, and whenever a "source2" message comes and and "Insert Error" is printed, I need to do a process(send en email to stakeholders)

How can this be achieved in Unix Shell-Script.
Please help.

---------- Post updated at 01:58 AM ---------- Previous update was at 01:53 AM ----------

okay. is it something to do with Log-File rotation?
# 2  
Old 08-10-2011
Assuming your log file is updated every time with 10 new lines, we are extracting the last ten lines and checking for the condition. You can use nawk instead of awk if the machine is Sun Solaris..
Code:
#!/bin/ksh

ERR_STATUS=$(tail -10 /path/to/inputfile.log | awk '$0 ~ /source2|Insert Error/{++i}(i==2){print "error ocured"}')
if [[ -n "$ERR_STATUS" ]]
then
	echo "Check log for Insert error" | mailx -s "Log - Insert Error" yourid@mail.com
fi

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Populating File data with custom manipulation on file names

Hi, I am confused how to proceed firther please find the problem below: Input Files: DCIA_GEOG_DATA_OCEAN.TXT DCIA_GEOG_DATA_MCRO.TXT DCIA_GEOG_DATA_CVAS.TXT DCIA_GEOG_DATA_MCR.TXT Output File Name: MMA_RFC_GEOG_NAM_DIM_LOD.txt Sample Record(DCIA_GEOG_DATA_OCEAN.TXT):(Layout same for... (4 Replies)
Discussion started by: Arun Mishra
4 Replies

2. Shell Programming and Scripting

Awk to convert a text file to CSV file with some string manipulation

Hi , I have a simple text file with contents as below: 12345678900 971,76 4234560890 22345678900 5971,72 5234560990 32345678900 71,12 6234560190 the new csv-file should be like: Column1;Column2;Column3;Column4;Column5 123456;78900;971,76;423456;0890... (9 Replies)
Discussion started by: FreddyDaKing
9 Replies

3. UNIX for Dummies Questions & Answers

Filtering records from 1 file based on some manipulation doen on second file

Hi, I am looking for an awk script which should help me to meet the following requirement: File1 has records in following format INF: FAILEd RECORD AB1234 INF: FAILEd RECORD PQ1145 INF: FAILEd RECORD AB3215 INF: FAILEd RECORD AB6114 ............................ (2 Replies)
Discussion started by: mintu41
2 Replies

4. Shell Programming and Scripting

value in file - manipulation

Hi Forum. I have the following 2 files: edw_mf_bypass_msg.txt and EDW_server.cfg. edw_mf_bypass_msg.txt - File#1 contains the following text To EDW Support: This is an automatic email sent from var_hostname. Please note that the Mutual Fund load did not run today due to previous... (2 Replies)
Discussion started by: pchang
2 Replies

5. Shell Programming and Scripting

File manipulation

Legends, Please help me to get the following I have a file abc.txt with the following contents 12 13 14 15 And, i want to get the output to a variable like below 12,13,14,15 .... How do i do this? Regards, san Please use code tags when posting data and code samples! (5 Replies)
Discussion started by: sdosanjh
5 Replies

6. Shell Programming and Scripting

File Manipulation...

Hi Freinds, :b: i have a flat file with below format... 1234,Hary,102.55 4567,Maria,250.40 78942,suzan,261.60 48965,Harun,179.32 so I need a script that can get me as below format... 1) 1234,Hary,103 2) 4567,Maria,250 3) 78942,suzan,262 4) 48965,Harun,179 Which means, it... (6 Replies)
Discussion started by: malcomex999
6 Replies

7. Shell Programming and Scripting

File manipulation

To all Guru I have a file like test.txt 111,122,212,123 data11,date12, data13, data14...data1n data21,date22, data23, data24...data2n data31,date32, data33, data34...data3n ... ... .. datan1,daten2, datan3, datan4...datann END I have to load this data into oracle , where first... (1 Reply)
Discussion started by: u263066
1 Replies

8. Shell Programming and Scripting

More log manipulation

wasn't sure if this should have a new thread since I'm still working on the same job I asked a question about earlier. But it's a different problem/question so I guess it deserves a new thread.... I have a log with roughly 10000 lines in it, each one has a timestamp. The problem is, the time... (8 Replies)
Discussion started by: StevePace
8 Replies

9. Shell Programming and Scripting

Help with log manipulation

Hi there, Scripting isnt my strong point, so any help is appreciated greatly. I have a large log file which contains details of user requests. My aim is to pull out the Time, IP address and source fields from every record but my problem is that when a request fails, the record is incomplete... (3 Replies)
Discussion started by: StevePace
3 Replies

10. Programming

need help with file manipulation

I've been able to open and write data to files but I need to know how to search a file for a hex string and replace it. (2 Replies)
Discussion started by: angelfly
2 Replies
Login or Register to Ask a Question