Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Extract all ERROR's on LOG File

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Extract all ERROR's on LOG File
# 1  
Old 09-26-2011
Extract all ERROR's on LOG File
Hello,

As I am still in trouble to easly extract all error's by date in log file, I am deply requesting your help ...

Here is an example of one error (the log file may contain a huge amont of error's, I must be able to extract all error for a day in parameter):

Code:
***** L1 FILE TEX_SAP4_ITD2_E_MU20060518004324 - CPU TIME 2010-06-09T09:54:53
GMT_PRODUCT_CREATION_TIME = 2010-06-09T09:54:53
Execution OK
***** L1 FILE TEX_SAP4_ITD2_E_MU20060518004335 - CPU TIME 2010-06-09T09:54:59
 Input file is empty or contains only comments
ERROR : Cannot open attitude binary file ATNV_FDLVMA_DAP051109051109_00302.BIN with initAttJ2000 : ier= 1
GMT_PRODUCT_CREATION_TIME = 2010-06-09T09:54:59
Bad Execution. See /DATA/SATURN1//DATA/SPD_TEX_FILES/LOGS/TEX.log or /DATA/SATURN1//DATA/SPD_TEX_FILES/TMP//JDB_SPD_NPD_20051109_20060831_20100609074221_stat_specc.
5+2010/06/09-09:55:03+produire_fichier_SPD.ksh+Erreur lors du lancement de l'executable : /DATA/SATURN1//SOFT/SPD_TEX/SPD_L1/bin//generer_SPD_ITD2.exe
***** L1 FILE TEX_SAP4_ITD2_E_MU20060518112848 - CPU TIME 2010-06-09T09:55:03
GMT_PRODUCT_CREATION_TIME = 2010-06-09T09:55:03
Execution OK

As if I use grep I can only see the line with error, I need help for a command line that will extract by DATE all error found like this :

Code:
***** L1 FILE TEX_SAP4_ITD2_E_MU20060518004335 - CPU TIME 2010-06-09T09:54:59
 Input file is empty or contains only comments
ERROR : Cannot open attitude binary file ATNV_FDLVMA_DAP051109051109_00302.BIN with initAttJ2000 : ier= 1
GMT_PRODUCT_CREATION_TIME = 2010-06-09T09:54:59
Bad Execution. See /DATA/SATURN1//DATA/SPD_TEX_FILES/LOGS/TEX.log or /DATA/SATURN1//DATA/SPD_TEX_FILES/TMP//JDB_SPD_NPD_20051109_20060831_20100609074221_stat_specc.
5+2010/06/09-09:55:03+produire_fichier_SPD.ksh+Erreur lors du lancement de l'executable : /DATA/SATURN1//SOFT/SPD_TEX/SPD_L1/bin//generer_SPD_ITD2.exe

I need to be able to filter all error's by date like :

grep 2010-06-09 | command ....


Thanks in advanced for your help .. I am completly lost on this. Thanks.
# 2  
Old 09-26-2011
Code:
awk '{
    if ($0 ~ "^[*]+.*2010-06-09.*$") {
        if (f) print s
        s = f = 0
    } if ($0 ~ "ERROR") f = 1
    s = s ? s "\n" $0 : $0
}' file

Moderator's Comments:
Mod Comment Some posts have been moved to a new thread.
Last edited by shamrock; 09-26-2011 at 12:44 PM.. Reason: var typo
These 2 Users Gave Thanks to shamrock For This Post:
Aswex SilvesterJ
# 3  
Old 09-27-2011
Dear shamrock,

thanks for your help and time given but the output does not only contain error info, it also return info that I do not want :

Is there anything you can do to get rid of the "Execution OK" as I only want to get the ERROR info ?

Also, do you mind to show me where to insert the DATE as variable instead of static value

Code:
"^[*]+.*2010-06-09.*$"

In another hand, your code seems to take a certain amont of time to get the result on screen and exit... I first think it wasn't working, were you aware of this ?


Thanks for your help.
# 4  
Old 09-27-2011
Quote:
Originally Posted by Aswex
Dear shamrock,

thanks for your help and time given but the output does not only contain error info, it also return info that I do not want :
That is because I went off the input sample you posted and the posted awk script works on that...and if you want a different output then post a better sample of the input and the expected output.
Quote:
Originally Posted by Aswex
Is there anything you can do to get rid of the "Execution OK" as I only want to get the ERROR info ?
I dont get the "execution OK" in the output of the posted awk script...
Quote:
Originally Posted by Aswex
Also, do you mind to show me where to insert the DATE as variable instead of static value
That is one of awk's limitations unless you want to get the current date but backwards means you will have to use perl or other utility that does date and time calculations for you...
Quote:
Originally Posted by Aswex
Code:
"^[*]+.*2010-06-09.*$"

In another hand, your code seems to take a certain amont of time to get the result on screen and exit... I first think it wasn't working, were you aware of this ?


Thanks for your help.
That maybe the case if your input file is too big...but as i am not working off your input file theres no way for me to forsee that...Smilie
# 5  
Old 09-28-2011
Going off your sample...

I created a file named err.txt and pasted your sample then ran:
Code:
grep -B2 -A3 "2010-06-09" err.txt |grep -B2 -A3 ERROR

My output was:
Code:
[ddreggors@thor ~]$ grep -B2 -A3 "2010-06-09" err.txt |grep -B2 -A3 ERROR
***** L1 FILE TEX_SAP4_ITD2_E_MU20060518004335 - CPU TIME 2010-06-09T09:54:59
 Input file is empty or contains only comments
 ERROR : Cannot open attitude binary file ATNV_FDLVMA_DAP051109051109_00302.BIN with initAttJ2000 : ier= 1
 GMT_PRODUCT_CREATION_TIME = 2010-06-09T09:54:59
 Bad Execution. See /DATA/SATURN1//DATA/SPD_TEX_FILES/LOGS/TEX.log or /DATA/SATURN1//DATA/SPD_TEX_FILES/TMP//JDB_SPD_NPD_20051109_20060831_20100609074221_stat_specc.
 5+2010/06/09-09:55:03+produire_fichier_SPD.ksh+Erreur lors du lancement de l'executable : /DATA/SATURN1//SOFT/SPD_TEX/SPD_L1/bin//generer_SPD_ITD2.exe

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extract data from a log file and put it in a file

Hi, I would like to seek your help for a script that will extract data from log file and put it in a file. Sample log file 2018-10-23 12:33:21 AI ERROR -- tpid: SAMPLE_TH account: 123456789 aiSessionNumber: 660640464 mapName: xxx to yyy errorDesc: Translation Error:ErrorNumber : 993 ... (2 Replies)
Discussion started by: neverwinter112
2 Replies

2. Shell Programming and Scripting

How to extract start/end times from log file to CSV file?

Hi, I have a log file (log.txt) that which contains lines of date/time. I need to create a script to extract a CSV file (out.csv) that gets all the sequential times (with only 1 minute difference) together by stating the start time and end time of this period. Sample log file (log.txt) ... (7 Replies)
Discussion started by: Mr.Zizo
7 Replies

3. UNIX for Dummies Questions & Answers

Extract Numbers from a log file

Hi, I am trying to grep/extract the number list from this log file, can I get some help on this. I can grep the word 'href' to see the numbers, but it is resulting with the complete line. Content of my file: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN"> <html> <head>... (4 Replies)
Discussion started by: Sajjadmehdi
4 Replies

4. Shell Programming and Scripting

Need to extract a String from log file

Hi i am having a logfile which contain lot of entires, but i need extract a word after if i found a line that contains a particular string as "ENROLLMENT_EXCEPTION - Exception". please help me in getting a script to do this. Regards C. Suresh (5 Replies)
Discussion started by: sumeeva1907
5 Replies

5. Shell Programming and Scripting

Extract IP Address from Log File

I have a log file with several IP addresses in it:- 2012-12-06 16:05:05,885 NOTICE **SNMP** Alarm was created: (LicenseClientRejected) Client Remote Peer /125.111.64.125:2573 was Rejected Property=/125.111.64.125:2573, Client Remote Peer /125.111.64.125:2573 was Rejected **SNMP**.... (5 Replies)
Discussion started by: BHM
5 Replies

6. Shell Programming and Scripting

Extract various information from a log file

Hye ShamRock If you can help me with this difficult task for me then it will save my day Logs : ================================================================================================================== ... (4 Replies)
Discussion started by: SilvesterJ
4 Replies

7. Shell Programming and Scripting

Script extract from log file

Hi i new to scripting and am trying to create a script to pull my current of logs from /var/logs/secure and name it securelog-Month-Day-Hour.txt example: grep 'Mar 5 11' /var/logs/secure > /home/(user)/Documents/Logs/mylog-02-1-11 How do i set the targeted strings to be the current... (2 Replies)
Discussion started by: M47H415
2 Replies

8. Shell Programming and Scripting

How to extract certain part of log file?

Hi there, I'm having some problem with UNIX scripting (ksh), perhaps somebody can help me out? For example: ------------ Sample content of my log file (text file): -------------------------------------- File1: .... info_1 ... info_2 ... info_3 ... File2: .... info_1 ... info_2 ...... (10 Replies)
Discussion started by: superHonda123
10 Replies

9. Shell Programming and Scripting

Extract values from log file

I would like to write a shell script that will parse through a file similar to the sample below. The data in the file is redirected from rsync into a log file. I would like to call a shell script to parse through and pick out the number beside the percent sign inside the parentheses in the last... (5 Replies)
Discussion started by: wdympcf
5 Replies

10. Shell Programming and Scripting

extract a portion of log file

hello, I want to grep the log file according to time and get the portion of log from one particular time to other. I can grep for individual lines by time but how should I print lines continuously from given start time till end till given end time. Appreciate your ideas, Thanks chandra (8 Replies)
Discussion started by: chandra004
8 Replies
Login or Register to Ask a Question