Text File Parsing


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Text File Parsing
# 1  
Old 02-26-2008
Text File Parsing

Hey Guys.I am a newbie on Bash Shell Scripting and Perl.And I have a question about file parsing.
I have a log file which contains reports about a communication device.I need to take some of the reports from the log file.Its hard to explain the issue.but shortly I can say that, the reports has a unique report no. and this report number is located at the 2nd or 3rd line and at the end of the report.How can I parse these reports?(I need all of the lines like below.)
It is very important for me.I am waiting for your fast response
Thanking you in advanced

A tiny part of he log file:



INITSX1 2008-02-07 15:45:52 TH

00048 00000000 M147AA03 M1SNSK04
ANOMALY REPORT

ERROR TYPE 1531 CS_MW_COMM_FLT SYSTEM REPORT
-------------------------------------------------------------------------
45:52:07 NA = 0435
ERCLAS SEQ RLVL FMM PROC CS : IP USERDATA
NOTIFY 18 NONE 5005 AA30 15A8:9379 80 A0 12 24 FF FF FF FF 00 00

UNSOLICITED REPORT NO = 00048



INITSX1 2008-02-07 15:46:00 TH
PSW001 0130/000C/0005
SEQ=7734+2007-12-31 00104 00000000 M147AA03 M1SNSK04
SWA-CE LOAD

ACTIVATE-CEOVLD-OBSERV SUCCESSFUL
RESULT PART 0001 -
-------------------------------------------------------------------------
REQUESTED START TIME: = 15:30
REQUESTED STOP TIME : = 15:45
PERIOD: = 00:15

NO PROCESSORS IN OVERLOAD

REPORT FOLLOWS NO = 00104


INITSX1 2008-02-07 15:46:07 TH

00048 00000000 M147AA03 M1SNSK04
ANOMALY REPORT

ERROR TYPE 1531 CS_MW_COMM_FLT SYSTEM REPORT
-------------------------------------------------------------------------
46:07:01 NA = 8402
ERCLAS SEQ RLVL FMM PROC CS : IP USERDATA
NOTIFY 18 NONE 5005 E430 15A8:9379 C0 9D 12 24 FF FF FF FF 00 00

UNSOLICITED REPORT NO = 00048



INITSX1 2008-02-07 15:46:20 TH

00048 00000000 M147AA03 M1SNSK04
ANOMALY REPORT

ERROR TYPE 1530 CS_S12_UX_AU_FLT SYSTEM REPORT
-------------------------------------------------------------------------
46:20:08 NA = C21F
ERCLAS SEQ RLVL FMM PROC CS : IP USERDATA
NOTIFY 10 NONE 5005 AA30 15A8:9379 80 A4 F1 01 2E 02 06 04 00 00

UNSOLICITED REPORT NO = 00048



INITSX1 2008-02-07 15:46:21 TH

00048 00000000 M147AA03 M1SNSK04
ANOMALY REPORT

ERROR TYPE 1531 CS_MW_COMM_FLT SYSTEM REPORT
-------------------------------------------------------------------------
46:21:02 NA = C600
ERCLAS SEQ RLVL FMM PROC CS : IP USERDATA
NOTIFY 18 NONE 5005 0230 15A8:9379 10 A7 12 24 FF FF FF FF 00 00

UNSOLICITED REPORT NO = 00048



INITSX1 2008-02-07 15:46:31 TH

05758 00000000 M147AA03 M1SNSK04
SWA-ORJ-MEAS REPORTING

WARNING
-------------------------------------------------------------------------
FILE READY FOR COPY ON TAPE - START FORMAT COMMAND
CALLTYPE LOG LOG NBR NBR REC
FILE DEV AVAIL USED SIZE
RECS RECS
---------------------------------------------------------------
CELOBS 4553 1032 40 40 2048

UNSOLICITED REPORT NO = 05758


I want to parse the reports like in red.I need to take different reports as well.In the log file there is more than one report for each report types.I mean;some of the reports are taken every 15 minute.Some of them are hourly and log file contains the reports for 2-3 days.And it means that I should have more than one reports for each report types.

The issue is a little bit hard.Any suggestion is welcome for me.I appriciate for your helps.

Last edited by Djlethal; 02-27-2008 at 03:25 AM..
# 2  
Old 02-26-2008
You would be better off posting a much smaller version of the log file. No way is anyone going to read/comprehend your entire post.

Secondly grep is your friend. You can grep in things that you want, you can also grep -v to exclude things that you don't want. you can use cut to get one part of a line, but it needs to be delimited with something. You can also look at regular expressions which will help you look for any pattern as long as you know the regular expression for that pattern.
# 3  
Old 02-27-2008
thanks for the suggestions.I know grep should be my best friend.But as I told before the pattern that I want to find, is placed on the 3rd line and at the last line.I need the lines between them also.How I can grep these lines?(3rd line till the last line)
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parsing text file

Hi Friends, I am back for the second round today - :D My input text file is this way Home friends friendship meter Tools Mirrors Downloads My Data About Us Help My own results BLAT Search Results ACTIONS QUERY SCORE START END QSIZE IDENTITY CHRO STRAND ... (7 Replies)
Discussion started by: jacobs.smith
7 Replies

2. Shell Programming and Scripting

Parsing text file

I'm totally stumped with how to handle this huge text file I'm trying to deal with. I really need some help! Here is what is looks like: ab1ba67c331a3d731396322fad8dd71a3b627f89359827697645c806091c40b9 0.2 812a3c3684310045f1cb3157bf5eebc4379804e98c82b56f3944564e7bf5dab5 0.6 0.6... (3 Replies)
Discussion started by: comp8765
3 Replies

3. Programming

Parsing a Text file using C++

I was trying to parse the text file, which will looks like this ###XYZABC#### ############ int = 4 char = 1 float = 1 . . ############ like this my text file will contains lots of entries and I need to store these entries in the map eg. map.first = int and map.second = 4 same way I... (5 Replies)
Discussion started by: agupta2
5 Replies

4. Programming

Parsing a text file in Tcl

Hi all, I need to parse through a text file searching for a specific string, then after I find this string read in remaining data off the line to a variable. I've tried various things and can't seem to get any to work. Any help would be much appreciated. (2 Replies)
Discussion started by: caboose57
2 Replies

5. Shell Programming and Scripting

Need help parsing a text file

I have a text file: router1#sh ip blah blah | incl --- Gi2/8 10.60.4.181 --- 10.60.123.175 11 0000 0000 355K Gi2/8 10.60.83.28 --- 224.10.10.26 11 F9FF 3840 154K Gi2/8 10.60.83.198 --- ... (1 Reply)
Discussion started by: streetfighter2
1 Replies

6. Shell Programming and Scripting

Log file text parsing

I'm new to scripting and was wondering if there was a way to accomplish what I want below using shell script(s). If there is a log file as follows, where the id is the unique id of a process, with the timestamp of when the process began and completed displayed, would it be possible to find the... (3 Replies)
Discussion started by: dizydolly
3 Replies

7. UNIX for Dummies Questions & Answers

Help parsing and replacing text with file name

Hi everyone, I'm having trouble figuring this one out. I have ~100 *.fa files with multiple lines of fasta sequences like this: file1.fa >xyzsequence atcatgcacac...... ataccgagagg..... atataccagag..... >abcsequence atgagatatat..... acacacggd..... atcgaacac.... agttccagat.... The... (2 Replies)
Discussion started by: mycoguy
2 Replies

8. Shell Programming and Scripting

Parsing text from file

Any ideas? 1)loop through text file 2)extract everything between SOL and EOL 3)output files, for example: 123.txt and 124.txt for the file below So far I have: sed -n "/SOL/,/EOL/{p;/EOL/q;}" file Here is an example of my text file. SOL-123.go something goes here something goes... (0 Replies)
Discussion started by: ndnkyd
0 Replies

9. Shell Programming and Scripting

Need help in parsing text file contents

Hi, I need some help in extracting the Exception block between the lines 21 Feb 01:18:54:146 ERROR com.orbits.frameworks.integrationframework.ValidationException - Caught exception in validateRequest() (PID=565584) and 21 Feb 01:18:55:149 INFO ... (0 Replies)
Discussion started by: Alecs
0 Replies

10. Shell Programming and Scripting

Parsing Lines from a text file

Hello Guru's I know there are people who live to be able to help people like me. That's why I'm here! I have a text file that has a corresponding address information that I need to be able to get maybe as a Unix Function. The text file contains the following: AIX17_JB_C;... (3 Replies)
Discussion started by: sallender
3 Replies
Login or Register to Ask a Question