Using awk to Parse File Post: 302894649

Sponsored Content

Top Forums Shell Programming and Scripting Using awk to Parse File Post 302894649 by atticuss on Wednesday 26th of March 2014 01:52:52 PM

03-26-2014

Registered User

Quote:

Originally Posted by vbe

Can you tell us a bit more about the input file format:
I understand this is an extract, does it correspond to a specific job log, or we might find the same job later? etc...
Anything to clear how the parsing will work:
e.g.
Will we have to look 3rd line after we find "^Job Name " to find the string containing the System Number ( will always be the case...)?

Sure!

Here is the general logic:

Code:

Read six lines (header)
Get system number and batch name

Until end of file:
    Read five lines
    Get machine name, status, start and end dates and times
    If status is FAILURE
        Read two lines (clear error message)

No, duplicate job names will be present, however jobs will contain the same system numbers.

Also, since some jobs may have have ran on that specific day so there will be no data in them. In this case the fields in the output file would just be empty or null.

I.E

Code:

Job Name                     Last Start           Last End             ST Run     Pri/tit
____________________________ ____________________ ____________________ __ _______ ___
B9043CC_uwsprem_l_thd013sv_D 08/04/2010 22:03:55  03/05/2012 07:51:33  OI 22333537/0    

  Status/[Event]  Time                 Ntry ES  ProcessTime           Machine
  --------------  --------------------- --  --  --------------------- -------

B9043CC_uwsprem_l_thd024sv_D 03/06/2012 22:00:34  03/06/2012 22:00:42  OI 22333536/1    

  Status/[Event]  Time                 Ntry ES  ProcessTime           Machine
  --------------  --------------------- --  --  --------------------- -------

B9043BC_bond_ba_mf_loss_thd013sv_D                               03/06/2012 08:54:11  03/06/2012 11:44:06  OI 22303721/1    

  Status/[Event]  Time                 Ntry ES  ProcessTime           Machine
  --------------  --------------------- --  --  --------------------- ----------------------------------------
  [STARTJOB]      03/19/2014 17:45:00    0  PD  03/19/2014 17:45:00   
    <Event was Scheduled based on Job Definition.>

 B9043CC_bcmsloss_l_thd013sv_D                                   03/21/2014 08:46:48  03/21/2014 10:38:31  SU 22303721/110    

   Status/[Event]  Time                 Ntry ES  ProcessTime           Machine
   --------------  --------------------- --  --  --------------------- ----------------------------------------
   SUCCESS         03/19/2014 14:04:49   108  PD  03/19/2014 14:04:49   
   [FORCE_STARTJOB]  03/20/2014 13:39:15    0  PD  03/20/2014 13:39:15   
     < >
   STARTING        03/20/2014 13:39:15   109  PD  03/20/2014 13:39:16   machine.enviorment.net
   RUNNING         03/20/2014 13:39:17   109  PD  03/20/2014 13:39:17   machine.enviorment.net
   SUCCESS         03/20/2014 14:24:56   109  PD  03/20/2014 14:24:56   
   [FORCE_STARTJOB]  03/21/2014 08:46:47    0  PD  03/21/2014 08:46:47   
     < >
   STARTING        03/21/2014 08:46:47   110  PD  03/21/2014 08:46:48   tmachine.enviorment.net
   RUNNING         03/21/2014 08:46:48   110  PD  03/21/2014 08:46:49   machine.enviorment.net
   SUCCESS         03/21/2014 10:38:31   110  PD  03/21/2014 10:38:31

Last edited by atticuss; 03-28-2014 at 12:07 PM..

atticuss

View Public Profile for atticuss

Find all posts by atticuss

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Parse file using awk and work in awk output

hi guys, i want to parse a file using public function, the file contain raw data in the below format i want to get the output like this to load it to Oracle DB MARWA1,BSS:26,1,3,0,0,0,0,0.00,22,22,22.00 MARWA2,BSS:26,1,3,0,0,0,0,0.00,22,22,22.00 this the file raw format: Number of...

2. Shell Programming and Scripting

AWK - Parse a big file

INPUT SAMPLE Symmetrix ID : 000192601507 Masking View Name : TS00P22_13E_1 Last updated at : 05:10:18 AM on Tue Mar 22,2011 Initiator Group Name : 10000000c960b9cd Host Initiators { WWN : 10000000c960b9cd } Port Group Name :...

3. Shell Programming and Scripting

Parse a file with awk?

Hi guys (and gals). I need some help. I'm running an IVR purely on Asterisk where I capture the DTMFs. After pulsing each DTMF I have Asterisk write to a file with whatever was dialed (mostly used for record-keeping) and at the end of the survey I write all variables in a single line to a...

4. Shell Programming and Scripting

AWK Command parse a file based on string.

AWK Command parse a file based on string. I am trying to write a shell script to parse a file based on a string and move the content of the file to another file. Here is scenario. File content below Mime-Version: 1.0 Content-Type: multipart/mixed; ...

5. Shell Programming and Scripting

AWK script to parse a data in a file

Hi Unix gurus.. I have a file which has below data, It has several MQ Queue statistics; QueueName= 'TEST1' CreateDate= '2009-10-30' CreateTime= '13.45.40' QueueType= Predefined QueueDefinitionType= Local QMinDepth= 0 QMaxDepth= 0 QueueName= 'TEST2' CreateDate= '2009-10-30'...

6. Shell Programming and Scripting

Parse a file using awk

Hi Experts, I am trying to parse the following file; FILEA a|b|c|c|c|c a|b|d|d|d|d e|f|a|a|a|a e|f|b|b|b|boutput expected: a<TAB>b <TAB><TAB>c<TAB>c<TAB>c<TAB>c<TAB> <TAB><TAB>d<TAB>d<TAB>d<TAB>d<TAB> e<TAB>f <TAB><TAB>a<TAB>a<TAB>a<TAB>a<TAB> <TAB><TAB>b<TAB>b<TAB>b<TAB>b<TAB>*...

7. Shell Programming and Scripting

awk to parse html file

Is it possible in awk to parse a webpage (EDAR Gene Sequencing - Genetic Testing Company | The DNA Diagnostic Experts | GeneDx), the source code is attached. <title> EDAR Gene Sequencing <dt>Test Code:</dt> <dd>156 </dd> <dt>Turnaround Time:</dt> <dd>6-8 weeks </dd> ...

8. Shell Programming and Scripting

awk or perl to parse file

I have an input file attached that I am trying to parse in tab-delimanted format: The chromosomal variant column contains all the information: parse rules: 1. 4 zeros after the NC_ and the digits before the . 2. digits after the g. repeated twice separated by a tab 3. letter before the > 4....

9. Shell Programming and Scripting

awk parse result that match data from file

i run command that return this result,example : gigabitethernet2/2/4:NotPresent, gigabitethernet2/1/17:UP, gigabitethernet2/1/10:UP, gigabitethernet2/1/5:UP, gigabitethernet2/1/9:UP, gigabitethernet2/1/36:DOWN, gigabitethernet2/1/33:DOWN, gigabitethernet2/1/8:UP,...

10. Shell Programming and Scripting

How to parse this file using awk and output in CSV format?

My source file looks like this: Cust-Number = "101" Cust-Name="Joe" Cust-Town="London" Cust-hobby="tennis" Cust-purchase="200" Cust-Number = "102" Cust-Name="Mary" Cust-Town="Newyork" Cust-hobby="reading" Cust-purchase="125" Now I want to parse this file (leaving out hobby) and...