Grep a section from an UNIX file obtaining only part of the data


 
Thread Tools Search this Thread
Top Forums UNIX for Beginners Questions & Answers Grep a section from an UNIX file obtaining only part of the data
# 1  
Old 07-19-2019
Grep a section from an UNIX file obtaining only part of the data

Hello,

I have a log file that has several sections "BEGIN JOB, End of job" like in the following example:

Code:
19/06/12 - 16:00:57 (27787398-449294): [I] BEGIN JOB j1(27787398-449294) JOB1

19/06/12 - 16:00:57 (27787398-449294): [I] DIGIT: 0
[I] number of present logs : 1
19/06/12 - 16:00:57 (27787398-449294): [I] The file /users/file1.dat.A0003HSI was rename to /users/file1.dat.001
19/06/12 - 16:00:57 (27787398-449294): [I] Sent to SERVER1 for transmission
19/06/12 - 16:00:57 (27787398-449294): [I] End of job j1(27787398-449294) JOB1

From each of these sections I need to extract the following data, if possible, with the following output format.
Code:
JOB1;SERVER1;file1.dat

Can you guide me through a possible way to do that?
Thanks a lot in advance.

Last edited by rbatte1; 07-22-2019 at 08:15 AM..
# 2  
Old 07-19-2019
Try
Code:
awk '/BEGIN JOB/, /End of job/ {if (/BEGIN JOB/ || /file/) print $NF; if (/Sent/) print $(NF-2)}' file
JOB1
/users/file1.dat.001
SERVER1

This User Gave Thanks to RudiC For This Post:
# 3  
Old 07-19-2019
Try:
Code:
awk '/Sent/{S[$4]=$8} /rename/{F[$4]=$NF} /End of job/{print $NF, S[$4], F[$4]}' OFS=\; file

Code:
JOB1;SERVER1;/users/file1.dat.001

This User Gave Thanks to Scrutinizer For This Post:
# 4  
Old 07-22-2019
Thanks!!! It works perfectly!!!!
# 5  
Old 07-22-2019
Hello mvalonso,

Could you please try following once.

Code:
awk '
BEGIN{
  OFS=";"
}
/BEGIN JOB/{
  if(value){
     print first,value,prev
  }
  value=first=prev=""
  flag=1
  first=$NF
}
flag && /file/{
  value=(value?value OFS:"")$NF
}
/End of job/{
  flag=""
  next
}
{
  gsub(/.*Sent to | for.*/,"")
  prev=$0
}
END{
  if(value){
     print first,prev,value
  }
}
'    Input_file

Thanks,
R. Singh
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to Grep of by section?

I have a script that outputs this as a file John Smith ---------------- memberOf: example1;sampletest;test memberOf: example2;sampletest;test memberOf: example3;sampletest;test memberOf: example4;sampletest;test A Member of 4 Groups Sally Smith ---------------- memberOf:... (4 Replies)
Discussion started by: ajetangay
4 Replies

2. UNIX for Dummies Questions & Answers

Grep a part of a line from a file

Hi, I have a file with thousands of lines as below INSERT INTO T_DIM_CLNT(CLNT_KY,CLNT_OBJ_ID,ISI_CLNT_ID,OPERN_ID,CLNT_NM,PRMRY_SIC_CD,PRMRY_SIC_DSC,RET_AGE_NBR,REC_CRT_TS,REC_DATA_EXTRC_TS,ETL_LOG_KY) VALUES ( ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)... (5 Replies)
Discussion started by: sudhakar T
5 Replies

3. Shell Programming and Scripting

Grep or print each section of a file on one line with a separator

I can obtain information from itdt inventory command however it display as below, I'd like to print each entity on one line but seperated by : the file is something like and each section ends with Volume Tag Drive Address 256 Drive State ................... Normal ASC/ASCQ... (3 Replies)
Discussion started by: gefa
3 Replies

4. UNIX for Dummies Questions & Answers

Copying part of a data file into another

Hi, I have a large number of data files each containing simple integers from 1 to around 25000 in ascending order. However, they are not in a specific progression; some numbers are missing in each file. For ex. datfile1 may have the numbers in order 1 2 4 6 7 8 12 ... 24996 24999 while datfile2... (8 Replies)
Discussion started by: latsyrc
8 Replies

5. Shell Programming and Scripting

Extract section of file based on word in section

I have a list of Servers in no particular order as follows: virtualMachines="IIBSBS IIBVICDMS01 IIBVICMA01"And I am generating some output from a pre-existing script that gives me the following (this is a sample output selection). 9/17/2010 8:00:05 PM: Normal backup using VDRBACKUPS... (2 Replies)
Discussion started by: jelloir
2 Replies

6. UNIX for Dummies Questions & Answers

How to get data only inside polygon created by points which is part of whole data from file?

hiii, Help me out..i have a huge set of data stored in a file.This file has has 2 columns which is latitude & longitude of a region. Now i have a program which asks for the number of points & based on this number it asks the user to enter that latitude & longitude values which are in the same... (7 Replies)
Discussion started by: reva
7 Replies

7. Shell Programming and Scripting

grep part of file name

Hi, I have a problem to use grep in my script . If I want to grep the file for example : PTWO9089.txt The code below works . grep ^PONE But, I dont know on how to grep the file like this 9066PTWO.txt I'll try to use this code : grep PTWO^ ,but it doesn't work. For your info, the... (4 Replies)
Discussion started by: badbunny9316
4 Replies

8. IP Networking

Obtaining your external IP address using a Unix Utility

Hello, this is my first post on the Unix forums. This is something that's been bothering me for a while, is there any particular UNIX/Linux application that will allow you to see you external IP address? :confused: ( The address beyond your router ) Thank you in advance, I could not find a... (4 Replies)
Discussion started by: inquen
4 Replies

9. UNIX for Dummies Questions & Answers

grep within certain part of file

Hi, Is it possible to grep only on a certain part of a file? Say I have file in.txt which contains below: 11/16 13:07:19.5436 --- ERROR 123 detected. 11/16 13:08:19.5436 --- Generating a <reading> event 11/16 13:08:19.7784 ---- Sending a <writing> event 11/16 14:08:37.4516 ---... (2 Replies)
Discussion started by: Orbix
2 Replies

10. SCO

Looking for guidance in obtaining a job in Unix Administration

I recently took a training through a college, and have obtained the CUSA certification, but I've been looking and don't see any jobs in unix out there! Does anyone know of hidden job markets in the unix administration area, located in the Detroit - Michigan area? (4 Replies)
Discussion started by: pkali290
4 Replies
Login or Register to Ask a Question