File Parsing Help


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting File Parsing Help
# 1  
Old 10-13-2008
File Parsing Help

Hello,

I have a file which contains groups of fields. These groups are separated by a blank line, to form a logical record.

Each line consists of a field-value pair.

If want to find all records where field 'd' has a value of '4' and if it does, I want the value of field 'a' (from the same record).

Here's an example input file:
Quote:
a 1
b 2
c 3
d 4
a 2
b 1
d 6

b 3
a 6
c 2

c 2
d 4
a 9

c 3
d 4
a 3

d 4
a 6
I want to end up with a file containing:
Quote:
1
6
Import things to nore about the input file are a) the number of records varies, b) not all records contain a 'd' field, c) not all records contain a 'a' field, e) fields can be in any order within a record.

I think the answer will be to use AWK but I have very little knowledge of AWK and have only used it for very basic things.

The OS is Sun 5.8 by the way.

Help would be greatly appreciated.

Thanks.

# 2  
Old 10-13-2008

Based on the input you supplied, the output should be:

Code:
1
9
3
6

This script will give you that:

Code:
awk '
/a/ { a = $2 }
/d/ { d = $2 }
/^$/ && d == 4 && a > 0 {
   print a 
   a = -1
   d = -1
}
END {
   if ( d == 4 && a > 0 ) print a
}
' "$FILE"

# 3  
Old 10-13-2008
Unclear

Seems to be a big gap between your requirements and the output you expect. Based on what you have stated the output should look like cfajohnson's awk script...correct???
# 4  
Old 10-13-2008
Sorry, you are correct, the output should have read:

Code:
 
1
9
3
6

Many thanks for your help cfajohnson.
# 5  
Old 10-13-2008
With Perl:
Code:
perl -00 -ne'print $1,"\n"if/d 4/&&/a (.)/' filename

And another AWK approach:

Code:
awk '/d 4/ && /a / {
  for (i=1; i<=NF; i++)
    if ($i == "a") print $(i+1)
	}' RS= filename


Last edited by radoulov; 10-13-2008 at 04:03 PM.. Reason: refactored
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

File Parsing

Hi Gurus, i have files like this and i want to rename it. server1_0_Log0000597500 server1_0_Log0000597501 server1_0_Log0000597502 server1_0_Log0000597503 server1_0_Log0000597504 server1_0_Log0000597505 server1_0_Log0000597506 server1_0_Log0000597507 server1_0_Log0000597508... (7 Replies)
Discussion started by: fedora132010
7 Replies

2. Shell Programming and Scripting

parsing data from a big file using keys from another smaller file

Hi, I have 2 files format of file 1 is: a1 b2 a2 c2 d1 f3 format of file 2 is (tab delimited): a1 1.2 0.5 0.06 0.7 0.9 1 0.023 a3 0.91 0.007 0.12 0.34 0.45 1 0.7 a2 1.05 2.3 0.25 1 0.9 0.3 0.091 b1 1 5.4 0.3 9.2 0.3 0.2 0.1 b2 3 5 7 0.9 1 9 0 1 b3 0.001 1 2.3 4.6 8.9 10 0 1 0... (10 Replies)
Discussion started by: Lucky Ali
10 Replies

3. Shell Programming and Scripting

Parsing of file for Report Generation (String parsing and splitting)

Hey guys, I have this file generated by me... i want to create some HTML output from it. The problem is that i am really confused about how do I go about reading the file. The file is in the following format: TID1 Name1 ATime=xx AResult=yyy AExpected=yyy BTime=xx BResult=yyy... (8 Replies)
Discussion started by: umar.shaikh
8 Replies

4. Shell Programming and Scripting

Parsing file, yaml file? Extracting specific sections

Here is a data file, which I believe is in YAML. I am trying to retrieve just the 'addon_domains" section, which doesnt seem to be as easy as I had originally thought. Any help on this would be greatly appreciated!! I have been trying to do this in awk and mostly bash scripting instead of perl... (3 Replies)
Discussion started by: Rhije
3 Replies

5. UNIX for Dummies Questions & Answers

Script for parsing details in a log file to a seperate file

Hi Experts, Im a new bee for scripting, I would ned to do the following via linux shell scripting, I have an application which throws a log file, on each action of a particular work with the application, as sson as the action is done, the log file would vanish or stops updating there, the... (2 Replies)
Discussion started by: pingnagan
2 Replies

6. Shell Programming and Scripting

Perl parsing compared to Ksh parsing

#! /usr/local/bin/perl -w $ip = "$ARGV"; $rw = "$ARGV"; $snmpg = "/usr/local/bin/snmpbulkget -v2c -Cn1 -Cn2 -Os -c $rw"; $snmpw = "/usr/local/bin/snmpwalk -Os -c $rw"; $syst=`$snmpg $ip system sysName sysObjectID`; sysDescr.0 = STRING: Cisco Internetwork Operating System Software... (1 Reply)
Discussion started by: popeye
1 Replies

7. Shell Programming and Scripting

need help in Parsing a CSV file and generate a new output file

Hi Scripting Gurus, I am trying to parse a csv file and generate a new output file. The input file will be a variable length in turns of rows and columns. output file will have 8 columns. we have three columns from the header for each set. just to give little bit more clarification each row... (15 Replies)
Discussion started by: vkr
15 Replies

8. Shell Programming and Scripting

Finding & Moving Oldest File by Parsing/Sorting Date Info in File Names

I'm trying to write a script that will look in an /exports folder for the oldest export file and move it to a /staging folder. "Oldest" in this case is actually determined by date information embedded in the file names themselves. Also, the script should only move a file from /exports to... (6 Replies)
Discussion started by: nikosey
6 Replies

9. Shell Programming and Scripting

Help me with parsing this file

Hi, I need a shell script that would parse this file /usr/share/i18n/locales/aa_DJ:title "Afar language locale for Djibouti (Cadu/Laaqo Dialects)." /usr/share/i18n/locales/aa_ER:title "Afar language locale for Eritrea (Cadu/Laaqo Dialects)." /usr/share/i18n/locales/aa_ER@saaho:title... (2 Replies)
Discussion started by: eamani_sun
2 Replies

10. Shell Programming and Scripting

Parsing a file

Hi, Please help in parsing the following file and write separate files by parsing the file for the new file's content. Main File: ------------ BEGIN FileName: FirstFile.txt Content of the File Start AAAAAAAA BBBBBBB Content of the File End END BEGIN FileName: SecondFile.txt... (11 Replies)
Discussion started by: aol12123
11 Replies
Login or Register to Ask a Question