Need help with parsing a file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Need help with parsing a file
# 1  
Old 02-22-2011
Need help with parsing a file

I trying to get only the highest version of the file names from an file which has list of file names.

EX:
Code:
CATEGORYDISPLAY JSP.A-SRC_BLD;2.4
CATEGORYDISPLAY JSP.A-SRC_BLD;2.5
CATEGORYDISPLAY JSP.A-SRC_BLD;2.1
CATEGORYDISPLAY JSP.A-SRC_BLD;2.2

The Script should display only the highest version, which is CATEGORYDISPLAY JSP.A-SRC_BLD;2.5

Can this be done with grep? Could anyone shed some light?



File Content :

Code:
 
CATEGORYDISPLAY JSP.A-SRC_BLD;2.4
CATEGORYDISPLAY JSP.A-SRC_BLD;2.5
BRANDDISPLAY JSP.A-SRC_BLD;2.5
BRANDDISPLAY JSP.A-SRC_BLD;2.6
BUNDLEDISPLAY JSP.A-SRC_BLD;2.6
BUNDLEDISPLAY JSP.A-SRC_BLD;2.7
CACHEDFOOTERDISPLAY JSP.A-SRC_BLD;2.25
CACHEDFOOTERDISPLAY JSP.A-SRC_BLD;2.26
CACHEDPRODUCTONLYDISPLAY JSP.A-SRC_BLD;2.25
CACHEDPRODUCTONLYDISPLAY JSP.A-SRC_BLD;2.26
CACHEDPRODUCTSEARCHRESULTBLOCK JSP.A-SRC_BLD;2.10
CACHEDPRODUCTSEARCHRESULTBLOCK JSP.A-SRC_BLD;2.11


Last edited by pludi; 02-22-2011 at 11:03 AM..
# 2  
Old 02-22-2011
Where infile.txt is the list you posted:

Code:
for JSP in `cut -d' ' -f1 infile.txt | uniq `
do   
       grep ${JSP} infile.txt | sort -rn | head -1
done

Returned:

CATEGORYDISPLAY JSP.A-SRC_BLD;2.5
BRANDDISPLAY JSP.A-SRC_BLD;2.6
BUNDLEDISPLAY JSP.A-SRC_BLD;2.7
CACHEDFOOTERDISPLAY JSP.A-SRC_BLD;2.26
CACHEDPRODUCTONLYDISPLAY JSP.A-SRC_BLD;2.26
CACHEDPRODUCTSEARCHRESULTBLOCK JSP.A-SRC_BLD;2.11

I should point out that this script ignores " JSP.A-SRC_BLD".

Last edited by mfsteve; 02-22-2011 at 11:42 AM..
# 3  
Old 02-22-2011
See if this works for you:
Code:
#!/usr/bin/ksh
mPrevFN="First_Time"
IFS=";"
while read mFName mVersion
do
  if [[ "${mFName}" != "${mPrevFN}" ]]; then
    if [[ "${mPrevFN}" != "First_Time" ]]; then
      echo ${mPrevFN} ${mPrevV}
    fi
  fi
  mPrevFN=${mFName}
  mPrevV=${mVersion}
done < input_file
if [[ "${mPrevFN}" != "First_Time" ]]; then
  echo ${mPrevFN} ${mPrevV}
fi

# 4  
Old 02-22-2011
Code:
nawk -F';' '{a[$1]=($1 in a)?((a[$1]>$2)?a[$1]:$2):$2}END{for (i in a) print i FS a[i]}' myFile

# 5  
Old 02-22-2011
Thank you! it works great..

Could you please explain me how it works?

I'm also trying to understand through awk docs.


Quote:
Originally Posted by vgersh99
Code:
nawk -F';' '{a[$1]=($1 in a)?((a[$1]>$2)?a[$1]:$2):$2}END{for (i in a) print i FS a[i]}' myFile

# 6  
Old 02-22-2011
Using Perl:-

Code:
#!/usr/bin/perl

use strict ;
use warnings ;

my %h ;
while (<DATA>) {
	(my $k, my $v) = split /;/ ;
	chomp $v ;
	$h{$k} .= "$v " ;
		}

END {
	foreach (keys %h) {
		my @a = sort {$b <=> $a} ( split / /,$h{$_} );
		print "$_;$a[0]","\n" ;
		}
	
	}

__DATA__
CATEGORYDISPLAY JSP.A-SRC_BLD;2.4
CATEGORYDISPLAY JSP.A-SRC_BLD;2.5
BRANDDISPLAY JSP.A-SRC_BLD;2.5
BRANDDISPLAY JSP.A-SRC_BLD;2.6
BUNDLEDISPLAY JSP.A-SRC_BLD;2.6
BUNDLEDISPLAY JSP.A-SRC_BLD;2.7
CACHEDFOOTERDISPLAY JSP.A-SRC_BLD;2.25
CACHEDFOOTERDISPLAY JSP.A-SRC_BLD;2.26
CACHEDPRODUCTONLYDISPLAY JSP.A-SRC_BLD;2.25
CACHEDPRODUCTONLYDISPLAY JSP.A-SRC_BLD;2.26
CACHEDPRODUCTSEARCHRESULTBLOCK JSP.A-SRC_BLD;2.10
CACHEDPRODUCTSEARCHRESULTBLOCK JSP.A-SRC_BLD;2.11

# 7  
Old 02-22-2011
Code:
sort -rn infile |awk -F \; '!a[$1]++'

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

File Parsing

Hi Gurus, i have files like this and i want to rename it. server1_0_Log0000597500 server1_0_Log0000597501 server1_0_Log0000597502 server1_0_Log0000597503 server1_0_Log0000597504 server1_0_Log0000597505 server1_0_Log0000597506 server1_0_Log0000597507 server1_0_Log0000597508... (7 Replies)
Discussion started by: fedora132010
7 Replies

2. Shell Programming and Scripting

parsing data from a big file using keys from another smaller file

Hi, I have 2 files format of file 1 is: a1 b2 a2 c2 d1 f3 format of file 2 is (tab delimited): a1 1.2 0.5 0.06 0.7 0.9 1 0.023 a3 0.91 0.007 0.12 0.34 0.45 1 0.7 a2 1.05 2.3 0.25 1 0.9 0.3 0.091 b1 1 5.4 0.3 9.2 0.3 0.2 0.1 b2 3 5 7 0.9 1 9 0 1 b3 0.001 1 2.3 4.6 8.9 10 0 1 0... (10 Replies)
Discussion started by: Lucky Ali
10 Replies

3. Shell Programming and Scripting

Parsing of file for Report Generation (String parsing and splitting)

Hey guys, I have this file generated by me... i want to create some HTML output from it. The problem is that i am really confused about how do I go about reading the file. The file is in the following format: TID1 Name1 ATime=xx AResult=yyy AExpected=yyy BTime=xx BResult=yyy... (8 Replies)
Discussion started by: umar.shaikh
8 Replies

4. Shell Programming and Scripting

Parsing file, yaml file? Extracting specific sections

Here is a data file, which I believe is in YAML. I am trying to retrieve just the 'addon_domains" section, which doesnt seem to be as easy as I had originally thought. Any help on this would be greatly appreciated!! I have been trying to do this in awk and mostly bash scripting instead of perl... (3 Replies)
Discussion started by: Rhije
3 Replies

5. UNIX for Dummies Questions & Answers

Script for parsing details in a log file to a seperate file

Hi Experts, Im a new bee for scripting, I would ned to do the following via linux shell scripting, I have an application which throws a log file, on each action of a particular work with the application, as sson as the action is done, the log file would vanish or stops updating there, the... (2 Replies)
Discussion started by: pingnagan
2 Replies

6. Shell Programming and Scripting

File Parsing Help

Hello, I have a file which contains groups of fields. These groups are separated by a blank line, to form a logical record. Each line consists of a field-value pair. If want to find all records where field 'd' has a value of '4' and if it does, I want the value of field 'a' (from the... (4 Replies)
Discussion started by: brawnr
4 Replies

7. Shell Programming and Scripting

Perl parsing compared to Ksh parsing

#! /usr/local/bin/perl -w $ip = "$ARGV"; $rw = "$ARGV"; $snmpg = "/usr/local/bin/snmpbulkget -v2c -Cn1 -Cn2 -Os -c $rw"; $snmpw = "/usr/local/bin/snmpwalk -Os -c $rw"; $syst=`$snmpg $ip system sysName sysObjectID`; sysDescr.0 = STRING: Cisco Internetwork Operating System Software... (1 Reply)
Discussion started by: popeye
1 Replies

8. Shell Programming and Scripting

need help in Parsing a CSV file and generate a new output file

Hi Scripting Gurus, I am trying to parse a csv file and generate a new output file. The input file will be a variable length in turns of rows and columns. output file will have 8 columns. we have three columns from the header for each set. just to give little bit more clarification each row... (15 Replies)
Discussion started by: vkr
15 Replies

9. Shell Programming and Scripting

Finding & Moving Oldest File by Parsing/Sorting Date Info in File Names

I'm trying to write a script that will look in an /exports folder for the oldest export file and move it to a /staging folder. "Oldest" in this case is actually determined by date information embedded in the file names themselves. Also, the script should only move a file from /exports to... (6 Replies)
Discussion started by: nikosey
6 Replies

10. Shell Programming and Scripting

Help me with parsing this file

Hi, I need a shell script that would parse this file /usr/share/i18n/locales/aa_DJ:title "Afar language locale for Djibouti (Cadu/Laaqo Dialects)." /usr/share/i18n/locales/aa_ER:title "Afar language locale for Eritrea (Cadu/Laaqo Dialects)." /usr/share/i18n/locales/aa_ER@saaho:title... (2 Replies)
Discussion started by: eamani_sun
2 Replies
Login or Register to Ask a Question