sorting/arrangement problem

Abhishek Ghose · #1 (**permalink**) 05-23-2007

Hi,
I have the following 'sorting' problem.
Given the input file:

a

c:12:x:k
s:m:d:8:z:m
a

c:1:x:k
p:q:r:23:y:m
a

c:3:x:k
p:q:r:1:y:m

the output I expect is:

a

c:1:x:k
p:q:r:1:y:m
s:m:d:8:z:m

What happened here is I grouped together lines having the same values for columns 1,2,3,5,6 and selected only the line with the smallest value in the 4th column in every group.

I am currently managing this with a small PERL script. Is there a way to do this using shell utilities alone?

Regards...

Ygor · #2 (**permalink**) 05-23-2007

Try...

Code:

awk 'BEGIN{FS=":"}{c=$4;b=$0;$4="";k=$0}!v[k]||v[k]>c{v[k]=c;a[k]=b}END{for(i in a)print a[i]}' file1

Abhishek Ghose · #3 (**permalink**) 05-24-2007

You are a man of few words

! Amazing!
My unix machine is down, and it will be a while before I can try this out. But now that I have seen it, I can tweak it, if I do run into any errors.

Thanks!

aigles · #4 (**permalink**) 05-24-2007

Another way:

Code:

sort -t':' -k1,3 -k5,6 -k4,4n s1.txt | \
awk  -F':' '{ line=$0; $4=""; if ($0 != key) print line; key=$0 }' inputfile

Jean-Pierre.

Abhishek Ghose · #5 (**permalink**) 05-24-2007

there is a slight problem i am encountering.......

reassigning $4, does not reassign $0. So both of the above methods are failing....any cures?

aigles · #6 (**permalink**) 05-24-2007

A little correction to my solution which works fine on my AIX box (do you try with nawk or gawk if they are available on your system ?) :

Code:

sort -t':' -k1,3 -k5,6 -k4,4n inputfile  | \
awk  -F':' '{ line=$0; $4=""; if ($0 != key) print line; key=$0 }'

The following solution doesn't modify fields, so it must work with all versions of awk :

Code:

sort -t':' -k1,3 -k5,6 -k4,4n inputfile  | \
awk  -F ':' '{ key=$1 ":" $2 ":" $3 ":" $5 ":" $6; if (key != prv_key) print; prv_key=key }'

Jean-Pierre.

Abhishek Ghose · #7 (**permalink**) 05-25-2007

Hi,

I made small change to the code posted by Ygor...and that will apply to solution by Aigles too (remember, my problem is reassigning $4 doesnt modify $0). Heres the changed code:

awk 'BEGIN{FS=":"}{str=""; for(j=1;j<=NF;++j) str=sprintf("%s%s",str,$j)} (v[str]=="")||(v[str]>$4){v[str]=$4;a[str]=$0}END{for(i in a)print a[i]}' file1

Here are the tweaks:
(1) Now I have a new variable "str" - this doesnt have the 4th column values
(2) In the condition part, now I check for (v[str]=="") instead of (!v[str]) --- the latter throws an error on my system.

Thanks to everyone for the effort....

Regards, Abhishek

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Sorting problem	cool4naren	UNIX for Dummies Questions & Answers	4	07-31-2007 08:28 AM
Sorting problem....	jarod004	HP-UX	4	06-25-2007 12:42 AM
Sorting/Filed Defining/Output problem	TiredOrangeCat	Shell Programming and Scripting	1	02-12-2007 12:41 AM
Data arrangement	bobo	UNIX for Dummies Questions & Answers	6	09-21-2006 10:36 AM
Problem in sorting the file	vishnu_vaka	Shell Programming and Scripting	1	12-04-2005 11:47 AM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode	Rate This Thread: