Getting Unique values in a file

Legend986 · #1 (**permalink**) 10-14-2008

Hi,

I have a file like this:

Some_String_Here 123 123 123 321 321 321 3432 3221 557 886 321 321

I would like to find only the unique values in the files and get the following output:

Some_String_Here 123 321 3432 3221 557 886

I am trying to get this done using awk. Can someone please point me towards the right direction?

Edit: Ahaa... I figured out one solution:

Code:

{
        for(i=1;i<=NF;i++) {
                uni[$i]++;
        }
        for(i in uni) {
                print uni[i], i;
        }

}

Posting it so that someone else might find use of it...

matrixmadhan · #2 (**permalink**) 10-14-2008

Quote:

{
for(i=1;i<=NF;i++) {
uni[$i]++;
}
for(i in uni) {
print uni[i], i;
}

}

Printing only the unique values

Code:

{
        for(i=1;i<=NF;i++) {
                uni[$i]++;
        }
        
        for(i in uni) {
                if ( uni[i] == 1 ) {
                 print i;
                }
        }
}

Legend986 · #3 (**permalink**) 10-14-2008

Ah... thanks for the pointer

But again, if I am printing out just the keys, wouldn't that be same as your solution? Just for clarification though...

radoulov · #4 (**permalink**) 10-14-2008

Or:

Code:

$ print Some_String_Here 123 123 123 321 321 321 3432 3221 557 886 321 321|
awk 'END{printf "\n"}!_[$1]++' ORS=" " RS=" " 
Some_String_Here 123 321 3432 3221 557 886

With Perl:

Code:

$ print Some_String_Here 123 123 123 321 321 321 3432 3221 557 886 321 321|
perl -lane'print join" ",grep!$_{$_}++,@F'
Some_String_Here 123 321 3432 3221 557 886

Legend986 · #5 (**permalink**) 10-14-2008

Thank You so much...

summer_cherry · #6 (**permalink**) 10-15-2008

Code:

nawk '{
for(i=1;i<=NF;i++)
	arr[$i]=1
}
END{
for(i in arr)
	printf("%s ",i)
print ""
}' filename

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
Search for all the unique file extension	riverside	Shell Programming and Scripting	1	04-09-2008 04:47 PM
Need to find only unique values for a given tag across the files	sudheshnaiyer	UNIX for Dummies Questions & Answers	8	09-03-2007 12:53 AM
to retrieve unique values	mahalakshmi	Shell Programming and Scripting	3	02-05-2007 09:30 AM
sorting file and unique commnad..	amon	Shell Programming and Scripting	2	02-16-2006 05:19 AM
Unique cell vaules in a file	rahulrathod	Shell Programming and Scripting	3	01-17-2006 07:42 AM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes	Rate This Thread
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode	Rate This Thread:


	Powered by