UNIX for Dummies Questions & Answers

here i have two files:
file 1
1
2
3
4
5
5
6
7
8
9

file 2
4
5
6
6
8
8
9

How to get file 3 containing no repetitions )
1
2
3
4
5
6
7
8
9

i tried
sort -o file1.srt file1
sort -o file2.srt file2
comm -13 file1.srt file2.srt > new
cat file1.srt new > file3
file3 should not contain repetitions.

Thanks.

This worked....Let me know if there is a better way to do it.

sort -o file1.dat.srt file1.dat
sort -o file2.dat.srt file2.dat
comm -13 file1.dat.srt file2.dat.srt > file.dat.srt
cat file1.dat.srt file.dat.srt > file.srt

for i in `cat file.srt | uniq`
do
echo $i >> file3.dat
done

With sort or uniq:

Code:

sort -u file1 file2>file3

Code:

<file1 uniq file2>file3

Or Awk (use nawk or /usr/xpg4/bin/awk on Solaris):

Code:

awk >file3 '!x[$1]++' file1 file2

Or use perl:

Code:

perl >file3 -nle'print unless $_{$_}++' file1 file2

Awesome!!!


awk command did not work on command line, but when i put that in script and executed, it worked : any reason ?

perl worked well.



thanks.

What was the error?

With perl:

Code:

perl >file3 -nle'$_{$_}++;END{print join "\n", sort keys %_}' file1 file2

But you don't need perl and awk when sort or uniq are sufficient
(see my previous post).

P.S. If you use uniq you should sort the input first.

This is the error :
$ awk '!x[$1]++' file1.dat file2.dat > file.dat
x[: Event not found.

sort works only if the file has numbers with same digits:
I mean it will sort like this
1
2
21
23
3
4
45
And not in exact manner like 1 2 3 4 21 23 45
But my problem is solved as all numbers have same no. of digits.


Anyways, I just want to let you know.
But I got my answer. I will use either perl or awk or sort.
THANK YOU

I suppose you're using (t)csh.
You shouldn't
Anyway, this may work:

Code:

awk '\!x[$1]++' file1 file2>file3

Just tell sort to thread them as numbers
(use the -n option):

Code:

$ sort <<<'20
3
1'
1
20
3

$ sort -n <<<'20
3
1'
1
3
20

Yes, I corrected my previous post: to get the output you want from uniq, the input should be sorted.