03-18-2009
Try with uniq command
cat temp temp1 | uniq
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
This may be the 3rd time I'm posting this question. I'm so new here that I'm not even sure how to post!
I'm trying to compare two files but can't do a line by line comparison so comm and diff are out. I've been told that I would need to use the awk programing language. I've looked up what I... (14 Replies)
Discussion started by: jimmyflip
14 Replies
2. Shell Programming and Scripting
I know the diff does this but it does output more info than just the different text
(e.g.
$ diff file1 file2
29a30
> /home/alex/Pictures/hello.jpg
1694a1696
> /home/alex/Pictures/hi.jpg
)
How can I make it output only
/home/alex/Pictures/hello.jpg
/home/alex/Pictures/hi.jpg
?
thank... (2 Replies)
Discussion started by: hakermania
2 Replies
3. Shell Programming and Scripting
Hi Team,
Could you please help me on below one ..
etrademail1.txt
etDefaultLogin=pdayanan
mail=poojaaragam.dayanand@exchange.etr.comx
employeeNumber=31567
etDefaultLogin=sudrupa
mail=sudrupa.ayanand@exchange.etr.comx
employeeNumber=318967
etDefaultLogin=gurathi (1 Reply)
Discussion started by: nivas_k2006
1 Replies
4. Shell Programming and Scripting
I have two csv files having 90K records each & each row has around 50 columns.Lets say the file names are FILE1 and FILE2. I have to compare both the files and generate a new file that has rows from FILE2 if it differs.
FILE1
-----
2001,"John",25,19901130,21211.41,Unix Forum... (3 Replies)
Discussion started by: Sheel
3 Replies
5. Shell Programming and Scripting
I have two files,
sec.txt(1st File)
3172
disp.txt(2nd file)
the file name is
***********
45676
Now i want to compare the value in sec.txt file with disp.txt file
Excatly i want to compare the value 3172 in first file and 45676 in second file.
i want to compare the first line of... (11 Replies)
Discussion started by: rammm
11 Replies
6. UNIX for Dummies Questions & Answers
Hello guys,
I have file1 and file2, two text files containing various lines.
I'm trying to find a way to compare file1 and file2:
If the first 7 characters of a line in file2 match the first 7 characters of a line in file1, then do not do anything.
Print out the lines of file1 (in file3,... (3 Replies)
Discussion started by: bobylapointe
3 Replies
7. Shell Programming and Scripting
i am working on a shell script and need help in the comparing part of it. for e.g. there two text files like this:
file1.txt
name1
name2
name3
file1 has to be comared with file2
defaultfile.txt
name1
name2
name3
name4
and during comparision with defaultfile.txt
if... (2 Replies)
Discussion started by: draghun9
2 Replies
8. Shell Programming and Scripting
Hi,
I have two text files, compare column one in both the files and if it matches then the output should contain the id in column one, the number and the description.
Both the files are sorted. Is there a one liner to get this done, kindly help. Thank you
File 1:
NC_000964 92.33 ... (2 Replies)
Discussion started by: pulikoti
2 Replies
9. Shell Programming and Scripting
"Help Me" Need script for transferring bulk files from one format to text format in a unix server.
Please suggest (2 Replies)
Discussion started by: Kranthi Kumar
2 Replies
10. Shell Programming and Scripting
Hi,
I have database table let say t_filenames which stores filenames and date_format in two columns.
e.g.
ABCD_TV_YYYYMMDD.txt YYYYMMDD
ABCD_MOUSE_YYYYMMDDHHMISS.txt YYYYMMDDHHMISS
Actual files are available in a directory (say /tmp), actual files are with... (2 Replies)
Discussion started by: pointers1234
2 Replies
uniq(1) General Commands Manual uniq(1)
Name
uniq - report repeated lines in a file
Syntax
uniq [-udc[+n][-n]] [input[output]]
Description
The command reads the input file comparing adjacent lines. In the normal case, the second and succeeding copies of repeated lines are
removed; the remainder is written on the output file. Note that repeated lines must be adjacent in order to be found. For further infor-
mation, see
Options
The n arguments specify skipping an initial portion of each line in the comparison:
-n Skips specified number of fields. A field is defined as a string of non-space, non-tab characters separated by tabs and spaces from its
neighbors.
+n Skips specified number of characters in addition to fields. Fields are skipped before characters.
-c Displays number of repetitions, if any, for each line.
-d Displays only lines that were repeated.
-u Displays only unique (nonrepeated) lines.
If the -u flag is used, just the lines that are not repeated in the original file are output. The -d option specifies that one copy of
just the repeated lines is to be written. The normal mode output is the union of the -u and -d mode outputs.
The -c option supersedes -u and -d and generates an output report in default style but with each line preceded by a count of the number of
times it occurred.
See Also
comm(1), sort(1)
uniq(1)