Comparing 2 files and return the unique lines in first file Post: 302281052

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

comparing 2 text files to get unique values??

Hi all, I have got a problem while comparing 2 text files and the result should contains the unique values(Non repeatable). For eg: file1.txt 1 2 3 4 file2.txt 2 3 So after comaping the above 2 files I should get only 1 and 4 as the output. Pls help me out.

2. Shell Programming and Scripting

return a list of unique values of a column from csv format file

Hi all, I have a huge csv file with the following format of data, Num SNPs, 549997 Total SNPs,555352 Num Samples, 157 SNP, SampleID, Allele1, Allele2 A001,AB1,A,A A002,AB1,A,A A003,AB1,A,A ... ... ... I would like to write out a list of unique SNP (column 1). Could you...

3. UNIX for Dummies Questions & Answers

Getting non unique lines from concatenated files

Hi All, Is there a way to get NON unique lines from 2 or more concatenated files? Basically I have several files which are very similar with the exception of few lines and I want to find out which lines are different in each file. Very simple example is file1 contains: 1 2 3 4 5file2...

4. UNIX for Advanced & Expert Users

In a huge file, Delete duplicate lines leaving unique lines

Hi All, I have a very huge file (4GB) which has duplicate lines. I want to delete duplicate lines leaving unique lines. Sort, uniq, awk '!x++' are not working as its running out of buffer space. I dont know if this works : I want to read each line of the File in a For Loop, and want to...

5. Shell Programming and Scripting

Comparing files and capture return code

Hi, I would like to compare 2 files, and have a return code write to a file. regardless of the files contents are the same the code should be writing to a file (if both files contents are same then return code 0). A simple example will be great :) Thanks

6. UNIX for Dummies Questions & Answers

getting unique lines from 2 files

hi i have used comm -13 <(sort 1.txt) <(sort 2.txt) option to get the unique lines that are present in file 2 but not in file 1. but some how i am getting the entire file 2. i would expect few but not all uncommon lines fro my dat. is there anything wrong with the way i used the command? my...

7. Shell Programming and Scripting

compare 2 files and return unique lines in each file (based on condition)

hi my problem is little complicated one. i have 2 files which appear like this file 1 abbsss:aa:22:34:as akl abc 1234 mkilll:as:ss:23:qs asc abc 0987 mlopii:cd:wq:24:as asd abc 7866 file2 lkoaa:as:24:32:sa alk abc 3245 lkmo:as:34:43:qs qsa abc 0987 kloia:ds:45:56:sa acq abc 7805 i...

8. Shell Programming and Scripting

Comparing 2 text files & downloading a file if the last lines are different

Hello I'm having a little difficulty in writing a shell script for a few simple tasks. First I have two files "file1.txt" and "file2.txt" and I want to read and compare the last line of each file. The files look like this. File1.txt File2.txt After comparing the two lines I would...

9. Shell Programming and Scripting

Using grep and a parameter file to return unique values

Hello Everyone! I have updated the first post so that my intentions are easier to understand, and also attached sample files (post #18). I have over 500 text files in a directory. Over 1 GB of data. The data in those files is organised in lines: My intention is to return one line per...

10. Shell Programming and Scripting

Shell Scripting | Return list of unique characters in files

Hi, I am trying to script the below, but I am not very good at it :( Your help would be greatly appreciated. 1. read all files in the directory in strings strings *.* 2. in each file, for each line that contains "ABCD", store characters located at position 521 and 522 of this line...

LEARN ABOUT MINIX

diff

DIFF(1) 						      General Commands Manual							   DIFF(1)

NAME

       diff - print differences between two files

SYNOPSIS

       diff   [-c | -e | -C n] [-br]file1 file2

OPTIONS

       -C n   Produce output that contains n lines of context

       -b     Ignore white space when comparing

       -c     Produce output that contains three lines of context

       -e     Produce an ed-script to convert file1 into file2

       -r     Apply diff recursively to files and directories of

EXAMPLES

       diff file1 file2    # Print differences between 2 files

       diff -C 0 file1 file2
			   # Same as above

       diff -C 3 file1 file2
			   # Output three lines of context with every

       diff -c file1 file2 # Same

       diff /etc /dev	   # Compares recursively the directories /etc and /dev

       diff passwd /etc    # Compares ./passwd to /etc/passwd

DESCRIPTION

       the same name, when file1 and file2 are both directories" difference encountered"

       Diff  compares  two files and generates a list of lines telling how the two files differ.  Lines may not be longer than 128 characters.	If
       the two	arguments on the command line are both directories, diff recursively steps through all subdirectories comparing files of the  same
       name.  If  a  file  name is found only in one directory, a diagnostic message is written to stdout. A file that is of either block special,
       character special or FIFO special type, cannot be compared to any other file.  On the other hand, if there is one directory  and  one  file
       given on the command line, diff tries to compare the file with the same name as file in the directory directory.

SEE ALSO

       cdiff(1), cmp(1), comm(1), patch(1).

																	   DIFF(1)