Sponsored Content
Top Forums Shell Programming and Scripting compare multiple files and get the difference Post 302596470 by deepakiniimt on Tuesday 7th of February 2012 12:56:00 PM
Old 02-07-2012
Thanks a lot for prompt reply,
let me explain a bit more:-
1. each file is having 50K lines , though size of file is not too much.
2. i have no standard file , so that i cant compaer with standard file
3.to get unique lines first and then search again through these 50 lines is not fast , m not sure because no of lines are too much.
4. files are having 3 columns, actually this is 'cksum' value in files, so third column(file name), will be same.
well just now , i got some output ,looks meaningful :-
cat $TMPDIR/*list*|egrep -ve $EXCEPTIONS_LIST_GREP| sort | uniq -c|grep -vw ^"[ ]*5"|cut -d' ' -f 5-7|while read line
do
export aa=`grep -lx "${line}" $TMPDIR/*list*`
echo "Unique value found : ${line} : in file : $aa"
done >>$TMPDIR/aaaaaajust need to sort , i guess

output :-


Unique value found : 1213068711 8303736 pbin/lib/libsyncsort.so : in file : /tmp/check_sync_20120208_004328_PID_29046/CELLTADM_LIST_2_celltadm@avm-siapp01_list
/tmp/check_sync_20120208_004328_PID_29046/CELLTADM_LIST_2_celltadm@rpa-siapp01_list
/tmp/check_sync_20120208_004328_PID_29046/CELLTADM_LIST_2_celltadm@wlg-siapp01_list
Unique value found : 330122325 8303736 pbin/lib/libsyncsort.so : in file : /tmp/check_sync_20120208_004328_PID_29046/CELLTADM_LIST_2_celltadm@bat-siapp01_list
/tmp/check_sync_20120208_004328_PID_29046/CELLTADM_LIST_2_celltadm@rpb-siapp01_list
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

compare two .dat files and if there is any difference pulled into a separate file

Hi, compare two .dat files and difference will be moved into separate file.if anybody having code for this please send asap. using diff command, i don't know how to write shell programming. and my first file is like this including Header and trailer 10Ç20060323Ç01(Header) 01ÇIÇbabuÇ3000 01ÇIÇbaluÇ4000... (1 Reply)
Discussion started by: kirankumar
1 Replies

2. Shell Programming and Scripting

to compare two files and to print the difference

suppose one file P1168S P2150L P85L Q597R R1097C Another file P2150L P85L Q597R R1097C R1379C R1587K Then output shud be R1379C R1587K thanks (5 Replies)
Discussion started by: cdfd123
5 Replies

3. Shell Programming and Scripting

script to compare first column of two files and find difference

Hi, I want to write a script which will compare the 1st column of both the files and will give the difference. e.g:- my 1st file contains: 89 /usr 52 /usr/local 36 /tmp 92 /opt 96 /home 27 /etc/opt/EMCom 1 ... (3 Replies)
Discussion started by: adityam
3 Replies

4. UNIX for Dummies Questions & Answers

Compare Files and Output Difference

I have to compare two files for any differences, then output the lab and question number for any differences. This is what I currently have: diff lab2.txt lab2answer.txt > lab2compare.txt Though the output doesn't have to be sent to a .txt (or any sort of log), I found that easier, at least... (2 Replies)
Discussion started by: Joesgrrrl
2 Replies

5. Shell Programming and Scripting

Compare two files and print the two lines with difference

I have two files like this: #FILE 1 ABCD 4322 26485 JMTJ 5311 97248 XMPJ 4321 58978 #FILE 2 ABCD 4321 26485 JMTJ 5311 97248 XMPJ 4321 68978 What to do: Compare the two files and find those lines that doesn't match. And have a new file like this: #FILE 3 "from file 1" ABCD 4322 26485... (11 Replies)
Discussion started by: kingpeejay
11 Replies

6. Shell Programming and Scripting

Compare two columns in two files and print the difference

one file . . importing table employee 119 . . importing table jobs 1 2nd file . . importing table employee 120 . . importing table jobs 1 and would like... (2 Replies)
Discussion started by: jhonnyrip
2 Replies

7. UNIX for Dummies Questions & Answers

compare / difference between sub-sections of files

Hi there, I'm sure this question has been asked many times but I can't find any posts with information. How can I check the differences between say lines 20 - 200 in file1 and lines 420 - 600 in file2? Thanks in advance for any help! js (2 Replies)
Discussion started by: js8765
2 Replies

8. Shell Programming and Scripting

Compare two files and output difference, by first field using awk.

It seems like a common task, but I haven't been able to find the solution. vitallog.txt 1310,John,Hancock 13211,Steven,Mills 122,Jane,Doe 138,Thoms,Doe 1500,Micheal,May vitalinfo.txt 12122,Jane,Thomas 122,Janes,Does 123,Paul,Kite **OUTPUT** vitalfiltered.txt 12122,Jane,Thomas... (2 Replies)
Discussion started by: charles33
2 Replies

9. Shell Programming and Scripting

Compare two text files and output difference

Hi experts, I am trying to compare two text files and output the difference to another file. I'm not strictly looking for differences in text but additional text at the end of one file that isn't in another, so basically comparing the file 2 against file 1 and printing any additional text to... (9 Replies)
Discussion started by: martin0852
9 Replies

10. Shell Programming and Scripting

Script to compare 2 files and prints difference as output sidebyside

Hi All, Am trying script to compare 2 files and print the difference found from old file to new file on line by line basis on side by side display. Basically line by line comparision and files may contain blank line as well I know we have compare/diff commands but i don't how to make... (10 Replies)
Discussion started by: Optimus81
10 Replies
cmp(1)							      General Commands Manual							    cmp(1)

Name
       cmp - compare two files

Syntax
       cmp [-l | -s] file1 file2  [ skip1 ]  [ skip2 ]

Description
       The  command  compares two files.  If either file1 or file2 is `-', standard input is used for the file.  With no options, makes no comment
       if the files are the same.  If they differ, it reports the byte and line number at which the difference occurred to  standard  output.	If
       one file is an initial subsequence of the other a message including the file name is written to standard error.

       The optional skip1 and skip2 parameters are initial byte offsets into file1 and file2 respectively and may be either octal, by specifying a
       leading 0, or decimal.  When using skip1 and skip2 the offset is treated as the start of the respective input file.  Only one option may be
       specified  at  a  time.	Only one of the input files may be standard input at a time.  Because the line number is not calculated when using
       either of the options the use of either flag will increase the speed of

Options
       -l Long format:	prints the byte number (decimal) and the differing bytes (octal) for each difference.

       -s Suppresses normal output and sets the exit code only.

Diagnostics
       Exit code 0 is returned for identical files, 1 for different files, and 2 for an inaccessible or missing argument.

See Also
       comm(1), diff(1)

																	    cmp(1)
All times are GMT -4. The time now is 04:54 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy