Comparing a distinct value in 1 list with another list


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Comparing a distinct value in 1 list with another list
# 1  
Old 06-22-2004
Comparing a distinct value in 1 list with another list

Hi all,

I need to compare the contents of 2 directories where the file contents are similar and take out the filenames whose contents does not exist within the 2 directories.

Directory1

1
2
3
4

Directory2

54
55
56
57

Does anyone has a script which can do this?
At the end of the command, all the files that does not exist when comparing the 2 directories should be cp -p to another new directory.

Thanks.
# 2  
Old 06-22-2004
Hi!
you can use sdiff with the option -s to print only not identical lines.

ls -la /first_dir > 1.dir
ls -la /seconed_dir >2.dir
sdiff -s 1.dir 2.dir

I hope this help.
regards joerg
# 3  
Old 06-22-2004
Hi Joerg,

Thanks for your advice, but the filenames are totally different, however the content is the same, in this case, how would i go about doing it?

There are 800+ files in one directory and 500+ in one directory, i know for sure that about 200+ do not share the same contents and i want to move them to another directory.

Regards,
Alvin
# 4  
Old 06-22-2004
Is the timestamp of the file in side the first directory the same as in the second directory.
Please give us a output of the ls -la command for both directorys.
Which kind of contense it is?
regards joerg
# 5  
Old 06-22-2004
Hi Joerg,

No the only thing that is the same is the xml file contents, i need to compare the file contents in one directory with the other directory. Do you know of a script which can do that?

Regards,
Alvin

s the timestamp of the file in side the first directory the same as in the second directory.
Please give us a output of the ls -la command for both directorys.
Which kind of contense it is?
regards joerg
# 6  
Old 06-22-2004
Loop thru files in source directory; see if file exists in destination; if it does then see if the contents differ...
Code:
#!/usr/bin/ksh

SOURCE=/path/to/source/dir
DEST=/path/to/dest/dir
cd $SOURCE
for i in *
do
    if [ -f $DEST/$i ]
    then
        echo file $i exists
        if cmp -s $i $DEST/$i
        then
            echo files are the same
        else
            echo files are different
        fi
    else
        echo file $i does not exist
    fi
done

# 7  
Old 06-22-2004
Thanks for your help, i appreciate it but if the filenames which are different are over 200+ files, how do i automate this with diff to search through their contents in different directories?
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Comparing two edge list

Hello, I have two network edgelists with first two columns as nodes and the last column pearson correlation coefficient (PCC). I want to remove the edges from net1 whose edges are common with net2 && (PCC)net2>=(PCC)net1 net1.txt A B 0.6 A C 0.7 B C 0.7 D C ... (1 Reply)
Discussion started by: Sanchari
1 Replies

2. Shell Programming and Scripting

Comparing list of files in parallel

Hi everyone. I have a list of files like: file001 file002 file003 . . . . file385 file386 file387 There are more files than above, but I hope you understand what I'm trying to do here. Is there a way I can create a loop to compare: file001 with file385 file002 with file386 (9 Replies)
Discussion started by: craigsky
9 Replies

3. UNIX for Dummies Questions & Answers

Comparing lines within a word list

Hello all- New to this forum, and relatively new to using grep at the Terminal command line to work with regular expressions. I've got a background in math and some programming experience, so it's not been too difficult to learn the basics of searching through my word lists for particular types of... (13 Replies)
Discussion started by: dtalvacchio
13 Replies

4. UNIX for Dummies Questions & Answers

Select distinct sequences from fasta file and list

Hi How can I extract sequences from a fasta file with respect a certain criteria? The beginning of my file (containing in total more than 1000 sequences) looks like this: >H8V34IS02I59VP SDACNDLTIALLQIAREVRVCNPTFSFRWHPQVKDEVMRECFDCIRQGLG YPSMRNDPILIANCMNWHGHPLEEARQWVHQACMSPCPSTKHGFQPFRMA... (6 Replies)
Discussion started by: Marion MPI
6 Replies

5. Shell Programming and Scripting

Comparing 2 variable in a list with foreach

cat file1 a b c d e f this is what is in my script foreach i (`cat file1`) foreach j (`cat file1`) #do something here end end basically i want to compare ab, ac, ad, ae, af, ba, bc, bd, be.... and also skipping aa,bb if possible.. if that anyway for me to just use 1 foreach? (2 Replies)
Discussion started by: ctphua
2 Replies

6. Shell Programming and Scripting

Comparing list of files

Hi All, I have a list of files and want to find the difference between each file if there is difference then i want the file name to be printed and log the duplicate files For example Size Filename 23 a1 23 a2 23 a3 45 a4 If i diff a1 and a2 and find... (3 Replies)
Discussion started by: wedng.bell
3 Replies

7. Shell Programming and Scripting

Comparing two files and list the differences

Hi * I have two text files which has the file size, timestamp and the file name. I need to compare these two files and get the differences in the output format. Can anyone help me out with this. * cat file1.txt *474742 Apr 18* 2010 sample.log *135098 Apr 18* 2010 Testfile 134282 Apr 18* 2010... (7 Replies)
Discussion started by: Sendhil.Kumaran
7 Replies

8. Shell Programming and Scripting

comparing list values in Perl

Hi, I have tab separated list: KB0005 1019 T IFVATVPVI 0.691 PKC YES KB0005 1036 T YFLQTSQQL 0.785 PKC YES KB0005 1037 S FLQTSQQLK 0.585 DNAPK YES KB0005 508 S ENIISGVSY 0.507 cdc2 YES KB0005 511 S ... (1 Reply)
Discussion started by: karla
1 Replies

9. UNIX for Advanced & Expert Users

Count the distinct list of ids

Hello guys, I have a file in the following format(each line seperated by TAB): ========= Filename id Filename id1 Filename id Filename1 id7 Filename1 id7 Filename2 id1 Filename2 id1 Filename2 id3 Filename3 id2 Filename3 id4 Filename3 id4 Filename3 id6 ========= I would like to... (2 Replies)
Discussion started by: jingi1234
2 Replies

10. UNIX for Dummies Questions & Answers

Comparing data list...

I have a list of files that I want to compare to another list of files, how do I do that? The first list will be my known list and hard coded, for example: mylist="janfile.tar jarfile.jar jan.rpt.Z" etc. The second list will be found by doing an 'ls' piped to a file: ls > filelist.dat ... (4 Replies)
Discussion started by: giannicello
4 Replies
Login or Register to Ask a Question