How to find duplicates contents in a files by comparing other files? Post: 302678051

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

comparing files to contents of a file

Hi I have a problem trying to run a while statement. I have files under one directory that i need to compare to a value in filex and update that file with the result files in the directory are DFC1. DFC5. DFC345. DFC344. DFC9. The program i am trying to run will take the number...

2. UNIX for Dummies Questions & Answers

Help comparing 2 files to find deleted records

Hi, I need to compare todays file to yesterdays file to find deletes. I cannot use comm -23 file.old file.new. Because each record may have a small change in it but is not really a delete. I have two delimited files. the first field in each file is static. All other fields may change. I...

3. Shell Programming and Scripting

Comparing contents of files

Hi, I hav two files a1.txt and a2.txt, a1.txt contains: --------------- asdev ebcdev .... a2.txt contains: --------------- asdev ebcdev prod .... a1.txt will be updated by a process,.. now i want to compare two files and i want to see data which is not in a1.txt am i clear....?? ...

4. Shell Programming and Scripting

Find duplicates from multuple files with 2 diff types of files

I need to compare 2 diff type of files and find out the duplicate after comparing each types of files: Type 1 file name is like: file1.abc (the extension abc could any 3 characters but I can narrow it down or hardcode for 10/15 combinations). The other file is file1.bcd01abc (the extension...

5. Shell Programming and Scripting

comparing two files and find mismatch

hi i have two files and i want to compare both the files and find out mismatch in 3rd file file1 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|1|2 43236|1|0|1|1|0|0|0|1|2 41404|1|0|1|1|0|0|0|1|2 79968|1|0|1|1|0|0|0|1|2 file2 00354|1|0|1|1|0|0|0|1|2 52424|1|0|1|1|0|0|0|0|2...

6. UNIX for Dummies Questions & Answers

sort and find duplicates for files with no white space

example data 5666700842511TAfmoham03151008075205999900000001000001000++ 5666700843130MAfmoham03151008142606056667008390315100005001 6666666663130MAfmoham03151008142606056667008390315100005001 I'd like to sort on position 10-14 where the characters are eq "130MA". Then based on positions...

7. Shell Programming and Scripting

Script to find files and delete it by comparing

I have a directory where lot of "gzip" files are dropped in every 5 minutes. There is an application which will process these gzip and move it to another directory but will leave a gzip.out file with lot of output data. I need to remove all the outfiles except for the one which is being...

8. Shell Programming and Scripting

how to check the duplicates files contents

Hi all , am using unix aix .. how to check the duplicates files contents and moving to someother folders ex .. i have files called qqq cat qqq 1 2 3 i have another file qqq02 cat qqq02 1 2 3 here qqq02 has having same contents as qqq file.. i need to check the duplicates files...

9. Shell Programming and Scripting

Need Help with Bash - comparing directory contents with list of files

Hey guys, need help with a script I'm trying to write. Basically I need to compare the contents of a folder called "profiles" with a list of files called "template". when the file matches the contents of the folder it needs to set a variable called "checked" to "1" Cookies to anyone...

10. UNIX for Dummies Questions & Answers

Find a list of files in directory, move to new, allow duplicates

Greetings. I know enough Unix to be dangerous (!) and know that there is a clever way to do the following and it will save me about a day of agony (this time) and I will use it forever after! (many days of agony saved in the future)! Basically I need to find any image files (JPGs, PSDs etc)...

LEARN ABOUT REDHAT

gst-md5sum

GStreamer(1)						      General Commands Manual						      GStreamer(1)

NAME

       gst-md5sum - get an md5sum of a GStreamer pipeline through md5sink

SYNOPSIS

       gst-md5sum [OPTION...] PARTIAL-PIPELINE-DESCRIPTION

DESCRIPTION

       gst-md5sum generates MD5 checksums of the data generated by a GStreamer pipeline.

       In theory, running

	    gst-md5sum filesrc location=music.mp3

       should print out the same checksum as

	    md5sum music.mp3

       The  pipeline  should  be  incomplete,  that  is, a final sink element should be omitted, so that gst-md5sum can connect the pipeline to an
       md5sink element.

       See the man page for gst-launch or the GStreamer docuementation for more information on how to create a PARTIAL-PIPELINE-DESCRIPTION.

OPTIONS

       gst-md5sum accepts the following options:

       --help  Print help synopsis and available FLAGS

       -v      Output verbose information

       --gst-info-mask=FLAGS
	       GStreamer info flags to set (list with --help)

       --gst-debug-mask=FLAGS
	       GStreamer debugging flags to set (list with --help)

       --gst-mask=FLAGS
	       GStreamer info and debugging flags to set (list with --help)

       --gst-plugin-spew
	       GStreamer info flags to set Enable printout of errors while loading GStreamer plugins

       --gst-plugin-path=PATH
	       Add directories separated with ':' to the plugin search path

SEE ALSO

       gst-launch(1)

AUTHOR

       The GStreamer team at http://gstreamer.net/

								  September 2002						      GStreamer(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

comparing files to contents of a file

Discussion started by: SummitElse

2. UNIX for Dummies Questions & Answers

Help comparing 2 files to find deleted records

Discussion started by: eja

3. Shell Programming and Scripting

Comparing contents of files

Discussion started by: rrs

4. Shell Programming and Scripting

Find duplicates from multuple files with 2 diff types of files

Discussion started by: ricky007