Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: How to compare multiple files in UNIX?
Top Forums Shell Programming and Scripting How to compare multiple files in UNIX? Post 302930870 by penqueen on Thursday 8th of January 2015 08:35:02 AM
Old 01-08-2015
Consider like you have below four files:
Code:
file1.txt - 1 2 3
file2.txt - 4 5 6
file3.txt - 6 7 8 
file4.txt - 9 10 11

1. Sort all the files using SORT
2. Compare file1.txt and file2.txt using DIFF -- no contents were same, now merge these two files say new_file1.txt
3. Compare new_file1.txt with file3.txt as like above -- one content is matched so it will return the value as '6', use SED / AWK to remove that value from file3.txt and merge the remaining contents with new_file1.txt
4. Now finally, compare file4.txt with new_file1.txt -- no contents matched as per the example shown above.

You can try to code for above logic and still if you have doubts with the codes, provide your progress we can help you out.

This will work only if you're having limited no. of files, incase if you wanna to compare 40files then you will to try for various logic like using functions in shell scripting etc.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare multiple columns between 2 files

hello I need to compare 2 text files. File 1 has 2 columns and file 2 has 1 to many. Sample: File 1: 111 555 222 666 333 777 444 755 File 2: 000 110 113 114 844 111 555 999 202 777 865 098 023 222 313 499 065 655 333 011 890 777 433 (15 Replies)
Discussion started by: stevesmith
15 Replies

2. Shell Programming and Scripting

String compare in multiple files

Hi I have a requirement to process number of files matching a criteria. The resulted file would be processed indivdually looking for a particular string until another one found lines afterwards. Then look for the occurrence of another string in the result count and display/return the result. ... (13 Replies)
Discussion started by: arungn
13 Replies

3. Shell Programming and Scripting

Script to Compare Multiple Files.

Hello Everyone, I have strange situation and unable to think of a solution. Situation is as follow, FolderA contrain following files, File1 File2 File3 File4 I want to compare as follow compare File1 with File2 --> Result Same/Diffrent compare File1 with File3 --> Result... (1 Reply)
Discussion started by: ZalimJin
1 Replies

4. Shell Programming and Scripting

Compare multiple files and print unique lines

Hi friends, I have multiple files. For now, let's say I have two of the following style cat 1.txt cat 2.txt output.txt Please note that my files are not sorted and in the output file I need another extra column that says the file from which it is coming. I have more than 100... (19 Replies)
Discussion started by: jacobs.smith
19 Replies

5. Shell Programming and Scripting

compare multiple files and get the difference

Hi all, i have 50 files .data should be same in these 50 files , so my task is to find the difference. i need a logic , which finds difference between all files and print in output file with file name where it found that difference . i tried below logic , but its not giving me what i want. let... (2 Replies)
Discussion started by: deepakiniimt
2 Replies

6. Shell Programming and Scripting

Compare multiple files with multiple number of columns

Hi, input file1 abcd 123 198 xyz1:0909090-0909091 ghij 234 999 xyz2:987654:987655 kilo 7890 7990 xyz3:12345-12357 prem 9 112 xyz5:97-1134 input file2 abcd 123 198 xyz1:0909090-0909091 -9.122 0 abed 88 98 xyz1:98989-090808 -1.234 1.345 ghij 234 999 xyz2:987654:987655 -10.87090909 5... (5 Replies)
Discussion started by: jacobs.smith
5 Replies

7. Shell Programming and Scripting

Compare multiple columns from 2 files

Hi, I need to compare multiple columns from 2 files. I can, for example, have these 2 files: file1: col1, col2, col3,col4 a,1,4,7 b,2,5,8 c,3,6,9file2: col1, col2, col3,col4 a,2,3,2 b,5,7,5 c,1,9,8As a result, I need for example the difference between the columns 2 and 4: col2,... (3 Replies)
Discussion started by: Subbeh
3 Replies

8. Shell Programming and Scripting

Compare multiple files, and extract items that are common to ALL files only

I have this code awk 'NR==FNR{a=$1;next} a' file1 file2 which does what I need it to do, but for only two files. I want to make it so that I can have multiple files (for example 30) and the code will return only the items that are in every single one of those files and ignore the ones... (7 Replies)
Discussion started by: castrojc
7 Replies

9. Shell Programming and Scripting

Create Multiple UNIX Files for Multiple SQL Rows output

Dear All, I am trying to write a Unix Script which fires a sql query. The output of the sql query gives multiple rows. Each row should be saved in a separate Unix File. The number of rows of sql output can be variable. I am able save all the rows in one file but in separate files. Any... (14 Replies)
Discussion started by: Rahul_Bhasin
14 Replies

10. Shell Programming and Scripting

Compare and Differentiate Multiple Files

Im using code below comparing and getting the diff of two files. But what about multiple files? can you help me guys diff -u file1 file2|sed -n '/^---/!{/^-/s/-//p}' diff -ui file1 file2| sed -n '/^++/!{/^+/s/+//p}' Example File1: aaa bbb ccc ddd File2: bbb eee (5 Replies)
Discussion started by: kenshinhimura
5 Replies

LEARN ABOUT SUSE

hardlink

hardlink(1)						      General Commands Manual						       hardlink(1)

NAME

       hardlink - Link multiple copies of a file

SYNOPSIS

       hardlink [option]...  [directory|file]...

DESCRIPTION

       hardlink is a tool which replaces copies of a file with hardlinks, therefore saving space.

OPTIONS

       -h or --help
	      print quick usage details to the screen.

       -v or --verbose
	      More verbose output. If specified once, every hardlinked file is displayed, if specified twice, it also shows every comparison.

       -n or --dry-run
	      Do not act, just print what would happen

       -f or --respect-name
	      Only try to link files with the same (basename).

       -p or --ignore-mode
	      Link/compare files even if their mode is different. This may be a bit unpredictable.

       -o or --ignore-owner
	      Link/compare files even if their owner (user and group) is different. It is not predictable

       -t or --ignore-time
	      Link/compare files even if their time of modification is different. This will retain the newest timestamp, unless -m or -M is given.

       -m or --maximize
	      Try to maximize the link count of the files.

       -M or --minimize
	      Try to minimize the link count of the files.

       -x or --exclude
	      A regular expression which excludes files from being compared and linked.

       -i or --include
	      A  regular  expression to include files. If the option --exclude has been given, this option re-includes files which would otherwise
	      be excluded. If the option is used without --exclude, only files matched by the pattern are included.

ARGUMENTS

       hardlink takes one or more directories which will be searched for files to be linked.

BUGS

       hardlink assumes that the trees it operates on do not change during operation. If a tree does change, the result is  undefined  and  poten-
       tially  dangerous.  For example, if a regular file is replaced by a device, hardlink may start reading from the device. If a component of a
       path is replaced by a symbolic link or file permissions change, security may be compromised. Do not run hardlink on a changing tree or on a
       tree controlled by another user.

AUTHOR

       The  program  hardlink  and  this manpage have been written by Julian Andres Klode, and are licensed under the MIT license. See the code of
       hardlink for further information.

0.2.0								    2012-02-28							       hardlink(1)
All times are GMT -4. The time now is 06:00 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy