Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: sort and compare files
Top Forums UNIX for Dummies Questions & Answers sort and compare files Post 302342005 by drl on Friday 7th of August 2009 06:54:23 AM
Old 08-07-2009
Hi.

Here is one approach:
Code:
#!/usr/bin/env bash

# @(#) s1	Demonstrate compare files after sort.

echo
set +o nounset
LC_ALL=C ; LANG=C ; export LC_ALL LANG
echo "Environment: LC_ALL = $LC_ALL, LANG = $LANG"
echo "(Versions displayed with local utility \"version\")"
version >/dev/null 2>&1 && version "=o" $(_eat $0 $1) sort cmp
set -o nounset
echo

if [ $# -ne 2 ]
then
  echo " Error - must supply 2 filenames."
  exit 1
fi

FILE1="$1"
shift
FILE2="$1"

echo
echo " Data file $FILE1:"
cat $FILE1

echo
echo " Data file $FILE2:"
cat $FILE2

echo
echo " Results:"
if cmp -s <( sort $FILE1) <(sort $FILE2)
then
  echo " Files $FILE1 and $FILE2 are same."
else
  echo " Files $FILE1 and $FILE2 are different."
fi

exit 0

producing for your sample data:
Code:
% ./s1 data1 data2

Environment: LC_ALL = C, LANG = C
(Versions displayed with local utility "version")
OS, ker|rel, machine: Linux, 2.6.26-2-amd64, x86_64
Distribution        : Debian GNU/Linux 5.0 
GNU bash 3.2.39
sort (GNU coreutils) 6.10
cmp (GNU diffutils) 2.8.1


 Data file data1:
a
b
c
d

 Data file data2:
b
c
a
d

 Results:
 Files data1 and data2 are same.

and for your sample data and one non-matching file:
Code:
% ./s1 data1 data3

Environment: LC_ALL = C, LANG = C
(Versions displayed with local utility "version")
OS, ker|rel, machine: Linux, 2.6.26-2-amd64, x86_64
Distribution        : Debian GNU/Linux 5.0 
GNU bash 3.2.39
sort (GNU coreutils) 6.10
cmp (GNU diffutils) 2.8.1


 Data file data1:
a
b
c
d

 Data file data3:
c
b
d
e

 Results:
 Files data1 and data3 are different.

The syntax
Code:
<( command )

is called process substitution. This also worked with "ksh 93s+". See man pages for details on specific commands.

If it is possible that the files could be very long, you could add a preliminary screening for size: check the length of the two files, if the lengths are different, then you need not sort and compare, but declare immediately that they are different ... cheers, drl
Last edited by drl; 08-08-2009 at 08:41 AM.. Reason: Edit 1: spelling correction
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Sort and compare file

If I have 3 kinds of files in directory DATA1: FileA.20060315.dat, FileB.20060315.dat, FileC.20060315.dat FileC.20060316.dat FileA.20060317.dat, FileB.20060317.dat FileA.20060318.dat, FileB.20060318.dat, FileC.20060318.dat If 3 files have the same date then run $cat FileA.20060315.dat... (3 Replies)
Discussion started by: sabercats
3 Replies

2. Shell Programming and Scripting

Why do we use sort before compare ?

Dear All. Im trying to know how exactly the command "compare" works, does it compare line by line or field by field, and the most important thing is that why the files have to be sorted before we compare them? Thanks in advance (7 Replies)
Discussion started by: yahyaaa
7 Replies

3. Shell Programming and Scripting

Require compare command to compare 4 files

I have four files, I need to compare these files together. As such i know "sdiff and comm" commands but these commands compare 2 files together. If I use sdiff command then i have to compare each file with other which will increase the codes. Please suggest if you know some commands whcih can... (6 Replies)
Discussion started by: nehashine
6 Replies

4. UNIX for Advanced & Expert Users

Script to sort the files and append the extension .sort to the sorted version of the file

Hello all - I am to this forum and fairly new in learning unix and finding some difficulty in preparing a small shell script. I am trying to make script to sort all the files given by user as input (either the exact full name of the file or say the files matching the criteria like all files... (3 Replies)
Discussion started by: pankaj80
3 Replies

5. Shell Programming and Scripting

comm command -- Sort and compare two files

Team, I have two files and I am trying to find the lines unique to file1. So i have executed the below command at shell prompt and got the correct results comm -23 <(sort test) <(sort test1) When i run the same command in Bash shell script, i got the correct results. But when i run... (5 Replies)
Discussion started by: forums123456
5 Replies

6. Shell Programming and Scripting

How to sort and compare files in more efficient manner?

Hello All, Iam using below method to sort and compare files. First iam doing sorting and changing the same file and then doing comparing and taking the final result to another file. sort -o temp.txt file1 mv temp.txt file1 sort -o temp.txt file2 mv temp.txt file2 sort -o temp.txt... (6 Replies)
Discussion started by: Vikram_Tanwar12
6 Replies

7. Shell Programming and Scripting

UNIX compare, sort lines and append difference

Hi, I have a file that needs to be converted: content is: a, b, 4 a ,b, 5 x, y, 1 a, b, 1 x, y, 3 how can i get: a, b, 1|4|5 x,y 1|3 (1 Reply)
Discussion started by: nike27
1 Replies

8. Shell Programming and Scripting

UNIX compare, sort lines and append difference

To make it easier, i gave following example. It is not homework or classwork. Instead, i have a huge csv file dump from tsql with 15 columns and around 300 rows. I was able to extract content that needs to be really converted. Here is the extract: ES FP,B1ES FP,70000,I,SL22,SL22 (70000) ES... (0 Replies)
Discussion started by: nike27
0 Replies

9. Shell Programming and Scripting

UNIX compare, sort lines and append difference

To make it easier, i gave following example. It is not homework or classwork. Instead, i have a huge csv file dump from tsql with 15 columns and around 300 rows. I was able to extract content that needs to be really converted. Here is the extract: ES FP,B1ES FP,70000,I,SL22,SL22 (70000) ES... (8 Replies)
Discussion started by: nike27
8 Replies

10. UNIX for Beginners Questions & Answers

Sort by record column, Compare with conditons and export the result

Hello, I am new to Unix and would like to seek a help, please. I have 2 files (file_1 and file_2), I need to perform the following actions. 1 ) Sort the both file by the column 26-36 (which is Invoice number) what is sort command with the column sort? 2) Compare the file_1.sorted and... (3 Replies)
Discussion started by: Usagi
3 Replies

LEARN ABOUT PHP

ssh2_methods_negotiated

SSH2_METHODS_NEGOTIATED(3)						 1						SSH2_METHODS_NEGOTIATED(3)

ssh2_methods_negotiated - Return list of negotiated methods

SYNOPSIS

       array ssh2_methods_negotiated (resource	$session)

DESCRIPTION

	Returns list of negotiated methods.

PARAMETERS

	      o $session
		- An SSH connection link identifier, obtained from a call to ssh2_connect(3).

RETURN VALUES

EXAMPLES

       Example #1

	      Determining what methods were negotiated

	      <?php
	      $connection = ssh2_connect('shell.example.com', 22);
	      $methods = ssh2_methods_negotiated($connection);

	      echo "Encryption keys were negotiated using: {$methods['kex']}
";
	      echo "Server identified using an {$methods['hostkey']} with ";
	      echo "fingerprint: " . ssh2_fingerprint($connection) . "
";

	      echo "Client to Server packets will use methods:
";
	      echo "	Crypt: {$methods['client_to_server']['crypt']}
";
	      echo "	Comp: {$methods['client_to_server']['comp']}
";
	      echo "	MAC: {$methods['client_to_server']['mac']}
";

	      echo "Server to Client packets will use methods:
";
	      echo "	Crypt: {$methods['server_to_client']['crypt']}
";
	      echo "	Comp: {$methods['server_to_client']['comp']}
";
	      echo "	MAC: {$methods['server_to_client']['mac']}
";

	      ?>

SEE ALSO

       ssh2_connect(3).

PHP Documentation Group 												SSH2_METHODS_NEGOTIATED(3)
All times are GMT -4. The time now is 03:07 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy