|
|
Sponsored Content
Homework and Emergencies
Homework & Coursework Questions
Script to find difference between 2 files by column
Post 302753659 by shakthi666 on Wednesday 9th of January 2013 07:06:20 AM
01-09-2013
Script to find difference between 2 files by column
Hi , i am newbie to shell scripting and am trying to do the below job,
A shell script to be run with a command like
sh Compare.ksh file1.txt file2.txt 1 2 > file3.txt
1 2-are the key columns
Consider the delimiter would be Tab or comma
File 1:
SK TEST NAME MATHS PHYSICS
21 1 AAA 45 65
21 2 AAA 48 66
22 1 BBB 46 64
22 2 BBB 47 65
23 1 CCC 58 85
23 2 CCC 59 88
File 2:
SK TEST NAME MATHS PHYSICS
21 1 AAA 45 65
21 2 AAA 48 66
22 1 BBB 46 6
22 2 BBB 47 65
23 1 CCC 58 85
23 2 CC 59 88
And return result like,
File 3:
FILE SK TEST NAME PHYSICS
file1.txt 22 1 BBB 64
file2.txt 22 1 BBB 6
file1.txt 23 2 CCC
file2.txt 23 2 CC
Any expert help for this student?
A shell script to be run with a command like
sh Compare.ksh file1.txt file2.txt 1 2 > file3.txt
1 2-are the key columns
Consider the delimiter would be Tab or comma
File 1:
SK TEST NAME MATHS PHYSICS
21 1 AAA 45 65
21 2 AAA 48 66
22 1 BBB 46 64
22 2 BBB 47 65
23 1 CCC 58 85
23 2 CCC 59 88
File 2:
SK TEST NAME MATHS PHYSICS
21 1 AAA 45 65
21 2 AAA 48 66
22 1 BBB 46 6
22 2 BBB 47 65
23 1 CCC 58 85
23 2 CC 59 88
And return result like,
File 3:
FILE SK TEST NAME PHYSICS
file1.txt 22 1 BBB 64
file2.txt 22 1 BBB 6
file1.txt 23 2 CCC
file2.txt 23 2 CC
Any expert help for this student?
|
|
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I want to write a script which will compare the 1st column of both the files and will give the difference.
e.g:-
my 1st file contains:
89 /usr
52 /usr/local
36 /tmp
92 /opt
96 /home
27 /etc/opt/EMCom
1 ... (3 Replies)
Discussion started by: adityam
3 Replies
2. Shell Programming and Scripting
Hi All,
i have a file that is tab delimited. i need help to find the rows which are having same price based on the site code but some times, there are difference so i need to find only the records which are different in all site code.
Dept Sec Barcode 10001 10002 10003 10004... (1 Reply)
Discussion started by: malcomex999
1 Replies
3. Solaris
I need to find the difference between two files in UNIX. I tried diff, but couldn't get it right.
There are two files:
file1: apple
mango
strawberry
banana
grape
file2: grape
apple
banana
I need an output file like below: ... (11 Replies)
Discussion started by: kisaad
11 Replies
4. UNIX for Dummies Questions & Answers
I have two files as below
File1:
a
b
c
d
File2:
a
b
When i find the difference the output would be c&d..
How can i get my requirement...pls help...
Many thanks in advance (10 Replies)
Discussion started by: jagadish_gaddam
10 Replies
5. UNIX for Advanced & Expert Users
I have 2 files as follows.
file1.txt
<cell>123</cell>
<cell>345</cell>
file2.txt
<cell>123</cell>
<cell>456</cell>
out out should be
output.txt
<cell>456></cell>
How do we achieve this> The difference betwenn the two files should be wirtten to the output file..
... (2 Replies)
Discussion started by: kanthrajgowda
2 Replies
6. Shell Programming and Scripting
i basically have 2 files and sdiff of the files is given below
sdiff file1 file 2
control_file <
path INDEX <
size 613 <
mode 0444 ... (1 Reply)
Discussion started by: under_cons
1 Replies
7. Shell Programming and Scripting
Hi , i am newbie to shell scripting and am trying to do the below job,
A shell script to be run with a command like
sh Compare.ksh file1.txt file2.txt 1 2 > file3.txt
1 2-are the key columns
Consider the delimiter would be Tab or comma
File 1:
SK TEST NAME MATHS PHYSICS
21 1... (1 Reply)
Discussion started by: shakthi666
1 Replies
8. Shell Programming and Scripting
File 1:
20130416,235800,10.78.25.104,BR2-loc,60.0,1624,50.0,0,50.0,0
20130416,235800,10.78.25.104,BR1-LOC,70.0,10,50.0,0,70.0,0
20130416,235800,10.78.25.104,Hub_None,60.0,15,60.0,0,50.0,0
File 2:
20130417,000200,10.78.25.104,BR2-loc,60.0,1626,50.0,0,50.0,0... (3 Replies)
Discussion started by: Lakshmikumari
3 Replies
9. Shell Programming and Scripting
Hi,
I need to find the difference between 2 files in unix and write the result in the new file
File1:
A
B
File2:
X 123 hajkd
Y 345 adjfka
A 123 djafjhd
B 678 dsndjks
Output file:
X 123 hajkd
Y 345 adjfka
Thanks. (6 Replies)
Discussion started by: nani1984
6 Replies
10. Shell Programming and Scripting
Hi All,
I want to find the difference between two files, by checking only the headers (column names) and report if any new column is added in the latest file.
For Ex: If the file "declartion.txt has these columns
url;image;id;showcase_id;showcase_name
and the actual file "feed.txt" has... (34 Replies)
Discussion started by: Praveen Pandit
34 Replies
LEARN ABOUT REDHAT
mac2unix
dos2unix(1) General Commands Manual dos2unix(1) NAME
dos2unix - DOS/MAC to UNIX text file format converter SYNOPSYS
dos2unix [options] [-c convmode] [-o file ...] [-n infile outfile ...] Options: [-hkqV] [--help] [--keepdate] [--quiet] [--version] DESCRIPTION
This manual page documents dos2unix, the program that converts plain text files in DOS/MAC format to UNIX format. OPTIONS
The following options are available: -h --help Print online help. -k --keepdate Keep the date stamp of output file same as input file. -q --quiet Quiet mode. Suppress all warning and messages. -V --version Prints version information. -c --convmode convmode Sets conversion mode. Simulates dos2unix under SunOS. -o --oldfile file ... Old file mode. Convert the file and write output to it. The program default to run in this mode. Wildcard names may be used. -n --newfile infile outfile ... New file mode. Convert the infile and write output to outfile. File names must be given in pairs and wildcard names should NOT be used or you WILL lost your files. EXAMPLES
Get input from stdin and write output to stdout. dos2unix Convert and replace a.txt. Convert and replace b.txt. dos2unix a.txt b.txt dos2unix -o a.txt b.txt Convert and replace a.txt in ASCII conversion mode. Convert and replace b.txt in ISO conversion mode. Convert c.txt from Mac to Unix ascii format. dos2unix a.txt -c iso b.txt dos2unix -c ascii a.txt -c iso b.txt dos2unix -c mac a.txt b.txt Convert and replace a.txt while keeping original date stamp. dos2unix -k a.txt dos2unix -k -o a.txt Convert a.txt and write to e.txt. dos2unix -n a.txt e.txt Convert a.txt and write to e.txt, keep date stamp of e.txt same as a.txt. dos2unix -k -n a.txt e.txt Convert and replace a.txt. Convert b.txt and write to e.txt. dos2unix a.txt -n b.txt e.txt dos2unix -o a.txt -n b.txt e.txt Convert c.txt and write to e.txt. Convert and replace a.txt. Convert and replace b.txt. Convert d.txt and write to f.txt. dos2unix -n c.txt e.txt -o a.txt b.txt -n d.txt f.txt DIAGNOSTICS
BUGS
The program does not work properly under MSDOS in stdio processing mode. If you know why is that so, please tell me. AUTHORS
Benjamin Lin - <blin@socs.uts.edu.au> Bernd Johannes Wuebben (mac2unix mode) <wuebben@kde.org> MISCELLANY
Tested environment: Linux 1.2.0 with GNU C 2.5.8 SunOS 4.1.3 with GNU C 2.6.3 MS-DOS 6.20 with Borland C++ 4.02 Suggestions and bug reports are welcome. SEE ALSO
unix2dos(1) mac2unix(1) 1995.03.31 dos2unix v3.0 dos2unix(1)