shell script comparing files in a file


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting shell script comparing files in a file
# 1  
Old 06-20-2005
shell script comparing files in a file

There is a text file that contains the data in the following format:

COLUMN1 COLUMN2
ABC 1
ABC 2
ABC 3
DEF 4
DEF 5
XYZ 7


We have to create a second text file by reading the above file in the following format:

COLUMN1 COLUMN2
ABC 1,2,3
DEF 4,5
XYZ 7


I am new to unix scripting!Kindly help !!!!!
# 2  
Old 06-20-2005
nawk -f raina.awk textFile

raina.awk:
Code:
{
  arr[$1] = ($1 in arr) ? arr[$1] "," $2 : $2
}
END {
  for (i in arr)
    print i, arr[i]
}

# 3  
Old 06-21-2005
Hello,
Thanks for the effort !
However,I am getting the following output :

ABC 1 1
ABC 2 2
ABC 3 3
XYZ 7 7
DEF 4 4
DEF 5 5

when the input file contained the data as mentioned in the problem.


Also,I could not use "nawk"--It said that --- command not found!

Thanks !
# 4  
Old 06-21-2005
THANKS A TON !
PLEASE IGNORE MY PREVIOUS REPLY..I HAD REPLACED $1 BY $i..SO WAS NOT WORKING :-)
ITS WORKING NOW.

THANKS !
# 5  
Old 06-21-2005
Here's some python for ya:

Code:
#!/usr/bin/env python
                                                                                                          
import sys
                                                                                                          
groups={}
                                                                                                          
while 1:
     line = sys.stdin.readline()
     if line == '':
         break
     try:
         key,value=line.strip().split()
         if not groups.has_key(key):
            groups[key]=[value]
         else:
            groups[key].append(value)
     except:
         pass
                                                                                                          
keys=groups.keys()
keys.sort()
for key in keys:
    print key,
    print ",".join(groups[key])

Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Shell script needed for comparing two files

Hi, I need shell script to compare the two files based on certain fields and output should contains the required fields based on result.pls find sample input files and required output file 1 COUNT, BNG_IP,PORT,OVLAN 22 , 10.238.60.129,1/1,2009 144 , 10.238.60.129,1/1,2251 ... (5 Replies)
Discussion started by: surender reddy
5 Replies

2. Shell Programming and Scripting

Need Help in comparing 2 text files in shell script

Hi All, I have 2 files like below vi f1 frog elephant rabit zebra dog vi f2 rabit dog ============== Now i want to comapre two files and the result will be frog (8 Replies)
Discussion started by: kumar85shiv
8 Replies

3. Shell Programming and Scripting

Need help in comparing two files using shell or Perl

I have these two file that I am trying to compare using shell arrays. I need to find out the changed or the missing enteries from File2. For example. The line "f nsd1" in file2 is different from file1 and the line "g nsd6" is missing from file2. I dont want to use "for loop" because my files... (2 Replies)
Discussion started by: sags007_99
2 Replies

4. Shell Programming and Scripting

shell script for comparing two files

Hi, I have 2 files as below FILE1.dat co1|co2|co3 abnd|45.56|AZ dkny|30.2|PA sam|.23|VA FILE.CTL FILENAME|FILE1.dat NO OF RECORDS|3 CHECKSUM|75.99 Could you please help me to write a shell script to compare 1. TOTAL RECORDS from FILE1.dat with NO of RECORDS in FILE.CTL 2.... (8 Replies)
Discussion started by: dreamsportsteam
8 Replies

5. Shell Programming and Scripting

Comparing 2 files using shell script

Hi Experts, I have 2 files 1 file consists of 800 records and 2 file consists of 100 records with matching column as Membership_Num.So i need a script which will compare the 2 files and displays the output.As these are the files the script should take any delimter like (tab,comma) as input... (6 Replies)
Discussion started by: naveen.dasu
6 Replies

6. Shell Programming and Scripting

comparing 2 files in shell script

I have 2 files config1h.txt ----------------- BFMU=ENABLE,ID=PM THR=OFF,REP=ALL,CON=IACM,TIM=OFF;GPON collection strategy 1.3.6.1.2.1.2.2:8 1.3.6.1.2.1.2.2:7 1.3.6.1.4.1.637.61.1.35.11.4:4 1.3.6.1.4.1.637.61.1.35.11.4:3 1.3.6.1.4.1.637.61.1.35.10.1:2 1.3.6.1.4.1.637.61.1.35.10.1:43... (7 Replies)
Discussion started by: LavanyaP
7 Replies

7. Shell Programming and Scripting

Comparing 2 file use c shell script

Hi all, I got 2 file : file1: file2: output: But , must write out in C shell.Anybody can help solve? (6 Replies)
Discussion started by: proghack
6 Replies

8. Shell Programming and Scripting

comparing two files using shell script

hi experts please help me to compare two files which are in different directory file1<file will be master file> (/home/rev/mas.txt} ex x1 x2 file2 <will be in different folder> (/home/rev/per/.....) ex x3 x4 the filesinside per folder i need to compare with master file and the files... (2 Replies)
Discussion started by: revenna
2 Replies

9. UNIX for Dummies Questions & Answers

shell script for comparing 2 files

Hi, how to read the 2 files and compare each other in shell script? i have 2 files test1 and test2, both files contains 20 character records.we have to compare file 1 records with file2, if exists then reject the record else we have to append it to test2 file. in file test1 around 100 single... (2 Replies)
Discussion started by: prashanth.spl
2 Replies
Login or Register to Ask a Question