Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Column comparision in two files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Column comparision in two files
# 8  
Old 04-04-2009
Quote:
Originally Posted by nuthalapati
Not working.

grep -vf temp file2 just hangs

This works

Code:
nawk -F"," 'FILENAME=File1 {array[$1]=$1} FILENAME=File2 { if (array[$4]) {print $0}}' File1 File2

# 9  
Old 04-05-2009
vgersh99,

Can you please explain your script.

Thank you.
# 10  
Old 04-06-2009
Code:
my @arr=('xyz.com','eg.com');
undef $/;
open $fh,"<","a.txt";
my @brr=split("\n",<$fh>);
map {
	for(my $i=0;$i<=$#brr;$i++){
		delete $brr[$i] if $brr[$i]=~/$_/;
	}
} @arr;
print join "\n", grep {$_!=""} @brr;

# 11  
Old 04-06-2009
file1:
Code:
laeg.com,2/2/23,a,b,ga
aeg.com,2/2/23,a,b,ga
xyz.com,2/2/12,a,b,c
eg.com,2/2/23,a,b,ga

file2:
Code:
1,2,ua,xyz.com
1,2,ua,abc.com
1,2,ua,eg.com
1,2,ua,easg.com
1,2,ua,zth.com

Executing
Code:
nawk -F, 'FNR==NR {f2[$4]; next} !($1 in f2)' OFS=',' file2 file1

yields:
Code:
laeg.com,2/2/23,a,b,ga
aeg.com,2/2/23,a,b,ga

Make sure that your data files have no embedded spaces present in one file and NOT present in the other.
In the future, when posting either data or code samples, use BB Code tags.
Last edited by vgersh99; 04-06-2009 at 11:06 AM..
# 12  
Old 04-06-2009
Something is seriously wrong, may be awk version (3.1.3) or something. Coz I always get this output.

laeg.com,2/2/23,a,b,ga
aeg.com,2/2/23,a,b,ga
xyz.com,2/2/12,a,b,c
eg.com,2/2/23,a,b,ga
# 13  
Old 04-06-2009
Vgersh99, Thank you so much.

I got it running. What I did is installed gawk for windows xp and ran this script and it worked. So something problem with my unix machine.

My new problem is file1 and file2 record count is not equal. The scripts throws a fatal error
gawk: (FILENAME=file1.csv FNR=207490) and my file2.csv has 86000 records.
# 14  
Old 04-06-2009
I had reversed the logic and tried seems to be working but in one file the email is without quotes and in another is with quotes

"abctest.com" and abc.com so that breaking my test. How do we include " value " comparision

Thanks for your help vgersh99.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Comparision of two data columns in different files

Hi All, I have a requirement to compare data column which is the last field in two different files and trigger and alert if the difference is greater than 1 for each row. File1 Jan Acount1 2014 11223 Feb Account2 2014 2345 Mar Account3 2014 1233 File2 Jan Account1 2014... (1 Reply)
Discussion started by: Naresh Babu
1 Replies

2. Shell Programming and Scripting

Comparision of two text files

Dear all, I am having two files big files i need an output file as first occurance of file1 field in file2 example: file1:raju ranifile2:raju|123 raju|879 rani|623 rani|253result:raju|123 rani|623pls help me in this regard (3 Replies)
Discussion started by: suryanarayana
3 Replies

3. Shell Programming and Scripting

Two files comparision with single field

Hi , Im new to uxin environment and shell scripting.... please help me with the code for the following scenario..... file 1 contains the following fields abc 200 rupee IND cdf 400 dollar USA efg 300 euro GER hij 600 pound ENG file 2 SBI abc 321 dollar CANAD kvr mnd ... (6 Replies)
Discussion started by: shivaji_veer
6 Replies

4. Shell Programming and Scripting

awk comparision between 2 files and substitution in third

Hi All, I have two files in the following format. File 1 : 1044|1|20121031|2910039.4|MR|201210|G1044|E 1082|2|20121031|1664662.84|MR|201210|G1082|E 1696|3|20121031|190801.5|MR|201210|G1696|E 1824|4|20121031|196350|MR|201210|G1824|E 1900|5|20121031|221447.8|MR|201210|G1900|E File 2 :... (7 Replies)
Discussion started by: nua7
7 Replies

5. UNIX and Linux Applications

Unix Shell Scripting : Comparision of two files

Hi, We need to compare a text file File1.txt and config file File2.txt in a way that it checks if the content of File1.txt exists between the range mentioned in File2.cfg. The range here is the range between col1 and col2 of File2.cfg If the content of File1.txt lies between the range of... (12 Replies)
Discussion started by: CFA
12 Replies

6. Shell Programming and Scripting

Comparision of fields in 2 files.

Hi Experts, I have two huge files in the format as shown below.I need to open a file1 and file 2 , cut first 24 characters of file 1 and search if the key exists in file 2 first field (delimted by *). If the value exists , copy the third field from file 2 and replace the 5th field in file 1 .... (4 Replies)
Discussion started by: nua7
4 Replies

7. Shell Programming and Scripting

Comparision of two huge unix files - Reconcilation

Hi, I have two huge file; each one has approximately 150000 lines. I need to compare both of them and store the unmatched lines into a different file. I have searched for everything in google but did not get solution. Files are: File1 NRALBAMINDB20003726 NRALBAMINDB20003727... (16 Replies)
Discussion started by: Suman Singh
16 Replies

8. Shell Programming and Scripting

Columns comparision of two large size files and printing the difference

Hi Experts, My requirement is to compare the second field/column in two files, if the second column is same in both the files then compare the first field. If the first is not matching then print the first and second fields of both the files. first file (a .txt) < 1210018971FF0000,... (6 Replies)
Discussion started by: krao
6 Replies

9. UNIX for Advanced & Expert Users

Comparision of two files.

File Structure file1.txt.arch 029429288,1,,,02087400376,N,02087400376,N,0,02087400376,N,0,0,8010,08000151736,U,N,,08000151736,U,20100726111237,20100726111237,0,20100726111651,00004140,16,16,10,N;... (1 Reply)
Discussion started by: ravigupta2u
1 Replies

10. Shell Programming and Scripting

comparision of string in various files

i want to take position 19-24(only first line) from all files and need to compare any duplication is there or not. If duplication, then i have to print the file names. I have written to take the characters from 19-24 from all files. but how to compare ? ... (1 Reply)
Discussion started by: senthil_is
1 Replies
Login or Register to Ask a Question