Eliminating differences in two files


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Eliminating differences in two files
# 1  
Old 07-13-2010
Error Eliminating differences in two files

Hello, I'm having trouble to read two txt files, they have employee records line by line, I need to do the reading of a file that is old and compare it with the new base in the new file, deleting the lines in old file, then add the new file data from the old file and write to the database manager.

I am new to Shell, I appreciate the help
# 2  
Old 07-13-2010
Please show a sample of the two files and the desired output.
# 3  
Old 07-13-2010
Old File
374905,2008, Selmar Evangelista dos Santos Filho, Analista de Sistemas, U$5.500,00
751890,2005, Ricardo de Souza, Técnico de sistemas, U$8.000,00
986250,2000, Eric Bastos, Gerente, U$10.000,00
...

New File
986250,2000, Eric Bastos, Gerente, U$12.000,00
859762, 2009, Fabiana Castro Neves, Assistente Administrativa, U$2.000,00
374905,2008, Selmar Evangelista dos Santos Filho, Analista de Sistemas, U$9.500,00
...

Result = New File
986250,2000, Eric Bastos, Gerente, U$12.000,00
859762, 2009, Fabiana Castro Neves, Assistente Administrativa, U$2.000,00
374905,2008, Selmar Evangelista dos Santos Filho, Analista de Sistemas, U$9.500,00
751890,2005, Ricardo de Souza, Técnico de sistemas, U$8.000,00

Thanks for all.
# 4  
Old 07-13-2010
How about:

Code:
[house@leonov] cat old.file new.file | sort -k 1,1 -u -r
986250,2000, Eric Bastos, Gerente, U$10.000,00
859762, 2009, Fabiana Castro Neves, Assistente Administrativa, U$2.000,00
751890,2005, Ricardo de Souza, Técnico de sistemas, U$8.000,00
374905,2008, Selmar Evangelista dos Santos Filho, Analista de Sistemas, U$5.500,00

# 5  
Old 07-13-2010
but, I need only compare the enrollment and the year (eg 374,905.2008) from both files to simplify the search.
# 6  
Old 07-13-2010
Something like this:
Code:
awk -F"," 'NR==FNR { a[$1","$2]=$1","$2;print;next} {if($1","$2 in a) next;else print; }' new_file old_file

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to do find differences between 2 XML Files?

Hello All, Requirement is to compare 2 XML files and see if there are any differences but from some of the providers We are receiving UTF-16 formatted XML file with no end of line as shown below. Excerpt of data file: ÿþ<^@?^@x^@m^@l^@ ^@v^@e^@r^@s^@i^@o^@n^@=^@"^@1^@.^@0^@"^@... (11 Replies)
Discussion started by: Ariean
11 Replies

2. Shell Programming and Scripting

Need to compare the two files and list out differences between the two

Hi, I need to compare the two files and list out difference between the two. Please assist. Best regards, Vishal (2 Replies)
Discussion started by: Vishal_dba
2 Replies

3. Shell Programming and Scripting

Help comparing 2 files and sending differences

I have 2 files that need to be compared. Email the differences if something is different and don't email if nothing is different. One or both of the files could be empty. One or both could have data in them. example files backup.doc.$(date +%y%m%d) file size is 0 backup.doc.$(TZ=CST+24... (4 Replies)
Discussion started by: jabbott3
4 Replies

4. Shell Programming and Scripting

Comparing two files and list the differences

Hi * I have two text files which has the file size, timestamp and the file name. I need to compare these two files and get the differences in the output format. Can anyone help me out with this. * cat file1.txt *474742 Apr 18* 2010 sample.log *135098 Apr 18* 2010 Testfile 134282 Apr 18* 2010... (7 Replies)
Discussion started by: Sendhil.Kumaran
7 Replies

5. Shell Programming and Scripting

Perl: Comparing to two files and displaying the differences

Hi, I'm new to perl and i have to write a perl script that will compare to log/txt files and display the differences. Unfortunately I'm not allowed to use any complied binaries or applications like diff or comm. So far i've across a code like this: use strict; use warnings; my $list1;... (2 Replies)
Discussion started by: dont_be_hasty
2 Replies

6. UNIX for Dummies Questions & Answers

Finding differences between 2 text files

Hi everyone, I know that's a deep treated issue but I'm actually not able to find the solution. I have 2 plain text files with ~ 2000 rows and ~5 columns. The first column of the shortest file (f1) is fully contained by the first column of the biggest one (f2), but only that column. I want to... (6 Replies)
Discussion started by: OBAFGKM
6 Replies

7. Shell Programming and Scripting

Differences between 2 Flat Files and process the differences

Hi Hope you are having a great weeknd !! I had a question and need your expertise for this : I have 2 files File1 & File2(of same structure) which I need to compare on some columns. I need to find the values which are there in File2 but not in File 1 and put the Differences in another file... (5 Replies)
Discussion started by: newbie_8398
5 Replies

8. Shell Programming and Scripting

Detect differences in two files

All, I have two csv files, the format of which are exactly the same. I would like to find differences between the two files but would like to identify the difference as opposed to just printing a different line. For exmaple File 1 xxx,yyy,zzz,1,2,3 111,222,333,xxx,yyy ... (4 Replies)
Discussion started by: pxy2d1
4 Replies

9. Solaris

Differences between jar files

I want to find the difference between two jar files sitting on a sun box. How do I do this? (3 Replies)
Discussion started by: runnerpaul
3 Replies

10. UNIX for Dummies Questions & Answers

Number of differences between 2 files

Hi, "diff" command takes two file names as arguements and gives the difference between the two. How do I get the number of differences between two files ??? (Excluding whitespaces). Don't ask me to count number of lines produced by "diff". Thanks in advance, Sharath (4 Replies)
Discussion started by: sharuvman
4 Replies
Login or Register to Ask a Question