Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Compare 2 log files

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Compare 2 log files
# 8  
Old 04-22-2009
Quote:
Originally Posted by Aswex
Hi,

do you mind tell me what i need to do ? Here is the error code I've got

nawk: can't open file FNR == NR { a[$0]++; next } a[$NF]
source line number 1
context is
>>> <<<


I've done this :

nawk -f/ 'FNR == NR { a[$0]++; next } a[$NF]' \
what else ? > one_trash.log two_arch.log
This is NOT what's been posted earlier:
Code:
nawk -F/ 'FNR == NR { a[$0]++; next } a[$NF]'  one_trash.log two_arch.log

# 9  
Old 04-23-2009
Dear vgersh99,

Thanks for a lot for your help, and I am sorry for my las post. The line code is working great, but the result is not exactly what I need...

On the first file "one_trash.log" I've got files name.

On the second file "two_arch.log" I've got where exactly where is stored a lots of line name.

My needs is to match all files name on the first log with the second log file.

The result of the command will create another file ex: match.log where the complet path will be preserved.

ex : compare first log with the second log file = match.log
match.log will have :

/rep1/rep2/rep3/filename
/rep1/filename
/rep1/rep2/filename ...etc.

Thanks a lot, for your help
# 10  
Old 04-23-2009
I believe the requirements are clear and that the awk script should work as provided. Please provide a sample output of what you are getting (say pipe the output to head -20).
# 11  
Old 04-23-2009
Dear posters,

I've lot my mind on this.. I am sorry to not be able to post the result of the nawk command as it doesn't work anymore. That's so wired.

I did :

nawk -F/ 'FNR == NR { a[$0]++; next } a[$NF]' one_trash.log two_arch.log

severals times with new log files everytime as otheus seems to say that the code should work, and I did make it work...but after clean up all files to try again with clean log files there is no more result.

I will try again tomorrow to see with clear mind what I've done wrong again Smilie

Oh just for info : All rights access are good and if I used >> to complet a log file to see what's wrong the file is empty.

Thanks a lot to veryone for your patence and help..
Last edited by Aswex; 04-23-2009 at 11:29 AM..
# 12  
Old 04-23-2009
Please post the head -10 of each log file and I will see if I can reproduce the problem on this side.
# 13  
Old 04-24-2009
Hello OTHEUS,

Here is what's your need :


one_trash.log

MERCURY_TITAN_20001227_20010103_R20010117
MERCURY_TITAN_20010103_20010110_R20010117
MERCURY_TITAN_20010110_20010117_R20010117
MERCURY_TITAN_20010117_20010124_R20010117
MERCURY_TITAN_20010124_20010131_R20010117
MERCURY_TITAN_20010117_20010124_R20010207
MERCURY_TITAN_20010124_20010131_R20010207
MERCURY_TITAN_20010131_20010207_R20010207
MERCURY_TITAN_20010207_20010214_R20010207
MERCURY_TITAN_20010214_20010221_R20010207


two_arch.log

/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20001227_20010103_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010103_20010110_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010110_20010117_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010117_20010124_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010124_20010131_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010117_20010124_R20010207
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010124_20010131_R20010207
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010131_20010207_R20010207
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010207_20010214_R20010207
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010214_20010221_R20010207

I am sure you will make this to work.

Thanks
# 14  
Old 04-24-2009
given the 2 sample files above and an already suggested code, I get:
Code:
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20001227_20010103_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010103_20010110_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010110_20010117_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010117_20010124_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010124_20010131_R20010117
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010117_20010124_R20010207
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010124_20010131_R20010207
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010131_20010207_R20010207
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010207_20010214_R20010207
/ARCHIVE/WBD1/RESTART/MERCURY_TITAN_20010214_20010221_R20010207

What is is correct? What's the desired output?
In the future, please use BB code tags when posting code/data samples - you'll increase the chances of somebody actually looking at it.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compare files and share output from both files

hi all, Thanks to all for your great help... I have a scenario that I have two files (file1 & file2). I need to compare two files entire row by row and share the output if any discrepancies within two files. File1: DB1|TB1|C1,C3 DB2|TB2|C1,C2 DB3|TB3|C1,C2,C3,C4 File2: ... (2 Replies)
Discussion started by: Selva_2507
2 Replies

2. Shell Programming and Scripting

Compare multiple files, and extract items that are common to ALL files only

I have this code awk 'NR==FNR{a=$1;next} a' file1 file2 which does what I need it to do, but for only two files. I want to make it so that I can have multiple files (for example 30) and the code will return only the items that are in every single one of those files and ignore the ones... (7 Replies)
Discussion started by: castrojc
7 Replies

3. Shell Programming and Scripting

Compare two files, then overwrite first file with only that in both files

I want to compare two files, and search for items that are in both. Then override the first file with that containing only elements which were in both files. I imagine something with diff, but not sure. File 1 One Two Three Four Five File 2 One Three Four Six Eight (2 Replies)
Discussion started by: castrojc
2 Replies

4. Shell Programming and Scripting

Compare different String in Log Files

Hi Guys , sorry for my first post but a newbie here need some help on my simple scripts. I have some scripts below that count the job started and the job finished and is the job started and job finished equal ..then all job was successfully run and finished on that day. but sometime the was... (3 Replies)
Discussion started by: thermometer
3 Replies

5. Shell Programming and Scripting

Require compare command to compare 4 files

I have four files, I need to compare these files together. As such i know "sdiff and comm" commands but these commands compare 2 files together. If I use sdiff command then i have to compare each file with other which will increase the codes. Please suggest if you know some commands whcih can... (6 Replies)
Discussion started by: nehashine
6 Replies

6. Shell Programming and Scripting

Compare 2 folders to find several missing files among huge amounts of files.

Hi, all: I've got two folders, say, "folder1" and "folder2". Under each, there are thousands of files. It's quite obvious that there are some files missing in each. I just would like to find them. I believe this can be done by "diff" command. However, if I change the above question a... (1 Reply)
Discussion started by: jiapei100
1 Replies

7. Shell Programming and Scripting

How to compare 2 files & get only few columns based on a condition related to both files?

Hiiiii friends I have 2 files which contains huge data & few lines of it are as shown below File1: b.dat(which has 21 columns) SSR 1976 8 12 13 10 44.00 39.0700 70.7800 7.0 0 0.00 0 2.78 0.00 0.00 0 0.00 2.78 0 NULL ISC 1976 8 12 22 32 37.39 36.2942 70.7338... (6 Replies)
Discussion started by: reva
6 Replies

8. Shell Programming and Scripting

compare files in two directories and output changed files to third directory

I have searched about 30 threads, a load of Google pages and cannot find what I am looking for. I have some of the parts but not the whole. I cannot seem to get the puzzle fit together. I have three folders, two of which contain different versions of multiple files, dist/file1.php dist/file2.php... (4 Replies)
Discussion started by: bkeep
4 Replies

9. Shell Programming and Scripting

Compare log files and get latest

I have a directory location where in some logs gets generated whenever some application build is triggered. I need to send the generated log as an email to end user. I will get files like abcyyyy_mm_dd_time.log and next file will have different time for same day. Need to run a cron and take the... (18 Replies)
Discussion started by: yogi90
18 Replies

10. Shell Programming and Scripting

compare two files and to remove the matching lines on both the files

I have two files and need to compare the two files and to remove the matching lines from both the files (4 Replies)
Discussion started by: shellscripter
4 Replies
Login or Register to Ask a Question