UNIX for Dummies Questions & Answers

here is the exact data i am using:
FILENAME1 XXXXX FOO BAR Date: 09/01/08
FILENAME1 XXXXX FOO BAR Date: 09/02/08
FILENAME1 XXXXX FOO BAR Date: 09/03/08
FILENAME2 XXXXX FOO BAR Date: 09/01/08
FILENAME2 XXXXX FOO BAR Date: 09/02/08

FILENAME1 Open 3:45 3:43
FILENAME1 Closed 0:00 0:01
FILENAME1 Total 0:15 0:12
FILENAME1 Open 0:00 0:04
FILENAME1 Total 4:00 4:00
FILENAME2 Open 3:45 3:38
FILENAME2 Closed 0:00 0:00
FILENAME2 Total 0:15 0:14

i am getting
FILENAME1 Open 3:45 3:43 XXXXX FOO BAR Date: 09/02/08
FILENAME1 Closed 0:00 0:01 XXXXX FOO BAR Date: 09/02/08
FILENAME1 Total 0:15 0:12 XXXXX FOO BAR Date: 09/02/08
FILENAME1 Open 0:00 0:04 XXXXX FOO BAR Date: 09/02/08
FILENAME1 Total 4:00 4:00 XXXXX FOO BAR Date: 09/02/08
FILENAME2 Open 3:45 3:38 XXXXX FOO BAR Date: 09/02/08
FILENAME2 Closed 0:00 0:00 XXXXX FOO BAR Date: 09/02/08
FILENAME2 Total 0:15 0:14 XXXXX FOO BAR Date: 09/02/08


I want
FILENAME1 Open 3:45 3:43 XXXXX FOO BAR Date: 09/01/08
FILENAME1 Closed 0:00 0:01 XXXXX FOO BAR Date: 09/01/08
FILENAME1 Total 0:15 0:12 XXXXX FOO BAR Date: 09/01/08
FILENAME1 Open 0:00 0:04 YYYYY FOO BAR Date: 09/02/08
FILENAME1 Total 4:00 4:00 YYYYY FOO BAR Date: 09/02/08
FILENAME2 Open 3:45 3:38 ZZZZZ FOO BAR Date: 09/03/08
FILENAME2 Closed 0:00 0:00 ZZZZZ FOO BAR Date: 09/03/08
FILENAME2 Total 0:15 0:14 ZZZZZ FOO BAR Date: 09/03/08

this script you have me first is giving me what i need

#!/bin/sh
awk 'NR == FNR {
t = $1
sub(/[^ \t]* /, "")
_[t] = $0
next
}
($1 in _ && /Total/ && $0 = $0 FS _[$1]) || 1
' bbb xxx

only thing is the date is not repeating but changing fine:
FILENAME1 Open 3:45 3:43
FILENAME1 Closed 0:00 0:01
FILENAME1 Total 0:15 0:12 XXXXX FOO BAR Date: 09/01/08
FILENAME1 Open 0:00 0:04
FILENAME1 Total 4:00 4:00 YYYYY FOO BAR Date: 09/02/08
FILENAME2 Open 3:45 3:38
FILENAME2 Closed 0:00 0:00
FILENAME2 Total 0:15 0:14 ZZZZZ FOO BAR Date: 09/03/08

I can use this not a problem.. if you have the time can you pl expalin this code to me. So that i can modify and maintain it thanks!!!!!!!!

I'll try to explain the script after the requirement has been met.
I'm not sure about the logic though ...
It seams something like this (the code assumes that the first column in both files is ordered and that the number of records in the first file is equal to the number of records matching the Total pattern in the second one):

Code:

awk 'NR == FNR {
  sub(/[^ \t]* /,"")
  r[FNR] = $0
  next
  }
$0 = $0FS r[c?c:++c]  
/Total/ { c++ }
' file1 file2

For example:

Code:

$ head file[12]
==> file1 <==
FILENAME1 XXXXX FOO BAR Date: 09/01/08
FILENAME1 XXXXX FOO BAR Date: 09/02/08
FILENAME1 XXXXX FOO BAR Date: 09/03/08
FILENAME2 XXXXX FOO BAR Date: 09/01/08
FILENAME2 XXXXX FOO BAR Date: 09/02/08

==> file2 <==
FILENAME1 Open 3:45 3:43
FILENAME1 Closed 0:00 0:01
FILENAME1 Total 0:15 0:12
FILENAME1 Open 0:00 0:04
FILENAME1 Total 4:00 4:00
FILENAME2 Open 3:45 3:38
FILENAME2 Closed 0:00 0:00
FILENAME2 Total 0:15 0:14 
$ awk 'NR == FNR {
  sub(/[^ \t]* /,"")
  r[FNR] = $0
  next
  }
$0 = $0FS r[c?c:++c]
/Total/ { c++ }
' file1 file2
FILENAME1 Open 3:45 3:43 XXXXX FOO BAR Date: 09/01/08
FILENAME1 Closed 0:00 0:01 XXXXX FOO BAR Date: 09/01/08
FILENAME1 Total 0:15 0:12 XXXXX FOO BAR Date: 09/01/08
FILENAME1 Open 0:00 0:04 XXXXX FOO BAR Date: 09/02/08
FILENAME1 Total 4:00 4:00 XXXXX FOO BAR Date: 09/02/08
FILENAME2 Open 3:45 3:38 XXXXX FOO BAR Date: 09/03/08
FILENAME2 Closed 0:00 0:00 XXXXX FOO BAR Date: 09/03/08
FILENAME2 Total 0:15 0:14  XXXXX FOO BAR Date: 09/03/08

That is indeed correct..however i did some analysis and found that there was a summary record in the input file that was creating one extra Total record in file2!!!!

I will think of a way to filter this and then what you state will be true:

the first column in both files is ordered and that the number of records in the first file is equal to the number of records matching the Total pattern in the second one.

thanks

yes i removed the summary and the code ran fine, It produces the exact output,. I will have to omit the summary in my extract or this code has to omit the last Total block everytime the filename changes. (a total of 6 lines..open..closed...et,. Total) ..

What's the format of the summary line?
Could you give an example of two blocks, summary line included?

The summary line is the same format except that its the last 6 lines of each file.so everytime the filename changes.. the last 6 lines are summary lines and wont have a entry in the first file.

FILENAME1 XXXXX FOO BAR Date: 09/01/08
FILENAME1 XXXXX FOO BAR Date: 09/02/08
FILENAME1 XXXXX FOO BAR Date: 09/03/08
FILENAME2 XXXXX FOO BAR Date: 09/01/08
FILENAME2 XXXXX FOO BAR Date: 09/02/08

FILENAME1 Open 3:45 3:43
FILENAME1 Closed 0:00 0:01
FILENAME1 Total 0:15 0:12
FILENAME1 Open 0:00 0:04
FILENAME1 Total 4:00 4:00
FILENAME1 Open 4:00 4:00
FILENAME1 Closed 4:00 4:00
FILENAME1 Other 4:00 4:00
FILENAME1 Other 4:00 4:00
FILENAME1 Other 4:00 4:00
FILENAME1 Total 4:00 4:00
FILENAME2 Open 3:45 3:38
FILENAME2 Closed 0:00 0:00
FILENAME2 Total 0:15 0:14
FILENAME2 Open 4:00 4:00
FILENAME2 Closed 4:00 4:00
FILENAME2 Other 4:00 4:00
FILENAME2 Other 4:00 4:00
FILENAME2 Other 4:00 4:00
FILENAME2 Total 4:00 4:00

thanks