Hi,
I have a list of log files as follows:

Code:

name_date_0001_ID0.log
name_date_0001_ID2.log
name_date_0001_ID1.log
name_date_0002_ID2.log
name_date_0004_ID0.log
name_date_0005_ID0.log

name_date_0021_ID0.log

name_date_0025_ID0.log

.......................................
name_date_0028_ID0.log
name_date_0029_ID0.log
name_date_0030_ID0.log

I need to generate numbers from 1 to 30 and match them with their equivalent extracted from the filename (if duplicates are found, than multiply the rows with the numbers of duplicates) and then search for a pattern inside the log file.
With help from internet I managed to complete each operation, but I do not know to how to merge them in a single command.
Generate numbers from 1 to 30 using :

Code:

awk 'BEGIN { for (i = 1; i <= 30; i++) printf "%06d\n", i }'

Now I need to match

Code:

0001 - name_date_0001_ID0.log
0001 - name_date_0001_ID2.log
0002 - name_date_0001_ID2.log
0003 - 
......
0030 - name_date_0030_ID0.log

Having those numbers generated first will help me to spot if a file is missing (like name_date_0003_ID0.log)

To extract the numeric value and see how many duplicates are I have used this command:

Code:

ls -1 |awk -F '_' '{print $3}' | awk -F '.' '{print $1}' | awk '{a[$0]++}END{for(i in a){print i, a[i]}}'

with the following results:

Code:

0001 3
0002 1
.......
0030 1

The last command that I'm using it is to search for a pattern in all the log files, print the 2nd line after matching, and count number of “%”

Code:

awk '/pattern/ {c[NR+2]++}  c[NR]  {n=split($0,a,"%"); printf("%-40s%2s%-80s%2s%4s\n",FILENAME,"  ",$0,"  ",n-1)}' *.log

The final result should look like:

Code:

0001 - name_date_0001_ID0.log    “2nd line after the pattern is found” “number of “%” signs” 
0001 - name_date_0001_ID2.log    “2nd line after the pattern is found” “number of “%” signs” 
0002 - name_date_0001_ID2.log    “2nd line after the pattern is found” “number of “%” signs”
0003 -    
......
0030 - name_date_0030_ID0.log    “2nd line after the pattern is found” “number of “%” signs”

Also if possible I would like to check for the length of ID0, ID1 .... IDn and if less then 3 characters then display a warning after “number of “%” signs”

Please help me merging all the codes to achieve the above results.
Alex