Shell Programming and Scripting

Hello guys,

I have a script like:

echo "Errores 0x01 `cat errores.log | grep 0x00000001 | wc -l` " > class_total
echo "Errores 0x0B `cat errores.log | grep 0x0000000B | wc -l` " >> class_total
echo "Errores 0x45 `cat errores.log | grep 0x00000045 | wc -l` " >> class_total
echo "Errores 0x58 `cat errores.log | grep 0x00000058 | wc -l` " >> class_total
echo "Errores 0x64 `cat errores.log | grep 0x00000064 | wc -l` " >> class_total
echo "Errores 0x66 `cat errores.log | grep 0x00000066 | wc -l` " >> class_total
echo "T O T A L `cat errores.log | grep 0x000 | wc -l` " >> class_total

and when i run it i get a 'class_total' file like:

Errores 0x01 188
Errores 0x0B 127
Errores 0x45 0
Errores 0x58 0
Errores 0x64 38
Errores 0x66 140
T O T A L 493

but the file 'errores.log' that i im counting have 5'000.000 of lines and this process take a few seconds, how i do the same in awk to improve the time of response?

nawk -f lest.awk errors.log

here's lest.awk - not tested

Code:

BEGIN {
  codesN=split("0x00000001 0x0000000B 0x00000045 0x00000058 0x00000064 0x00000066", codesA, " ");
  split("0x01 0x0B 0x45 0x58 0x64 0x66", codesAs, " ");
}

{
   for(i=1; i <= codesN; i++)
     if ( $0 ~ codesA[i] )
        arr[codesAs[i]]++
}

END {
  for( i in arr ) {
    printf("Errores %s %d\n", i, arr[i])
    tot+=arr[i]
  }
  printf("TOTAL %d\n", tot)
}

I don't know too much of awk, i just know that awk is powerfull as another, when i run the following script u have this problem:

awk: syntax error near line 1
awk: bailing out near line 1

what can i do?

use nawk instead of awk.

Not yet, i still have problems:

example# nawk prueba.awk borrar

nawk: syntax error at source line 1
context is
>>> prueba. <<< awk
nawk: bailing out at source line 1

vgersh99's solution is good, but it might be possible to refine it a bit. Assuming a nawk/gawk (likewise untested):

Code:

k = match($0,/0x000000(01|0B|45|58|64|66)/) {
    arr[substr($0, k + 8, 2)]++
}

END {
    for (i in arr)
        print "Errores", "0x" i, arr[i]
}

What are the differences?
[Old awk solution deleted --- no alternation ("|") available.]

The disadvantage here is that nawk and awk don't "capture" the thing matched, so you still do the substr call on every match (though it's in machine language and therefore fast). (I don't use gawk, but it may have a remedy for this.)

A ruby solution would work like this (and the perl solution would be similar):

Code:

$hsh = { "01" => 0, "0B" => 0, "45" => 0, "58" => 0, "64" => 0, "66" => 0 }
ARGF.each do |line|
    next unless m = %r/0x000000(01|0B|45|58|64|66)/.match line
    $hsh[m[1]] += 1
end
$hsh.keys.sort do |k|
    print "Errores 0x", k, " ", $hsh[k]
end

pay more attention to the postings.......
nawk -f prueba.awk borrar