Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

[AWK] Logparse script problems

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting [AWK] Logparse script problems
# 1  
Old 05-01-2010
[AWK] Logparse script problems
Hey,

I've gone through the code a number of times but I can't get the result that I want.

If I run it on some big old maillogs then it basically doesn't give the right output.

The script:
Code:
#!/bin/awk -f
 
BEGIN { delivery_count = 0; deferred_mail_count = 0; deliveries_failed = 0;DOMAIN_NAME_SPLIT_NUMBER = 2;}

function extract_domain_name(string) {
   
     n = split(string, domain_name, "@");
     tstr = domain_name[DOMAIN_NAME_SPLIT_NUMBER]
     /* get rid of the trailing > */
    result = substr(tstr, 1, length(tstr) - 1);
    return result;
}


{ if ($1 == "d") {
        n = split($7, domain_name, "@");
        if ($2 == "z") { 
            deferred_mail_count++;
            printf("Deferred mail sending to: %s\n", 
                   extract_domain_name($7));
        }
        
        if ($2 == "d") { 
            deliveries_failed++;
            printf("Failed to deliver to: %s\n", 
                   extract_domain_name($7));
        }
        delivery_count++;
  }
}
      
END { printf("Tried to send %d mails, %d of them were deferred and %d failed\n", delivery_count, deferred_mail_count, deliveries_failed);}

Example, of input line:
Code:
d d 1004274655.308560500 1004274655.382174500 1004274655.417475500 1873 SINT_PANCRAS@Groenland.com local.VLAARDINGEN@Nieuwzeeland.com 22061 81 
 
$7 orginally being(w/o spaces): < SINT_PANCRAS@Groenland.com >

The WRONG but current output is:
Code:
### As you can see below, it printed nothing. ###
Failed to deliver to: 
Deferred mail sending to:
Deferred mail sending to:
Deferred mail sending to:
Deferred mail sending to:
Tried to send 123 mails, 4 of them were deferred and 1 failed

The RIGHT output would be:
Code:
Failed to deliver to: Groenland.com
Deferred mail sending to: Example.com
Deferred mail sending to: Exampleb.com
Deferred mail sending to: Example.com
Deferred mail sending to: Exampleb.com
Tried to  send 123 mails, 4 of them were deferred and 1 failed

I don't know what is wrong in the script, hopefully you experts can tell me a bit more about my mistakes.

Thanks in advance!!!! SmilieSmilie

----- ----- -----
Edit:
Furthermore, how would I go about editing my script so it count the deferred mail per Domain, for example:
Code:
Exampleb.com: 2 
Example.com: 1
France.com: 6

I know I'm asking too much haha, sorry. I'm just very limited in my knowledge of AWK. That's why im hoping you guys could somehow help me out. I would really, really appreciate it a lot!!! Smilie
# 2  
Old 05-01-2010
change the $7 to $8 as below and try.


Code:
#!/bin/awk -f
 
BEGIN { delivery_count = 0; deferred_mail_count = 0; deliveries_failed = 0;DOMAIN_NAME_SPLIT_NUMBER = 2;}

function extract_domain_name(string) {
   
     n = split(string, domain_name, "@");
     tstr = domain_name[DOMAIN_NAME_SPLIT_NUMBER]
     /* get rid of the trailing > */
    result = substr(tstr, 1, length(tstr) - 1);
    return result;
}


{ if ($1 == "d") {
        n = split($8, domain_name, "@");
        if ($2 == "z") { 
            deferred_mail_count++;
            printf("Deferred mail sending to: %s\n", 
                   extract_domain_name($8));
        }
        
        if ($2 == "d") { 
            deliveries_failed++;
            printf("Failed to deliver to: %s\n", 
                   extract_domain_name($8));
        }
        delivery_count++;
  }
}
      
END { printf("Tried to send %d mails, %d of them were deferred and %d failed\n", delivery_count, deferred_mail_count, deliveries_failed);}

# 3  
Old 05-09-2010
Sorry for the late reply, however, it does not work.

It doesn't show the domains at all.
# 4  
Old 05-09-2010
Maybe something like this?
Code:
awk '
{split($7, domain_name, "@"); sub(/ *$/, "", domain_name[2])}
$1=="d"{
  if($2=="z") {
    deferred_mail_count++;
    dn=domain_name[2]
    a[dn]++
    printf("Deferred mail sending to: %s\n", dn)
  }
  if($2=="d") {
    deliveries_failed++;
    printf("Failed to deliver to: %s\n", domain_name[2]);
  }
  delivery_count++;
}
END{
  printf("Tried to send %d mails, %d of them were deferred and %d failed\n\n", delivery_count, deferred_mail_count, deliveries_failed)
  for (i in a)
     print i ":", a[i];
}' file

Last edited by Franklin52; 05-09-2010 at 03:27 PM.. Reason: adding code for deferred mail per domain
# 5  
Old 05-09-2010
Another awk program :
Code:
awk -F'[ >@]+' '
BEGIN {
   msg["z"] = "Deferred mail sending to:";
   msg["d"] = "Failed to deliver to:";
}
$1 == "d" {
   domain = $8;
   print msg[$2],domain;
   delivery_count++;
   count[$2]++;
   if ($2 == "z") deferred_domain[domain]++;
}
END {
   printf "\nTried to send %d mails, %d of them were deferred and %d failed\n",
          delivery_count, count["z"], count["d"];
   print "Deferred mails per domain:";
   for (domain in deferred_domain)
       print domain ":",deferred_domain[domain];
}
' Inputfile

Inputfile :
Code:
d z 1004274655.308560500 1004274655.382174500 1004274655.417475500 1873 <SINT_PANCRAS@Exemple.com> local.VLAARDINGEN@Nieuwzeeland.com 22061 81
d d 1004274655.308560500 1004274655.382174500 1004274655.417475500 1873 <SINT_PANCRAS@Groenland.com> local.VLAARDINGEN@Nieuwzeeland.com 22061 81
d d 1004274655.308560500 1004274655.382174500 1004274655.417475500 1873 <SINT_PANCRAS@Groenland2.com> local.VLAARDINGEN@Nieuwzeeland.com 22061 81
d z 1004274655.308560500 1004274655.382174500 1004274655.417475500 1873 <SINT_PANCRAS@Exemple2.com> local.VLAARDINGEN@Nieuwzeeland.com 22061 81
d z 1004274655.308560500 1004274655.382174500 1004274655.417475500 1873 <SINT_PANCRAS@Exemple2.com> local.VLAARDINGEN@Nieuwzeeland.com 22061 81

Output :
Code:
Deferred mail sending to: Exemple.com
Failed to deliver to: Groenland.com
Failed to deliver to: Groenland2.com
Deferred mail sending to: Exemple2.com
Deferred mail sending to: Exemple2.com

Tried to send 5 mails, 3 of them were deferred and 2 failed
Deferred mails per domain:
Exemple2.com: 2
Exemple.com: 1

Jean-Pierre.
# 6  
Old 05-11-2010
Thanks so much everyone!!

You all helped me a lot, I'm really, really happy with all the help.

Thanks everyone!!!
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Having Problems with AWK

So, I'm having a lot of crazy problems with Awk that I cannot understand. This one in particular is driving me nuts. Here is one section of my Awk script: print $0 sub(/Jan/,"",$2) sub(/Feb/,"",$2) sub(/Mar/,"",$2) sub(/Apr/,"",$2) sub("May","",$2) ... (5 Replies)
Discussion started by: rrdein
5 Replies

2. Shell Programming and Scripting

awk problems - awk ignores conditions

awk 'BEGIN{ if('"$CATE"'<'"${WARN}"') printf ("%s", "'"`Kfunc "" ; break`"'") else if (('"${CATE}"'>='"${WARN}"') && ('"${CATE}"'<'"${CRIT}"')) printf ("%s", "'"`Wfunc ""; break`"'") else if ('"${CATE}"'>='"${CRIT}"') printf... (6 Replies)
Discussion started by: SkySmart
6 Replies

3. Shell Programming and Scripting

Problems editing file with awk in bash script

Hello dear users, here I have a script to manipulate .csv files that are like this originally: And I need to make a script to delete certain fields. Each field is separated with a comma. So, here is my script (at least a part of it): Field $1 is composed of a name, and then a... (5 Replies)
Discussion started by: sr00t
5 Replies

4. UNIX for Dummies Questions & Answers

Problems with AWK

Hi I am writing a shell script for a number of things and aone problem that keeps comming up is AWK formatting. When commands are typed into the command line they are fine, but when executed in the script the results are pilled up and not in a list/table format. I have tried using ... (2 Replies)
Discussion started by: AngelFlesh
2 Replies

5. UNIX for Dummies Questions & Answers

problems with awk

Using Linux, I am trying to create a list of all the lines that have "Non-white" or "No" in column 3 of a file: ethnicity.txt. I have used the following command : awk '$3 == "No" || $3 == "Non-white" {print $1, $2, $3}' ethnicity.txt This only returns the lines with "No" and none of... (3 Replies)
Discussion started by: polly_falconer
3 Replies

6. Shell Programming and Scripting

AWK in CSH script problems

Hello Guys, I was trying to obtain the information from the /etc/passwd file, here was my script: 38 echo -n "What's your login name? " 39 set logname=$< 40 echo "Your login name is $logname, your user's ID is `grep $logname /etc/passwd|awk -F: '{print $3}'`" 41 echo " Your home dir is... (1 Reply)
Discussion started by: tpltp
1 Replies

7. Shell Programming and Scripting

help.. Problems in using awk

I do have a file (named as templist) which looks like this one: 00450000.000000 00402300.000000 00040000.000000 00020000.000000 00020000.000000 00020000.000000 00020000.000000 and I want to make a script that adds this using AWK or FOR. I tried using awk using the command but it just... (8 Replies)
Discussion started by: dakid
8 Replies

8. UNIX for Advanced & Expert Users

awk problems

awk ' FILENAME=="First"{ arr = 1; x=sub ; } FILENAME=="Second"{ if (/^10/ &&... (5 Replies)
Discussion started by: Ehab
5 Replies

9. Shell Programming and Scripting

awk problems

If i try the -f option for awk, i get the "awk: can't open " error message The following awk statement works fine without the -f option `awk <$RULES '/^IGNORE_POLICY / { print $2 }'` Below how i turned on debugging to show what is happening, can someone provide me with some advice!!!! ... (1 Reply)
Discussion started by: Junes
1 Replies

10. Shell Programming and Scripting

Problems with AWK

Hi I'm a newbie to Unix scripting and was having some problems with AWK. I have written this little script that should read a process list and then print out the PID's of the offending processes. Unfortunately it doesn't seem to work! The script is as follows: ps -ef | awk '{if... (10 Replies)
Discussion started by: trainee
10 Replies
Login or Register to Ask a Question