Shell Programming and Scripting

Hi,

Here below the logs from the mail server:

less /var/log/messages:

Sep 6 04:03:31 server-59 out[30914]: 1252227811|webmaster@zilia.com|antonino.granata@gmail.com|2175|success|1
Sep 6 04:03:33 server-59 in[30897]: 1252227813|news@tarot.com|junk@thess.com|30376|success|1
Sep 6 04:03:35 server-59 in[30932]: 1252227815|mtarmizi@perak.gov.my|baha.ansari@risates.com.pk|2934|success|1
Sep 6 04:03:47 server-59 in[30933]: 1252227827|admin@joboffer.com|kemera@mol.com.mk|1736|success|1

Where:

1252227827 -> this is one of the id generated for every second. Using this id we can find out how many email where send out with in a second.
I 'll use the below command to find out the count of emails send out per account:

less /var/log/messages/ | awk '{print $1,$2,$3, +$6}' | grep "Sep 6" | sort | uniq -c | sort -n

Here below the output of the above command:

Output:
40 Sep 6 06:31:02 1252236662
36 Sep 6 21:07:39 1252289259
19 Sep 6 06:31:24 1252236684
17 Sep 6 12:14:22 1252257262
17 Sep 6 05:25:57 1252232757
13 Sep 6 10:51:03 1252252263

Then,

less /var/log/messages | grep 1252236662

It will list the count of 40 mails send out from this id:

Sep 6 06:31:02 server-59 in[27341]: 1252236662|afnaz.bv@sysh.com.sa|achupnm@gmail.com|8035635|success|1
Sep 6 06:31:02 server-59 in[27341]: 1252236662|afnaz.bv@sysh.com.sa|achupnm@yahoo.co.in|8035635|success|1
Sep 6 06:31:02 server-59 in[27341]: 1252236662|afnaz.bv@sysh.com.sa|afsal.ambalavan@alsaif-motors.com|8035635|success|1
Sep 6 06:31:02 server-59 in[27341]: 1252236662|afnaz.bv@sysh.com.sa|afsalpioneer@gmail.com|8035635|success|1
Sep 6 06:31:02 server-59 in[27341]: 1252236662|afnaz.bv@sysh.com.sa|akthabkm@gmail.com|8035635|success|1

So, I need to automate the process of the above one. while running the command it should email me the email account . For eg: the account "afnaz.bv@sysh.com.sa" has used 40 in count. I need a script to email me the top 15 counts and the email account. Is this possible Via the shell script.

Code:

sed -n '/^Sep 6/s/[^ ]* [^ ]* [^ ]* [^ ]* [^ ]* [^|]*|\([^|]*\)|.*/\1/p' yourLogFile |\
sort | uniq -c | sort -n | head -15 |\
mail -s 'mail count' yourID@your.dom

or shorter:

Code:

awk -F'|' '/Sep 6/ {print $2}' yourLogFile |sort |uniq -c |sort -n |tail -15 |mail -s 'mail count' youID@you.dom

The mail will look like this:

40 afnaz.bv@sysh.com.sa
31 news@tarot.com
...

Hope some awker can do it straight.

Yes. It looks like you have most of the pieces in place already. (Though why do you use less instead of cat?)

You can use cron to run you script at intervals that you decide and the output stdout and stderr will be emailed to the address you provide.

I always keep a text file, ~/text/crontab.txt, to simplify updating cron. I edit it and then call this command to update what cron does.

Code:

crontab ~/text/crontab.txt

Here is a sample file. Be sure to specify the path, because cron executes with a very limited environment.

Code:

# crontab for Ken Jackson
# Time fields:  minute, hour, day, month, day-of-week (0 or 7 is Sun)
MAILTO=ken
22  3  * * *  $HOME/bin/cron_attempt_remote
4   4  * * *  $HOME/bin/cron_uptime
58  6  * * *  $HOME/bin/fixhtaccess -q
6   9  * * *  $HOME/bin/fixhtaccess -q

In the sed command, the path for the file is not mentioned, eg., /var/log/messages and also, this is an automated process, which should will be running in an hourly basis. So, that we can't specifically check with the date, like sep 6.

I hope it makes sense.

Could this fit your needs:

Code:

theDate=$(LC_TIME=C date +'%b %d %H')
sed '/'$theDate'/s/[^ ]* [^ ]* [^ ]* [^ ]* [^ ]* [^|]*|\([^|]*\)|.*/\1/' /var/log/messages |\
...

While running the scripts as a .sh, it gives the error message as

sed: -e expression #1, char 4: unterminated address regex
Null message body; hope that's ok

I tired with different options, but still getting with the same error.