Sponsored Content
Top Forums Shell Programming and Scripting Log search and mail it if the log is updated before 24 hours from the current time Post 302831901 by gacanepa on Friday 12th of July 2013 07:41:11 AM
Old 07-12-2013
Quote:
Originally Posted by Kalaihari
Am so happy for the above explanations dude,, Thanks a lot for spending your valuable time for answering this question and doubts... Smilie
You're welcome Smilie.
Here's an improved, fully commented version of the script:
Code:
#!/bin/bash

################################################################################
# AUTHOR: Gabriel A. Cánepa / Twitter: @gacanepa
# CREATION DATE: July 11, 2013
# LICENSE: GPL v3 or later. See http://www.gnu.org/licenses/gpl.html
# USAGE: 
#	- Create a plain text file (THE FILE) with a list of files to be examined.
#	  For example:
#		ls -ld /var/log/* | grep '^-' | grep 'log$' | awk '{print $9}' > mylogs
#		[List all regular files (grep '^-' looks for a hyphen at the beginning
#		of each line resulting from the output of the ls command) that end in 
#		.log, then prints the 9th field, which is the absolute pathname of each 
#		file (see the -d option of the ls command)]
#	- Chmod it to 700 (or give it adequate permissions)
#	- This script will:
#		* search the word ERROR in the last 100 lines of those files.
#		* if any of those files doesn't exist, or is not a regular file, 
#		  the script will skip it and continue with the next file.
#		* detect whether each file has been updated during the last 24 hours.
#		* send the results via email.
#		* See example: http://i40.tinypic.com/2e5pnjd.png
# MODIFICATION HISTORY:
#	- July 12, 2013: 
#		* Added email header with host information and job date
#		* Added email footer: user executing the script
#		* Replaced THE FILE's relative pathname (mylogs) for its absolute
#		  pathname (/home/gacanepa/stuff/scripts/mylogs), stored in the 
#		  loglist variable, to be able to run the script through cron as well.
################################################################################

mailcontents=mailbody # Auxiliary file that is used to store the contents of the email's body
loglist=/home/gacanepa/stuff/scripts/mylogs # Absolute path to the file that contains the
											# list of files to be examined. This way, the script
											# can be run through cron as well.

# Email header
echo "*****************************************************************" > $mailcontents
echo "*   LOG CHECK - HOST: $HOSTNAME - DATE: $(date +'%A %B %d, %Y')   *" >> $mailcontents
echo "*****************************************************************" >> $mailcontents
echo "" >> $mailcontents
# End email header

while read line
do
	if [ ! -f $line ]; then
		echo "$line doesn't exist or is not a regular file. Continuing with the next file in the list..." >> $mailcontents
		echo "============" >> $mailcontents 
		continue
	else
		last_mod_time=$(stat -c '%Y' $line) # Check the log's last modification time and converts it to Unix epoch
		last_24_hours=$(date +%s -d "24 hours ago") # Return the epoch of (the current timestamp minus 24 hours)

		if [ $last_mod_time -lt $last_24_hours ]; then
			echo "$line has NOT been updated in the last 24 hours" >> $mailcontents
		else
			echo "$line was updated during the last 24 hours" >> $mailcontents
		fi
	
		tail -100 $line > checklog

		error=$(grep ERROR checklog | wc -l) # We look for the lines containing the word "ERROR" in the checklog file.
											 # Then we redirect the output to the wc -l command to count the number
											 # of lines where the word ERROR appears.
	
		if [ $error -gt 0 ]; then # If this condition is satisfied, that means the word ERROR appeared at least once in
								  # the log that's being examined in the current loop.
			echo "ERROR found in $line" >> $mailcontents
			echo -e "\t" $(grep ERROR checklog) >> $mailcontents
		else
			echo "No errors found in $line" >> $mailcontents
		fi
	fi
echo "============" >> $mailcontents
done < $loglist

# Email footer
echo "" >> $mailcontents
echo "This script was executed by $USER on $(date +'%A %B %d, %Y') at $(date +'%H:%M:%S')" >> $mailcontents
# End email footer

if [ -s $mailcontents ]; then
	mail -s "Errors and last modification times - $(date +'%A %B %d, %Y')" myemail@mydomain.com < $mailcontents
fi

rm $mailcontents checklog # Delete auxiliary files when we're done.

If you consider that your question has been answered, please mark this thread as SOLVED for the future reference of other users (Go to "Thread tools" and click on "Mark this thread as solved"), and please click on the "Thanks" link in the bottom right corner of this post.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

shell script not getting current error messages with time from alert.log

Hi All, I need to get current error messages with time from alert.log.Below is my shell script but it's not working to meet this objective. could anyone pls share on the above issue for resolution: #################################################################### ## ckalertlog.sh ##... (2 Replies)
Discussion started by: a1_win
2 Replies

2. Solaris

files updated in last 10 hours should be moved

Hi, I would like to move all files that are updated in last 10 hrs. to some temporary folder. Please help. (3 Replies)
Discussion started by: sanjay1979
3 Replies

3. UNIX for Dummies Questions & Answers

Execute crontab for every 4 hours and begin from current time

I want to add a crontab entry which should execute for every 4 hours and that 4 hours calculation should begin from the current time. Normally if I set the crontab entry like this, 00 */4 30 05 * root date >>/tmp/cronout The above will execute the date command for every 4 hours like... (7 Replies)
Discussion started by: Ganeshwari
7 Replies

4. Shell Programming and Scripting

How can view log messages between two time frame from /var/log/message or any type of log files

How can view log messages between two time frame from /var/log/message or any type of log files. when logfiles are very big and especially many messages with in few minutes, I would like to display log messages between 5 minute interval. Could you pls give me the command? (1 Reply)
Discussion started by: johnveslin
1 Replies

5. UNIX for Dummies Questions & Answers

Adding hours and minutes to current date (Only to date not to time)

Hi, I want to add some hours and minutes to the current date. For example, if the current date is "July 16, 2012 15:20", i want to add 5 hours 30 minutes to "July 16, 2012 00:00" not to "July 16, 2012 15:20". Please help. Thanks! (4 Replies)
Discussion started by: manojgarg
4 Replies

6. Homework & Coursework Questions

Sort current logged in users by log in time (supposedly to be very easy but I'm missing something)

1. The problem statement, all variables and given/known data: Show all users who are currently logged in, sorted from earliest to latest log in time. The log in time includes the month, day, and time. 2. Relevant commands, code, scripts, algorithms: finger, who, sort, pipe, head, tail, ... (8 Replies)
Discussion started by: vtmd
8 Replies

7. Shell Programming and Scripting

awk : Search for text between two time frame (12 hours)

I have created the script to grep the errors from weblogic logs files and redirecting output to file.txt ...From file.txt I'm using awk command to collect the past 20 mins output...The script running from cron every 15 mins... The script working well... Now the challenges, I'm trying to use... (27 Replies)
Discussion started by: zenkarthi
27 Replies

8. Shell Programming and Scripting

Search for logs traced between specific date and time from log file

HI, I want to search for a logs which are trace between specific date and time from logs file. My logs are generated like this :- Tue Jun 18 05:00:02 EEST 2013 | file_check.sh| Message:script has files to process. Thu Jun 20 05:00:02 EEST 2013 | file_check.sh| Message:script has files to... (5 Replies)
Discussion started by: ketanraut
5 Replies

9. Shell Programming and Scripting

Search the string in the active log and send mail

Hello, I wanted to search specific string in the acitve log file and send an email if the search string found in the log. Log file is written by application all the time. So, script has to search if any new log entry has the specific string for example " sample exception" and send an email. (1 Reply)
Discussion started by: balareddy
1 Replies

10. Shell Programming and Scripting

Log File updated time

hi can any one please help on below .im new to shell scrpting i need to write a shell script which will check particular log file is presented or not in specific location ,if yes how long it was not modified/not rolling ?if its not modified/log is not rolling script will have to send mail (9 Replies)
Discussion started by: 4Learning
9 Replies
All times are GMT -4. The time now is 11:53 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy