05-07-2011
script to constantly read the last 500 new logs in a log file
Hello,
I would like to write a bash script that would monitor a log file for a certain number of logs, let's say 500 logs and when it reaches that number to write the last log to another file. For example, I want to watch the /var/adm/messages and everytime, there is 500 new logs that are generated in this file to write the last log into a new file lik /var/tmp/tmp1.log. So, if the logs keep popping up in the /var/adm/message, for every 500 of them there will one instance in /var/tmp/tmp1.log. But, it has to monitor for new logs. Let's say the script already read 500 logs, the count has to be for new logs occurence all the time. It should not consider previous logs that could have been in the /var/adm/messages before that it might have already read. Please give me some ideas.
Thank you,
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I have a log file which is continuously added to, called log.file. I'd like to
monitor this file, and when certain lines are found, update some totals in
another file. I've played around with tail -f, grep, and awk, but can't seem
to hit the right note, so to speak.
The lines I'm... (0 Replies)
Discussion started by: nortonloaf
0 Replies
2. Shell Programming and Scripting
Hi,
I have gps receiver log..its giving readings .like below
Trying 127.0.0.1...
Connected to localhost.
Escape character is '^]'.
GPSD,R=1
$GPGSV,3,1,11,08,16,328,40,11,36,127,00,28,33,283,39,20,11,165,00*71... (3 Replies)
Discussion started by: gudivada213
3 Replies
3. Shell Programming and Scripting
What is wrong with my menu script? Do I need to continue with the read statements? All I want to do with option 4 is to cat some /var/log/files and awk out a few lines? How do I do that please?
$ cat menu.sh ... (11 Replies)
Discussion started by: taekwondo
11 Replies
4. Shell Programming and Scripting
Hi,
I am working on the script to parsing the specific message like "aaaa" in multiple log files like N1-***,N2-***,N3-***...
The script is to find the list of lof files which contains the message "aaaa" and export the list into excel filE.
Can anyone give help?
Thanks (2 Replies)
Discussion started by: shyork2001
2 Replies
5. Shell Programming and Scripting
Hi
I have a big log file
:08,936 DEBUG HttpConnectionManager.getConnection: config =
11:39:08,936 DEBUG Getting free connection,
11:39:08,989 DEBUG Freeing connection, hostConfig=HostConfiguration
11:39:08,989 DEBUG Notifying no-one, there are no waiting threads
11:39:09,046... (4 Replies)
Discussion started by: javaholics
4 Replies
6. Shell Programming and Scripting
Hello Team,
I need help to improve my script which is used to grep 500 error messages in the logs.
I am using following logic in the script to grep 500 error messages in the logs.
var1=`awk '$9 == "500"' access_log | tail -1`
The above logic is not useful if logs are not getting... (1 Reply)
Discussion started by: coolguyamy
1 Replies
7. UNIX for Advanced & Expert Users
Hi,
Im looking for a shell script which will search for a particular string in a log file as below scenario
1. I need to run URL http://localhost/client/update?feedid=200 in shell script at(eg)4:00 PM which will not take more than 15 mins to complete.
2. After 15 mins i need to... (6 Replies)
Discussion started by: Paulwintech
6 Replies
8. Shell Programming and Scripting
# cat /tmp/checkdate.log
SQL*Plus: Release 11.2.0.1.0 Production on Mon Sep 17 22:49:00 2012
Copyright (c) 1982, 2009, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - 64bit Production
FIRST_TIME NEXT_TIME... (1 Reply)
Discussion started by: SarwalR
1 Replies
9. Shell Programming and Scripting
Hi All,
I want to read the log file for last 30mins logs with time stamps.
Am using below command but, it is not working for me
awk -F - -vDT="$(date --date="30 minutes ago" "+%b %_d %H:%M:%S")" ' DT < $1' log.file >tmp.txt
log file time format is 2016-09-27 14:00:25,192
Use code... (1 Reply)
Discussion started by: Prashanth.K
1 Replies
10. Shell Programming and Scripting
United States 1.2.3.4 80 10 1563790914 1 1932454179 1.2.3.6 55517 11.1.2.1 55517
Italy 1.2.3.4 80 10 1563790914 1 1932454179 1.2.3.6 55517 11.1.2.1 55517
India 1.2.3.4 80 10 1563790914 1 1932454179 1.2.3.6 55517 11.1.2.1 55517
south Africa 1.2.3.4 80 10 1563790914 1... (9 Replies)
Discussion started by: arm
9 Replies
LEARN ABOUT DEBIAN
writetmp
WRITETMP(8) System Manager's Manual WRITETMP(8)
NAME
writetmp - write special wtmp entries to a wtmp file.
SYNOPSIS
writetmp [-w wtmp|-] [-X[3|4]] [-u user] [-l line] [-h host] [-i id] [-p pid] [-t type] [-c comment] [--help] [--version] [entry-type]
DESCRIPTION
Writetmp is a utility to write special entries to a wtmp file. Useful as either a replacement for the functionality of the "halt -w" or
"reboot -w" commands which are normally run at shutdown time or to write special wtmp entries to an alternate wtmp file to which such
entries would normally not be written.
Under normal conditions radius radtwmp or tacacs accounting logs do not contain shutdown and boottime entries because the access control
software is not setup to take into account these events. In the case of a quick shutdown or server crash, the wtmp file(s) will lose
coherency. To avoid or minimize the amount of accounting error, it is necessary to write shutdown and boottime entries to such logs.
Also changes in time which are made manually with date or via the network with a program such as rdate are not reflected in the accounting
logs, which, if the time difference is severe can improperly account time for logins active during the time change.
If an entry-type is specified on the command line, the -u, -l, -h, -i, -p, -t and -c options are ignored as writetmp will fill in the user-
name, line, id, and host entries as required for that particular wtmp entry-type.
Writetmp understands the following entry types:
shutdown
used just prior to a normal system shutdown. Also accepts halt or reboot as aliases for shutdown.
boottime
used at system initialization time, to indicate the system is booting.
oldtime
Indicates the time is about to change.
newtime
Indicates the time has changed. The difference in time is determined from the timestamp on the last oldtime entry.
runlevel
Indicates a change in runlevel (useless in an accounting sense).
OPTIONS
Writetmp understands the following command line switches:
--help Outputs a verbose usage listing.
--version
Displays the version of writetmp.
-w wtmp
Select a different output file instead of the default (/var/log/wtmp).
-X[3] Write to a wtmp file maintained by versions 3.3 or 3.4 Tacacs terminal server access control software.
-X4 Write to a wtmp file maintained by version 4.0 of Tacacs terminal server access control software.
-u user
Specify the username for the username field.
-l line
Specify the tty name for the line field.
-h host
Specify the hostname.
-i id Specify the init id name. Not applicable to tacacs wtmp files.
-p pid Specify the pid number. Not appliccable to tacacs wtmp files.
-t type
Specify the type of wtmp entry for the ut_type field, not to be confused with entry-type. May be coded as a number or one of:
unknown, runlevel, boottime, newtime, oldtime, init, login, user or dead.
-c comment
Specify the comment for the tacacs 4 wtmp comment field (16 characters max).
EXAMPLES
Write a shutdown message to an alternate wtmp log:
writetmp -w /var/adm/xtmp shutdown
A shell script to update the time in an alternate wtmp file when netdate is run:
#!/bin/sh
writetmp -w /var/adm/xtmp oldtime
netdate clock.llnl.gov
writetmp -w /var/adm/xtmp newtime
Find out how often and for how long people run a specific program, such as pine:
#!/bin/sh
# /var/adm/cmdtmp must be globally writable.
cmdtmp=/var/adm/cmdtmp
writetmp -w $cmdtmp -u pine -l cmd$$ -h $USER -t user
/path/to/real-pine $*
writetmp -w $cmdtmp -l cmd$$ -t dead
FILES
/var/log/wtmp login database.
AUTHOR
Steve Baker (ice@mama.indstate.edu)
BUGS
Does not lock the wtmp file and does not guarantee a successful write. Could in theory corrupt a log file.
Rdate and netdate can take seconds to complete, so writing oldtime/newtime records around them may not be entirely accurate.
SEE ALSO
date(1), last(1), sac(8), netdate(8L), reboot(8)
UNIX Manual WRITETMP(8)