Sponsored Content
Top Forums Shell Programming and Scripting Pattern count on rotating logs for the past 1 Hr Post 302631321 by jim mcnamara on Friday 27th of April 2012 08:01:11 AM
Old 04-27-2012
Each line in the logs has a timestamp?

Otherwise you cannot be precise about where in a log file to start your search. Example: Suppose a log file has a ctime of 65 minutes ago (ctime is as close as you can get to a create time for files in UNIX). The mtime (last time of write) is 45 minutes ago. So where in the file is 5 minutes into the log? You have to guess without some other guidance.

Please show sample log file entries and an example pattern. What OS and shell (bash, ksh, etc.)?
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

nawk-how count the number of occurances of a pattern, when don't know the pattern

I've written a script to count the total size of SAN storage LUNs, and also display the LUN sizes. From server to server, the LUNs sizes differ. What I want to do is count the occurances as they occur and change. These are the LUN sizes: 49.95 49.95 49.95 49.95 49.95 49.95 49.95 49.95... (2 Replies)
Discussion started by: cyber111
2 Replies

2. Shell Programming and Scripting

To find out the logs count

Hi, I am using the below command to find out the mail logs which will grep the repeated message ids: less /var/log/messages |awk '{print +$6}'| sort | uniq -c | sort -nr OUTPUT: 506 1246382279 404 1246373467 303 1246383457 303 1246382268 300 1246379705 202... (7 Replies)
Discussion started by: gsiva
7 Replies

3. Shell Programming and Scripting

Rotating logs in Perl without message loss

(I'm aware log rotation is a common subject, but I tried searching and couldn't find an answer) For some time now, I've been using the Logfile::Rotate module to rotate logs in a log-monitoring script. So far, I haven't experienced any problems, and it works great because I can use it in Linux... (1 Reply)
Discussion started by: w1r3d
1 Replies

4. Shell Programming and Scripting

Count the number of occurrences of a pattern between each occurrence of a different pattern

I need to count the number of occurrences of a pattern, say 'key', between each occurrence of a different pattern, say 'lu'. Here's a portion of the text I'm trying to parse: lu S1234L_149_m1_vg.6, part-att 1, vdp-att 1 p-reserver IID 0xdb registrations: key 4156 4353 0000 0000 ... (3 Replies)
Discussion started by: slipstream
3 Replies

5. Shell Programming and Scripting

Grep string from logs of last 1 hour on files of 2 different servers and calculate count

Hi, I am trying to grep a particular string from the files of 2 different servers without copying and calculate the total count of its occurence on both files. File structure is same on both servers and for reference as follows: 27-Aug-2010... (4 Replies)
Discussion started by: poweroflinux
4 Replies

6. Shell Programming and Scripting

Count number of errors within logs for last 6 months

I have directory /test/logs which has multiple logs: audit.log audit.log.1 audit.log.2 audit.log.3 audit.log.4 audit.log.5 audit.log is current log file and audit.log.X are archive log files. I need to search within these log files and count word "error-5" logged within last 6 months... (4 Replies)
Discussion started by: djanu
4 Replies

7. Shell Programming and Scripting

Search for a pattern in a String file and count the occurance of each pattern

I am trying to search a file for a patterns ERR- in a file and return a count for each of the error reported Input file is a free flowing file without any format example of output ERR-00001=5 .... ERR-01010=10 ..... ERR-99999=10 (4 Replies)
Discussion started by: swayam123
4 Replies

8. Shell Programming and Scripting

Grep a pattern in current date logs

Hello, I need to write one script which should search particular pattern like ABCD in log file name hello.txt only in current date logs. in current directory i have so many past date logs but grep should be applied on current date logs. on daily basis current date logs are in number 30 and... (2 Replies)
Discussion started by: ajju
2 Replies

9. Shell Programming and Scripting

Identify file pattern, take count of pattern, then act

Guys - Need your ideas on a section of code to finish something up. To make a long story short, I'm parsing a print output file that goes to pre-printed forms. I'm intercepting it, parsing it, formatting it, cutting it up into individual pages, grabbing the text I want in zones, building an... (3 Replies)
Discussion started by: ampsys
3 Replies

10. UNIX for Beginners Questions & Answers

How to count respon time max min avg for nginx logs?

Hi All, need your help, i want count respon time max and average my nginx logs, based on hourly or minutes per api... my nginx.log sample : 10.1.1.1 - - "POST /v2/api/find/outlet/ HTTP/1.1" 200 2667 "-" "okhttp/3.12.0" "118.215.153.47" 0.178 0.178 . 10.1.1.1 - - "POST... (4 Replies)
Discussion started by: fajar_3t3
4 Replies
shutdown(8)						      System Manager's Manual						       shutdown(8)

Name
       shutdown - close down the system at a given time

Syntax
       /etc/shutdown [ -k ] [ -r ] [ -h ] [ -o ] time [ warning-message ... ]

Description
       The command provides an automated shutdown procedure that a superuser can use to notify users when the system is shutting down.

       The  time is the time at which will bring the system down.  It may be the word `now', indicating an immediate shutdown, or specify a future
       time in one of two formats: + number or hour : min.  The first form brings the system down in number minutes.  The second brings the system
       down at the time of day indicated, using a 24-hour clock format.

       At intervals which get shorter as shutdown nears, warning messages are displayed at the terminals of all users on the system.  Warning mes-
       sages are also sent to users who are logged in to a remote system that has mounted a file system or directory from the local  system  using
       NFS.   Five  minutes  before  shutdown, or immediately if shutdown is timed for less than five minutes, logins are disabled by creating and
       writing a message there.  If this file exists when a user attempts to log in, prints its contents and exits.   The  file  is  removed  just
       before exits.

       At  shutdown  time, a message is written in the file This message contains the time of shutdown, who ran shutdown, and the reason.  Then, a
       terminate signal is sent at to bring the system to single-user state.

       If the or options are used, then executes or avoids shutting the system down (respectively).  The option is for use by only.  It  indicates
       to that it is being called by and not to return to the user.

       You should place the time of the shutdown and the warning message in Use the message to inform the users about when the system will be back
       up and why it is going down.

Restrictions
       You can kill the system only between now and 23:59, if you use the absolute time for shutdown.

Files
       Tells login not to let anyone log in

       Log file for successful shutdowns

See Also
       login(1), wall(1), halt(8), opser(8), reboot(8), rwalld(8c)

																       shutdown(8)
All times are GMT -4. The time now is 09:36 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy