Sponsored Content
Top Forums Shell Programming and Scripting Take minute per minute from a log awk Post 302626907 by Corona688 on Friday 20th of April 2012 01:26:24 AM
Old 04-20-2012
To keep the forums high quality for all users, please take the time to format your posts correctly.

First of all, use Code Tags when you post any code or data samples so others can easily read your code. You can easily do this by highlighting your code and then clicking on the # in the editing menu. (You can also type code tags [code] and [/code] by hand.)



Second, avoid adding color or different fonts and font size to your posts. Selective use of color to highlight a single word or phrase can be useful at times, but using color, in general, makes the forums harder to read, especially bright colors like red.

Third, be careful when you cut-and-paste, edit any odd characters and make sure all links are working property.

Thank You.

The UNIX and Linux Forums
 

10 More Discussions You Might Find Interesting

1. Programming

linux 7.1 goes off every other minute

i have loaded linux 7.1 on my PC along with win98 the problem is that every other minute th system goes off please help me (1 Reply)
Discussion started by: vidya_harnal
1 Replies

2. Programming

how can i run a process for a whole minute?

here's the problem, i have two processes that i need to run and both process should be run at a total of 1 minute each. how do i do that? and one more here's what the processes do: the 1st process show the '+" sign infinitely while the 2nd process displays the "-" infinitely. how could i count the... (1 Reply)
Discussion started by: kelogs1347
1 Replies

3. Shell Programming and Scripting

scripting running every minute

Hi Experts, below similar thread i posted earlier. Although i wish to know ur suggestion newly. I want to run a script every 1 minute. I tried with Crontab. But the problem is cron send every 1 mins invertal- mail to the user mailbox. meanwhile, some expert telling me it is not wise to... (15 Replies)
Discussion started by: thepurple
15 Replies

4. Shell Programming and Scripting

How do i get only last 5 minute worth of data

I have a text file called 'tomcat_temp_out'. I want to get only last 5 minute worth of data from this file and redirect those data into another fule. Could you please help to work on this? (2 Replies)
Discussion started by: shivanete
2 Replies

5. Shell Programming and Scripting

Crontab for every minute or every hour

How to set crontab for every minute or every hour (1 Reply)
Discussion started by: kaushik02018
1 Replies

6. Shell Programming and Scripting

Process file every minute

Hey guy's, How can I schedule this script using AWK, what I require is it runs every minute as new data will be added to the file? And I need to capture these data and save it to the output file. I tried using sleep 1 to allow the file to be processed but is not working. awk ' ... (35 Replies)
Discussion started by: James_Owen
35 Replies

7. Shell Programming and Scripting

Count of matched pattern occurences by minute and date in a log file

Anyone knows how to use AWK to achieve the following Sun Feb 12 00:41:01-00:41:59 Success:2 Fail:2 Sun Feb 12 00:42:01-00:42:59 Success:1 Fail:2 Sun Feb 12 01:20:01-01:20:59 Success:1 Fail:2 Mon Feb 13 22:41:01-22:41:59 Success:1 Fail:1 log file: Success Success Fail Fail ... (9 Replies)
Discussion started by: timmywong
9 Replies

8. Shell Programming and Scripting

Check log file size every 10 minute. Alert if log not update

How to check log size every 10min. by script (can use crontab) if log size not change with alert "Log not update" Base run on SunOS 5.8 Generic_Virtual sun4u sparc SUNW,SPARC-Enterprise logFiles="log1.log log2.log" logLocation="/usr/home/test/log/" Out put. Tue Jan 31... (3 Replies)
Discussion started by: ooilinlove
3 Replies

9. Shell Programming and Scripting

[solved] Awk/shell question to parse hour minute from text

Hi, I have a quick question on parsing the hour/minute and value from a text file and remove the seconds portion. For example in the below text file: 20:26:01 95.83 20:27:01 96.06 20:28:01 95.99 20:29:01 7.11 20:30:01 5.16 20:31:01 8.27 20:32:02 9.79 20:33:01 11.27 20:34:01 7.83... (2 Replies)
Discussion started by: satishrao
2 Replies

10. Shell Programming and Scripting

Minute(4) issue in teradata

I have values below for which diff field is giving error like "invalid time interval" in teradata Might be it is not doing calculation anymore after exceeding minute(4) value END_TS 2/2/2018 08:50:49.000000 START_TS 1/5/2018 17:30:02.000000 SLA_TIME 23:59:59.000000 select... (0 Replies)
Discussion started by: himanshupant
0 Replies
QSLOG(1)							  qslog man page							  QSLOG(1)

NAME
qslog - collects request statistics from access log data. SYNOPSIS
qslog -f <format_string> -o <out_file> [-p [-v]] [-x] [-u <name>] [-m] [-c <path>] DESCRIPTION
qslog is a real time access log analyzer. It collects the data from stdin. The output is written to the specified file every minute and includes the following entries: - requests per second (r/s) - requests within the last minute (req) - bytes sent to the client per second (b/s) - bytes received from the client per second (ib/s) - repsonse status codes within the last minute (1xx,2xx,3xx,4xx,5xx) - average response duration (av) - average response duration in milliseconds (avms) - distribution of response durations within the last minute (<1s,1s,2s,3s,4s,5s,>5) - number of established (new) connections within the last minutes (esco) - average system load (sl) - free memory (m) (not available for all platforms) - number of client ip addresses seen withn the last 600 seconds (ip) - number of different users seen withn the last 600 seconds (usr) - number of mod_qos events within the last minute (qV=create session, qS=session pass, qD=access denied, qK=connection closed, qT=dynamic keep-alive, qL=request/response slow down, qs=serialized request) OPTIONS
-f <format_string> Defines the log data format and the positions of data elements processed by this utility. See to the 'LogFormat' directive of the httpd.conf file to see the format defintions of the servers access log data. qslog knows the following elements: I defines the client ip address (%h) R defines the request line (%r) S defines HTTP response status code (%s) B defines the transferred bytes (%b or %O) i defines the received bytes (%I) T defines the request duration (%T) t defines the request duration in milliseconds (may be used instead of T) D defines the request duration in microseconds (may be used instead of T) (%D) k defines the number of keepalive requests on the connection (%k) U defines the user tracking id (%{mod_qos_user_id}e) Q defines the mod_qos_ev event message (%{mod_qos_ev}e) C defines the element for the detailed log (-c option), e.g. "%U" . defines an element to ignore (unknown string) -o <out_file> Specifies the file to store the output to. -p Used for post processing when reading the log data from a file (cat/pipe). qslog is started using it's offline mode in order to process existing log files (post processing). The option "-pc" may be used alternatively if you want to gather request information per client (identified by IP address (I) or user tracking id (U) showing how many request each client has performed within the cap- tured period of time). -v Verbose mode. -x Rotates the output file once a day (move). -u <name> Become another user, e.g. www-data. -m Calculates free system memory every minute. -c <path> Enables the collection of log statitics for different request types. 'path' specifies the necessary rule file. Each rule consists of a rule identifier and a regular expression to identify a request seprarated by a colon, e.g., 01:^(/a)|(/c). The regular expressions are matched against the log data element which has been identified by the 'C' format character. EXAMPLE
Configuration using pipped logging: LogFormat "%t %h "%r" %>s %b "%{User-Agent}i" %T" TransferLog "|./bin/qslog -f ..IRSB.T -x -o ./logs/stat_log" Configuration using the CustomLog directive: CustomLog "|./bin/qslog -f ISBTQ -x -o ./logs/stat_log" "%h %>s %b %T %{mod_qos_ev}e" Post processing: cat access_log | ./bin/qslog -f ..IRSB.T -o ./logs/stat_log -p SEE ALSO
qsexec(1), qsfilter2(1), qsgeo(1), qsgrep(1), qslogger(1), qspng(1), qsrotate(1), qssign(1), qstail(1) AUTHOR
Pascal Buchbinder, http://opensource.adnovum.ch/mod_qos/ mod_qos utilities 10.8 June 2012 QSLOG(1)
All times are GMT -4. The time now is 09:06 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy