If the logs are very big it may be a good trick to read them backwards, because maybe the interesting part is more likely at the end of the file, so we maybe save to read tons of old lines that way:
Code:
#!/bin/sh
logfile="$3"
# reverse at the beginning to read from end to start
tac "$logfile" | awk -vstart="$1" -vend="$2" '
BEGIN {
start_epoch = mktime(start)
end_epoch = mktime(end)
}
function monthnumber(monthname) {
return sprintf("%02d\n",(match("JanFebMarAprMayJunJulAugSepOctNovDec",monthname)+2))/3
}
match($0,/^([0-9]+)\/([a-zA-Z]+)\/([0-9]{4}):([0-9]{2}):([0-9]{2}):([0-9]{2})/,r) {
current=mktime( sprintf("%s %s %s %s %s %s", r[3],monthnumber(r[2]),r[1],r[4],r[5],r[6])); }
match($0,/^[a-zA-Z]+ ([a-zA-Z]+) ([0-9]+) ([0-9]+):([0-9]+):([0-9]+) ([0-9]{4})/,r) {
current=mktime( sprintf("%s %s %s %s %s %s", r[6],monthnumber(r[1]),r[2],r[3],r[4],r[5])); }
match($0,/^([0-9]+)-([a-zA-Z]+) ([0-9]+):([0-9]+):([0-9]+)/,r) {
current=mktime( sprintf("%s %s %s %s %s %s", strftime("%Y"),monthnumber(r[2]),r[1],r[3],r[4],r[5])); }
# we have to swap the actions here!
(current < start_epoch) { exit }
(current > end_epoch ) { next }
1
' | tac # and reverse again at the end to return to chronological order
Hi,
I'm trying to accomplish the following and would like some suggestions or possible bash script examples that may work
I have a directory that has a list of log files that's periodically dumped from a script that is crontab that are rotated 4 generations. There will be a time stamp that is... (4 Replies)
Hi,
Is it possible to set the two time formats in a single machine. My machine time is in EST and the logs are in PST. What would be the issue, and how to make change of this.? (5 Replies)
Hi there, am trying to parse an Apache 'server' config file. A snippet of the config file is shown below:
.....
ProxyPassReverse /foo http://foo.example.com/bar
.....
.....
RewriteRule ^/(.*) http://www.example.com/$1
RewriteRule /redirect https://www.example1.com/$1
........ (7 Replies)
Hello,
I have a log file for the year, which contains lines starting with the data in the format of YYYY-MM-DD. I need to get all the lines that contain the DD being 04, how would I do this? I tried using grep "*-*04" but it didn't work.
Any quick one liners I should know about?
Thank you. (2 Replies)
I was looking at this script which outputs the two lines which differs less than one sec.
#!/usr/bin/perl -w
use strict;
use warnings;
use Time::Local;
use constant SEC_MILIC => 1000;
my $file='infile';
## Open for reading argument file.
open my $fh, "<", $file or die "Cannot... (1 Reply)
Greetings
I have a file formatted like this:
rhino grey weight=1003;height=231;class=heaviest;histology=9,0,0,8
bird white weight=23;height=88;class=light;histology=7,5,1,0,0
turtle green weight=40;height=9;class=light;histology=6,0,2,0... (2 Replies)
Hello All,
Below is the excerpt from my Informatica log file which has 4 blocks of lines (starting with WRITER_1_*_1). Like these my log file will have multiple blocks of same pattern.
WRITER_1_*_1> WRT_8161
TARGET BASED COMMIT POINT Thu May 08 09:33:21 2014... (13 Replies)
I am developing one script which will take log file name, output file name, date, hour and minute as an argument and based on these inputs, the script will scan and capture all the error(s) that have been triggered from a given time. Example: script should capture all the error after 13:50 on Jan... (2 Replies)
I am trying to do a comparison of files based on their last modified date.
I am pulling the first file from a webapp folder using curl.
curl --silent -I http://localhost:8023/conf/log4j2.xml | grep Last
Last-Modified: Tue, 22 Mar 2016 22:02:18 GMT
The second file is on local disk.
stat... (2 Replies)
The below perl script parses a variety of formats. If I use the numeric text file as input the script works correctly. However using the alpha text file as input there is a black output file. The portion in bold splits the field to parse f or NC_000023.10:g.153297761C>A into a variable $common but... (3 Replies)
Discussion started by: cmccabe
3 Replies
LEARN ABOUT DEBIAN
mencal
mencal(1) 1 mencal(1)NAME
mencal - menstruation calendar
SYNOPSIS
mencal [options] [file1 file2 ... -c CONF1 -c CONF2 ...]
DESCRIPTION
Display options:
-m, --monday
draw monday as first weekday (sunday is default)
-1 current month (default)
-3 previous, current and next month
-y [YYYY]
all-year calendar (default YYYY is current year)
-q, --quiet
no top information will be printed
-n, --nocolor
noncolored output
-i, --icolor COLOR
intersection color (default red)
available colors: red, green, blue, yellow, violet, cyan, shiny, bold
mencal configuration:
-c, --config
s=[YYYY]MMDD,l=LL,d=DD,n=NAME,f=FILE,c=COLOR
The second argument is a comma separated list of options. No spaces are allowed in this list. If no name is specified, 'Unknown' is
used. Various -c options or filenames can be set.
s,start=[YYYY]MMDD
start day of period (default current day)
l,length=LL
length of period in days (default 28)
d,duration=D
duration of menstruation in days (default 4)
n,name=NAME
name of subject
f,file=FILE
filename to save configuration to (see section FILES)
only menstruation related variables will be saved
c,color=COLOR
color used for menstruation days
available colors: red, green, blue, yellow, violet, cyan, shiny, bold default color is red, with '-n' switch color settings are
ignored
Info options:
-h, --help
print help
-V, --version
print version information
FILES :
$HOME/.mencalrc - the default configuration file that is automatically loaded
AUTHOR :
(C) 2002 C. McCohy
e-mail: <mccohy@kyberdigi.cz>
Word-Wide-Web: http://www.kyberdigi.cz/projects/mencal/english
This manual page was written for the Debian GNU/Linux distribution because the original program does not have a manual page (but may be
used by others).
HISTORY
22 March 2002 - Originally written by Amaya Rodrigo <amaya@debian.org>.
24 Apr 2002 - New manpage contributed by Pablo S. Torralba <psanchez@skyrealms.org>.
Amaya Rodrigo <amaya@debian.org> is now responsible for developing and maintaining this manual page. Comments and suggestions are greatly
wellcome.
mencal Menstruation calendar mencal(1)