Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Extract data from log file within specified time
Top Forums Shell Programming and Scripting Extract data from log file within specified time Post 302921034 by Corona688 on Tuesday 14th of October 2014 11:41:24 AM
Old 10-14-2014
All those cats are completely useless, see useless use of cat award. They are particularly harmful on Windows, whose scheduler deals badly with too many short-lived programs.

If you rearrange your dates into YYYY/MM/DD HH:MM:SS order they easily compare alphabetically, which is why the rest of the world has converted to this order. You can do this rearranging inside awk, though a lookup table of month names is needed.

Code:
awk -F"[ \t/:\\\[\\\]]+" 'BEGIN { split("Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec", A); for(X in A) M[A[X]]=sprintf("%02d", X) }
# Create timestamp in YYYY/MM/DD:HH:MM:SS so it can be compared to TSTART and TEND, which controls printing of lines
{ T=$6"/"M[$5]"/"$4":"$7":"$8":"$9 } (T >= TSTART) && (T <= TEND)' TSTART="2003/01/01:12:55:20" TEND="2003/01/01:12:55:20" inputfile

If awk doesn't work, try gawk or nawk.
Last edited by Corona688; 10-14-2014 at 12:54 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

shell-script which extract data from log file

give me a shell-script which extract data from log file on a server by giving date and time as input (for both start time and end time) and it will give the logs generated during the given time as output. (4 Replies)
Discussion started by: abhishek27
4 Replies

2. Shell Programming and Scripting

Extract data from log file from or after the specific date

Hi , I am having a script which will start a process and appends the process related logs to a log file. The log file writes logs with every line starting with date in the format of: date +"%Y %b %d %H:%M:%S". So, in the script, before I start the process, I am storing the date as DATE=`date +"%Y... (5 Replies)
Discussion started by: chiru_h
5 Replies

3. Shell Programming and Scripting

how to make a log file of extract time

Dear All, Please apology to me if this question already posted, because I try to find it but not found. I have make bash script to automatically download data from ftp and this running very well. and after the data downloaded it will automatically extract the data and keep in the specific... (2 Replies)
Discussion started by: chenboly
2 Replies

4. Shell Programming and Scripting

Extract info from log file and compute using time date stamp

Looking for a shell script or a simple perl script . I am new to scripting and not very good at it . I have 2 directories . One of them holds a text file with list of files in it and the second one is a daily log which shows the file completion time. I need to co-relate both and make a report. ... (0 Replies)
Discussion started by: breez_drew
0 Replies

5. Shell Programming and Scripting

need a shell script to extract data from a log file.

If I have a log like : Mon Jul 19 05:07:34 2010; TCP; eth3; 52 bytes; from abc to def Mon Jul 19 05:07:35 2010; UDP; eth3; 46 bytes; from aaa to bbb Mon Jul 19 05:07:35 2010; TCP; eth3; 52 bytes; from def to ghi I will need an output like this : Time abc to def... (1 Reply)
Discussion started by: hitha87
1 Replies

6. Shell Programming and Scripting

Data Extract from XML Log File

Please help me out to extract the Data from the XML Log files. So here is the data ERROR|2010-08-26 00:05:52,958|SERIAL_ID=128279996|ST=2010-08-2600:05:52|DEVICE=113.2.21.12:601|TYPE=TransactionLog... (9 Replies)
Discussion started by: raghunsi
9 Replies

7. Shell Programming and Scripting

Extract data from log file in specified range of time

I was searching for parsing a log file and found what I need in this link http://stackoverflow.com/questions/7575267/extract-data-from-log-file-in-specified-range-of-time But the most useful answer (posted by @Kent): # this variable you could customize, important is convert to seconds. # e.g... (2 Replies)
Discussion started by: kingk110
2 Replies

8. UNIX for Dummies Questions & Answers

Extract date ranged data from log file

Hi, I am trying to extract lines of data within a log file on a Redhat 5 Linux system. eg I need all the lines with a particular username over the last 3 minutes. the log file may read like this, and I want a way to search all the lines extracting all the relevant lines over the last 3... (2 Replies)
Discussion started by: mantis100
2 Replies

9. Shell Programming and Scripting

Archiving or removing few data from log file in real time

Hi, I have a log file that gets updated every second. Currently the size has grown to 20+ GB. I need to have a command/script, that will try to get the actual size of the file and will remove 50% of the data that are in the log file. I don't mind removing the data as the size has grown to huge... (8 Replies)
Discussion started by: Souvik Patra
8 Replies

10. Shell Programming and Scripting

Extract data from a log file and put it in a file

Hi, I would like to seek your help for a script that will extract data from log file and put it in a file. Sample log file 2018-10-23 12:33:21 AI ERROR -- tpid: SAMPLE_TH account: 123456789 aiSessionNumber: 660640464 mapName: xxx to yyy errorDesc: Translation Error:ErrorNumber : 993 ... (2 Replies)
Discussion started by: neverwinter112
2 Replies

LEARN ABOUT OSX

datetime::locale::en_be

DateTime::Locale::en_BE(3)				User Contributed Perl Documentation				DateTime::Locale::en_BE(3)

NAME

       DateTime::Locale::en_BE

SYNOPSIS

	 use DateTime;

	 my $dt = DateTime->now( locale => 'en_BE' );
	 print $dt->month_name();

DESCRIPTION

       This is the DateTime locale package for English Belgium.

DATA

       This locale inherits from the DateTime::Locale::en locale.

       It contains the following data.

   Days
       Wide (format)

	 Monday
	 Tuesday
	 Wednesday
	 Thursday
	 Friday
	 Saturday
	 Sunday

       Abbreviated (format)

	 Mon
	 Tue
	 Wed
	 Thu
	 Fri
	 Sat
	 Sun

       Narrow (format)

	 M
	 T
	 W
	 T
	 F
	 S
	 S

       Wide (stand-alone)

	 Monday
	 Tuesday
	 Wednesday
	 Thursday
	 Friday
	 Saturday
	 Sunday

       Abbreviated (stand-alone)

	 Mon
	 Tue
	 Wed
	 Thu
	 Fri
	 Sat
	 Sun

       Narrow (stand-alone)

	 M
	 T
	 W
	 T
	 F
	 S
	 S

   Months
       Wide (format)

	 January
	 February
	 March
	 April
	 May
	 June
	 July
	 August
	 September
	 October
	 November
	 December

       Abbreviated (format)

	 Jan
	 Feb
	 Mar
	 Apr
	 May
	 Jun
	 Jul
	 Aug
	 Sep
	 Oct
	 Nov
	 Dec

       Narrow (format)

	 J
	 F
	 M
	 A
	 M
	 J
	 J
	 A
	 S
	 O
	 N
	 D

       Wide (stand-alone)

	 January
	 February
	 March
	 April
	 May
	 June
	 July
	 August
	 September
	 October
	 November
	 December

       Abbreviated (stand-alone)

	 Jan
	 Feb
	 Mar
	 Apr
	 May
	 Jun
	 Jul
	 Aug
	 Sep
	 Oct
	 Nov
	 Dec

       Narrow (stand-alone)

	 J
	 F
	 M
	 A
	 M
	 J
	 J
	 A
	 S
	 O
	 N
	 D

   Quarters
       Wide (format)

	 1st quarter
	 2nd quarter
	 3rd quarter
	 4th quarter

       Abbreviated (format)

	 Q1
	 Q2
	 Q3
	 Q4

       Narrow (format)

	 1
	 2
	 3
	 4

       Wide (stand-alone)

	 1st quarter
	 2nd quarter
	 3rd quarter
	 4th quarter

       Abbreviated (stand-alone)

	 Q1
	 Q2
	 Q3
	 Q4

       Narrow (stand-alone)

	 1
	 2
	 3
	 4

   Eras
       Wide

	 Before Christ
	 Anno Domini

       Abbreviated

	 BC
	 AD

       Narrow

	 B
	 A

   Date Formats
       Full

	  2008-02-05T18:30:30 = Tuesday 5 February 2008
	  1995-12-22T09:05:02 = Friday 22 December 1995
	 -0010-09-15T04:44:23 = Saturday 15 September -10

       Long

	  2008-02-05T18:30:30 = 5 Feb 2008
	  1995-12-22T09:05:02 = 22 Dec 1995
	 -0010-09-15T04:44:23 = 15 Sep -10

       Medium

	  2008-02-05T18:30:30 = 05 Feb 2008
	  1995-12-22T09:05:02 = 22 Dec 1995
	 -0010-09-15T04:44:23 = 15 Sep -10

       Short

	  2008-02-05T18:30:30 = 05/02/08
	  1995-12-22T09:05:02 = 22/12/95
	 -0010-09-15T04:44:23 = 15/09/-10

       Default

	  2008-02-05T18:30:30 = 05 Feb 2008
	  1995-12-22T09:05:02 = 22 Dec 1995
	 -0010-09-15T04:44:23 = 15 Sep -10

   Time Formats
       Full

	  2008-02-05T18:30:30 = 18 h 30 min 30 s UTC
	  1995-12-22T09:05:02 = 09 h 05 min 02 s UTC
	 -0010-09-15T04:44:23 = 04 h 44 min 23 s UTC

       Long

	  2008-02-05T18:30:30 = 18:30:30 UTC
	  1995-12-22T09:05:02 = 09:05:02 UTC
	 -0010-09-15T04:44:23 = 04:44:23 UTC

       Medium

	  2008-02-05T18:30:30 = 18:30:30
	  1995-12-22T09:05:02 = 09:05:02
	 -0010-09-15T04:44:23 = 04:44:23

       Short

	  2008-02-05T18:30:30 = 18:30
	  1995-12-22T09:05:02 = 09:05
	 -0010-09-15T04:44:23 = 04:44

       Default

	  2008-02-05T18:30:30 = 18:30:30
	  1995-12-22T09:05:02 = 09:05:02
	 -0010-09-15T04:44:23 = 04:44:23

   Datetime Formats
       Full

	  2008-02-05T18:30:30 = Tuesday 5 February 2008 18 h 30 min 30 s UTC
	  1995-12-22T09:05:02 = Friday 22 December 1995 09 h 05 min 02 s UTC
	 -0010-09-15T04:44:23 = Saturday 15 September -10 04 h 44 min 23 s UTC

       Long

	  2008-02-05T18:30:30 = 5 Feb 2008 18:30:30 UTC
	  1995-12-22T09:05:02 = 22 Dec 1995 09:05:02 UTC
	 -0010-09-15T04:44:23 = 15 Sep -10 04:44:23 UTC

       Medium

	  2008-02-05T18:30:30 = 05 Feb 2008 18:30:30
	  1995-12-22T09:05:02 = 22 Dec 1995 09:05:02
	 -0010-09-15T04:44:23 = 15 Sep -10 04:44:23

       Short

	  2008-02-05T18:30:30 = 05/02/08 18:30
	  1995-12-22T09:05:02 = 22/12/95 09:05
	 -0010-09-15T04:44:23 = 15/09/-10 04:44

       Default

	  2008-02-05T18:30:30 = 05 Feb 2008 18:30:30
	  1995-12-22T09:05:02 = 22 Dec 1995 09:05:02
	 -0010-09-15T04:44:23 = 15 Sep -10 04:44:23

   Available Formats
       d (d)

	  2008-02-05T18:30:30 = 5
	  1995-12-22T09:05:02 = 22
	 -0010-09-15T04:44:23 = 15

       EEEd (d EEE)

	  2008-02-05T18:30:30 = 5 Tue
	  1995-12-22T09:05:02 = 22 Fri
	 -0010-09-15T04:44:23 = 15 Sat

       Hm (H:mm)

	  2008-02-05T18:30:30 = 18:30
	  1995-12-22T09:05:02 = 9:05
	 -0010-09-15T04:44:23 = 4:44

       hm (h:mm a)

	  2008-02-05T18:30:30 = 6:30 PM
	  1995-12-22T09:05:02 = 9:05 AM
	 -0010-09-15T04:44:23 = 4:44 AM

       Hms (H:mm:ss)

	  2008-02-05T18:30:30 = 18:30:30
	  1995-12-22T09:05:02 = 9:05:02
	 -0010-09-15T04:44:23 = 4:44:23

       hms (h:mm:ss a)

	  2008-02-05T18:30:30 = 6:30:30 PM
	  1995-12-22T09:05:02 = 9:05:02 AM
	 -0010-09-15T04:44:23 = 4:44:23 AM

       M (L)

	  2008-02-05T18:30:30 = 2
	  1995-12-22T09:05:02 = 12
	 -0010-09-15T04:44:23 = 9

       Md (M/d)

	  2008-02-05T18:30:30 = 2/5
	  1995-12-22T09:05:02 = 12/22
	 -0010-09-15T04:44:23 = 9/15

       MEd (E, M/d)

	  2008-02-05T18:30:30 = Tue, 2/5
	  1995-12-22T09:05:02 = Fri, 12/22
	 -0010-09-15T04:44:23 = Sat, 9/15

       MMdd (dd/MM)

	  2008-02-05T18:30:30 = 05/02
	  1995-12-22T09:05:02 = 22/12
	 -0010-09-15T04:44:23 = 15/09

       MMM (LLL)

	  2008-02-05T18:30:30 = Feb
	  1995-12-22T09:05:02 = Dec
	 -0010-09-15T04:44:23 = Sep

       MMMd (MMM d)

	  2008-02-05T18:30:30 = Feb 5
	  1995-12-22T09:05:02 = Dec 22
	 -0010-09-15T04:44:23 = Sep 15

       MMMEd (E, MMM d)

	  2008-02-05T18:30:30 = Tue, Feb 5
	  1995-12-22T09:05:02 = Fri, Dec 22
	 -0010-09-15T04:44:23 = Sat, Sep 15

       MMMMd (MMMM d)

	  2008-02-05T18:30:30 = February 5
	  1995-12-22T09:05:02 = December 22
	 -0010-09-15T04:44:23 = September 15

       MMMMEd (E, MMMM d)

	  2008-02-05T18:30:30 = Tue, February 5
	  1995-12-22T09:05:02 = Fri, December 22
	 -0010-09-15T04:44:23 = Sat, September 15

       ms (mm:ss)

	  2008-02-05T18:30:30 = 30:30
	  1995-12-22T09:05:02 = 05:02
	 -0010-09-15T04:44:23 = 44:23

       y (y)

	  2008-02-05T18:30:30 = 2008
	  1995-12-22T09:05:02 = 1995
	 -0010-09-15T04:44:23 = -10

       yM (M/yyyy)

	  2008-02-05T18:30:30 = 2/2008
	  1995-12-22T09:05:02 = 12/1995
	 -0010-09-15T04:44:23 = 9/-010

       yMEd (EEE, M/d/yyyy)

	  2008-02-05T18:30:30 = Tue, 2/5/2008
	  1995-12-22T09:05:02 = Fri, 12/22/1995
	 -0010-09-15T04:44:23 = Sat, 9/15/-010

       yMMM (MMM y)

	  2008-02-05T18:30:30 = Feb 2008
	  1995-12-22T09:05:02 = Dec 1995
	 -0010-09-15T04:44:23 = Sep -10

       yMMMEd (EEE, MMM d, y)

	  2008-02-05T18:30:30 = Tue, Feb 5, 2008
	  1995-12-22T09:05:02 = Fri, Dec 22, 1995
	 -0010-09-15T04:44:23 = Sat, Sep 15, -10

       yMMMM (MMMM y)

	  2008-02-05T18:30:30 = February 2008
	  1995-12-22T09:05:02 = December 1995
	 -0010-09-15T04:44:23 = September -10

       yQ (Q yyyy)

	  2008-02-05T18:30:30 = 1 2008
	  1995-12-22T09:05:02 = 4 1995
	 -0010-09-15T04:44:23 = 3 -010

       yQQQ (QQQ y)

	  2008-02-05T18:30:30 = Q1 2008
	  1995-12-22T09:05:02 = Q4 1995
	 -0010-09-15T04:44:23 = Q3 -10

   Miscellaneous
       Prefers 24 hour time?

       Yes

       Local first day of the week

       Monday

SUPPORT

       See DateTime::Locale.

AUTHOR

       Dave Rolsky <autarch@urth.org>

COPYRIGHT

       Copyright (c) 2008 David Rolsky. All rights reserved. This program is free software; you can redistribute it and/or modify it under the
       same terms as Perl itself.

       This module was generated from data provided by the CLDR project, see the LICENSE.cldr in this distribution for details on the CLDR data's
       license.

perl v5.16.2							    2013-08-25						DateTime::Locale::en_BE(3)
All times are GMT -4. The time now is 03:36 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy