Grep a log file starting from a specific time to the end of file Post: 303021656

Sponsored Content

Top Forums Shell Programming and Scripting Grep a log file starting from a specific time to the end of file Post 303021656 by stomp on Tuesday 14th of August 2018 02:47:15 PM

08-14-2018

Registered User

This does not work in AIX. It's an older date implementation there.

------ Post updated at 08:47 PM ------

I have some awk script for you, which you will need to adapt to your needs. Maybe a starting point for you to learn to get aquainted with GNU awk.

Code:

#!/usr/bin/gawk -f
#
#       Usage:
#
#       ./log_output_from "timespec" <input_file.txt
#
#               timespec is: "YYYY MM DD HH MM SS"
#
#       Example: 
#
#       ./log_output_from "2018 01 01 16 00 00" <input_file.txt
#
#
#
#
#       Sample Input data
#
#       Jul 2018 16:17:30 Some text here
#


function epoch(year,month,day,hour,min,sec) {

         return mktime(year" "month" "day" "hour" "min" "sec) 

}

BEGIN {
        months_str=("Jan_Feb_Mar_Apr_May_Jun_Jul_Aug_Sep_Oct_Nov_Dec")
        split(months_str, month_names, "_");
        for(name in month_names) {
                i=i+1
                month_number[month_names[i]]=i
        }
        start_seconds=mktime(start_time)

 }
# if the time is reached, no more checking, just print every line

 (time_reached==1) {
        print($0)
        next
}
{
        split($4,mytime,":")
        current_line_seconds=epoch($3,month_number[$1],$2,mytime[1],mytime[2],mytime[3]) 
        if(current_line_seconds > start_seconds) {
                time_reached = 1
                print($0)
        }
}

Last edited by stomp; 08-14-2018 at 03:53 PM..

stomp

View Public Profile for stomp

Find all posts by stomp

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Print starting 3rd line until end of the file.

Hi, I want to Print starting 3rd line until end of the file. Pls let me know the command. Thanks in advance.

2. Shell Programming and Scripting

Grep from a starting line till the end of the file

Hi Folks, I got to know from this forums on how to grep from a particular line say line 6 awk 'NR==6 {print;exit}' But how do i grep from line 6 till the end of the file or command output. Thanks,

3. Shell Programming and Scripting

Grep starting from a specific position

Hello people, I'm scratch my head to find a solution to my problem, I'm absolutely sure this is very simple!!! :wall: I'm using the tcpdump to show on the screen in real time the UCP traffic: tcpdump -l -i bond1 -s 1514 -nntttt -A src or dst 192.168.1.5 and port 10000 | egrep "/51/"The output...

4. Shell Programming and Scripting

Grep the Content of a LOG File which has latest Date and Time

Hi All, Need a small help. I have a log file which keeps updating for every Minute with multiple number of lines. I just want to grep few properties which has latest Date and Time to it. How do i do it? I wanted to grep a property by name "Reloading cache with a maximum of" from the...

5. Shell Programming and Scripting

need to grep contents of a file within specific time span. regex i am using is not working

Hi , I am trying to extract contents of a file between specified time stamp. but it does not seem to work. i am trying to extract output of /var/adm/messages between 15:00:00 to 15:23:59 . i have tried two regex the first one seems to kind of work. it displays some output. the second one is...

6. Shell Programming and Scripting

Grep in a log file within a time range (hour)

Hi, im trying to write a grep script that returns me the last inputs added in the last hour in the log file. Literally i have nothing yet but: grep 'Line im looking for' LOGFILE.log | tail -1 this only gives me the last input, but no necessarily from the last hour. Help Please.

7. UNIX for Dummies Questions & Answers

Add strings from one file at the end of specific lines in text file

Hello All, this is my first post so I don't know if I am doing this right. I would like to append entries from a series of strings (contained in a text file) consecutively at the end of specifically labeled lines in another file. As an example: - the file that contains the values to be...

8. Shell Programming and Scripting

Search for logs traced between specific date and time from log file

HI, I want to search for a logs which are trace between specific date and time from logs file. My logs are generated like this :- Tue Jun 18 05:00:02 EEST 2013 | file_check.sh| Message:script has files to process. Thu Jun 20 05:00:02 EEST 2013 | file_check.sh| Message:script has files to...

9. Shell Programming and Scripting

Extract specific line in an html file starting and ending with specific pattern to a text file

Hi This is my first post and I'm just a beginner. So please be nice to me. I have a couple of html files where a pattern beginning with "http://www.site.com" and ending with "/resource.dat" is present on every 241st line. How do I extract this to a new text file? I have tried sed -n 241,241p...

10. UNIX for Dummies Questions & Answers

How to grep a line not starting with # from a file (there are two lines starting with # and normal)?

e.g. File name: File.txt cat File.txt Result: #INBOUND_QUEUE=FAQ1 INBOUND_QUEUE=FAQ2 I want to get the value for one which is not commented out. Thanks,

LEARN ABOUT OPENSOLARIS

igawk

IGAWK(1)							 Utility Commands							  IGAWK(1)

NAME

       igawk - gawk with include files

SYNOPSIS

       igawk [ all gawk options ] -f program-file [ -- ] file ...
       igawk [ all gawk options ] [ -- ] program-text file ...

DESCRIPTION

       Igawk is a simple shell script that adds the ability to have ``include files'' to gawk(1).

       AWK programs for igawk are the same as for gawk, except that, in addition, you may have lines like

	      @include getopt.awk

       in your program to include the file getopt.awk from either the current directory or one of the other directories in the search path.

OPTIONS

       See gawk(1) for a full description of the AWK language and the options that gawk supports.

EXAMPLES

       cat << EOF > test.awk
       @include getopt.awk

       BEGIN {
	    while (getopt(ARGC, ARGV, "am:q") != -1)
		 ...
       }
       EOF

       igawk -f test.awk

SEE ALSO

       gawk(1)

       Effective AWK Programming, Edition 1.0, published by the Free Software Foundation, 1995.

AUTHOR

       Arnold Robbins (arnold@skeeve.com).

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +--------------------+-----------------+
       |  ATTRIBUTE TYPE    | ATTRIBUTE VALUE |
       +--------------------+-----------------+
       |Availability	    | SUNWgawk	      |
       +--------------------+-----------------+
       |Interface Stability | Volatile	      |
       +--------------------+-----------------+
NOTES

       Source for gawk is available on http://opensolaris.org.

Free Software Foundation					    Nov 3 1999								  IGAWK(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Print starting 3rd line until end of the file.

Discussion started by: smc3

2. Shell Programming and Scripting

Grep from a starting line till the end of the file

Discussion started by: Mr. Zer0

3. Shell Programming and Scripting

Grep starting from a specific position

Discussion started by: Lord Spectre

4. Shell Programming and Scripting

Grep the Content of a LOG File which has latest Date and Time

Discussion started by: nvindraneel