Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Grep a log file starting from a specific time to the end of file
Top Forums Shell Programming and Scripting Grep a log file starting from a specific time to the end of file Post 303021656 by stomp on Tuesday 14th of August 2018 02:47:15 PM
Old 08-14-2018
This does not work in AIX. It's an older date implementation there.

------ Post updated at 08:47 PM ------

I have some awk script for you, which you will need to adapt to your needs. Maybe a starting point for you to learn to get aquainted with GNU awk.


Code:
#!/usr/bin/gawk -f
#
#       Usage:
#
#       ./log_output_from "timespec" <input_file.txt
#
#               timespec is: "YYYY MM DD HH MM SS"
#
#       Example: 
#
#       ./log_output_from "2018 01 01 16 00 00" <input_file.txt
#
#
#
#
#       Sample Input data
#
#       Jul 2018 16:17:30 Some text here
#


function epoch(year,month,day,hour,min,sec) {

         return mktime(year" "month" "day" "hour" "min" "sec) 

}

BEGIN {
        months_str=("Jan_Feb_Mar_Apr_May_Jun_Jul_Aug_Sep_Oct_Nov_Dec")
        split(months_str, month_names, "_");
        for(name in month_names) {
                i=i+1
                month_number[month_names[i]]=i
        }
        start_seconds=mktime(start_time)

 }
# if the time is reached, no more checking, just print every line

 (time_reached==1) {
        print($0)
        next
}
{
        split($4,mytime,":")
        current_line_seconds=epoch($3,month_number[$1],$2,mytime[1],mytime[2],mytime[3]) 
        if(current_line_seconds > start_seconds) {
                time_reached = 1
                print($0)
        }
}

Last edited by stomp; 08-14-2018 at 03:53 PM..
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Print starting 3rd line until end of the file.

Hi, I want to Print starting 3rd line until end of the file. Pls let me know the command. Thanks in advance. (1 Reply)
Discussion started by: smc3
1 Replies

2. Shell Programming and Scripting

Grep from a starting line till the end of the file

Hi Folks, I got to know from this forums on how to grep from a particular line say line 6 awk 'NR==6 {print;exit}' But how do i grep from line 6 till the end of the file or command output. Thanks, (3 Replies)
Discussion started by: Mr. Zer0
3 Replies

3. Shell Programming and Scripting

Grep starting from a specific position

Hello people, I'm scratch my head to find a solution to my problem, I'm absolutely sure this is very simple!!! :wall: I'm using the tcpdump to show on the screen in real time the UCP traffic: tcpdump -l -i bond1 -s 1514 -nntttt -A src or dst 192.168.1.5 and port 10000 | egrep "/51/"The output... (5 Replies)
Discussion started by: Lord Spectre
5 Replies

4. Shell Programming and Scripting

Grep the Content of a LOG File which has latest Date and Time

Hi All, Need a small help. I have a log file which keeps updating for every Minute with multiple number of lines. I just want to grep few properties which has latest Date and Time to it. How do i do it? I wanted to grep a property by name "Reloading cache with a maximum of" from the... (4 Replies)
Discussion started by: nvindraneel
4 Replies

5. Shell Programming and Scripting

need to grep contents of a file within specific time span. regex i am using is not working

Hi , I am trying to extract contents of a file between specified time stamp. but it does not seem to work. i am trying to extract output of /var/adm/messages between 15:00:00 to 15:23:59 . i have tried two regex the first one seems to kind of work. it displays some output. the second one is... (13 Replies)
Discussion started by: chidori
13 Replies

6. Shell Programming and Scripting

Grep in a log file within a time range (hour)

Hi, im trying to write a grep script that returns me the last inputs added in the last hour in the log file. Literally i have nothing yet but: grep 'Line im looking for' LOGFILE.log | tail -1 this only gives me the last input, but no necessarily from the last hour. Help Please. (4 Replies)
Discussion started by: blacksteel1988
4 Replies

7. UNIX for Dummies Questions & Answers

Add strings from one file at the end of specific lines in text file

Hello All, this is my first post so I don't know if I am doing this right. I would like to append entries from a series of strings (contained in a text file) consecutively at the end of specifically labeled lines in another file. As an example: - the file that contains the values to be... (3 Replies)
Discussion started by: gus74
3 Replies

8. Shell Programming and Scripting

Search for logs traced between specific date and time from log file

HI, I want to search for a logs which are trace between specific date and time from logs file. My logs are generated like this :- Tue Jun 18 05:00:02 EEST 2013 | file_check.sh| Message:script has files to process. Thu Jun 20 05:00:02 EEST 2013 | file_check.sh| Message:script has files to... (5 Replies)
Discussion started by: ketanraut
5 Replies

9. Shell Programming and Scripting

Extract specific line in an html file starting and ending with specific pattern to a text file

Hi This is my first post and I'm just a beginner. So please be nice to me. I have a couple of html files where a pattern beginning with "http://www.site.com" and ending with "/resource.dat" is present on every 241st line. How do I extract this to a new text file? I have tried sed -n 241,241p... (13 Replies)
Discussion started by: dejavo
13 Replies

10. UNIX for Dummies Questions & Answers

How to grep a line not starting with # from a file (there are two lines starting with # and normal)?

e.g. File name: File.txt cat File.txt Result: #INBOUND_QUEUE=FAQ1 INBOUND_QUEUE=FAQ2 I want to get the value for one which is not commented out. Thanks, (3 Replies)
Discussion started by: Tanu
3 Replies

LEARN ABOUT DEBIAN

photon

PHOTON(1)																 PHOTON(1)

NAME

       photon - generates photo albums

SYNOPSIS

       photon [OPTIONS] [PATH]

DESCRIPTION

       Photon generates clean, yet configurable, static HTML photo galleries. All of the work is done from the command line, and the resulting
       output can easily be configured by changing the template files found in /usr/share/photon/templates.

       To create a new template (skin), first create a new directory:

	  mkdir -p ${HOME}/.photon/templates/my_theme/

       Then copy the contents of /usr/share/photon/templates/photonv1/ to this new directory.  Photon only needs three files to build pages:

       index.html
	  used to display the content of a folder

       image.html
	  used to display the page for an image

       movie.html
	  used to display the page for a movie

       If a file is missing, then photon will throw an error and will not run.

HOW TO BUILD A GALLERY

       Quick start
	  $ photon -o myoutputdir /photos

       Use the gimp plugin
	  $ photon --resize-plugin=gimp -v -o myoutputdir /photos

       Change the size for all images and the thumbnail and keep the original photo
	  $ photon --sizelist=0,1600x1200,800x600 --thumbsize=320x240 -o myoutputdir /photos

       Create a gallery from your custom template (skin)
	  $ photon -k my_theme -o myoutputdir /photos

       See photon help
	  $ photon --help

OPTIONS

       -a | --awstats
	  Insert Javascript for Awstats

       --awstats-url=URL
	  Change default value for Awstats script url

       -c NAME | --comment
	  Name of the comment file (default .comments)

       -d NUM | --display-columns=NUM
	  Number of columns in index (default 3)

       -E | --no-exif
	  Don't include EXIF information in HTML file

       -f | --force
	  Overwrite non-image generated files (html, javascript, etc) (default no)

       -ff | --force --force
	  Overwrite image files (default no)

       -h | --help
	  Print this help

       -I | --no-index
	  Do not generate the high level index.html

       -J | --no-javascript
	  Do not use javascript (no shortcuts, ... )

       -k | --skin=THEME
	  Skin selector (default photonv1)

       --print-skins
	  Print out available skins (templates)

       -l NUM | --display-lines=NUM
	  Number of lines in index (default 5)

       -m | --movie
	  Movie mode, include link to movie (*.mov)

       -o NAME | --output-directory=NAME
	  Name of the output directory

       -s LIST | --sizelist=LIST
	  Image sizes (default 0,1024x768,800x600,640x480). Zero, which is the default, uses the original resolution. W x H specifies the width
	  and height of the image in pixels.

       -t SIZE | --thumbsize=SIZE
	  Size of thumbnails (default 160x120)

       -v | --verbose
	  Verbosely print information

       -V | --version
	  Print program version number

       -z | --compress
	  Compress the original image if selected (default copy the image)

       --exif-bordercolor=COLOR
	  Exif window border color (default #008000)

       --exif-bgcolor=COLOR
	  Exif window background color (default #f0fff0)

       --exif-fgcolor=COLOR
	  Exif window text color (default black)

       --body-bgcolor=COLOR
	  Body background color (default #ccccff)

       --img-bgcolor=COLOR
	  Image background color (default white)

       --exclude=PATTERN
	  Exclude files matching PATTERN

       --resize-plugin=PLUG
	  Where PLUG is the program used to create thumbnails internal: fastest method (default) gimp: use Gimp>1.x (better quality)

       --resize-quality-low=NUM
	  Quality for small image. 0 (bad) and 100 (good)

       --resize-quality-high=NUM
	  Quality for big image 0 (bad) and 100 (good)

       --gimp-program=PROG
	  use PROG for gimp

SHORTCUTS WHILE VIEWING AN IMAGE

	  n/SPACE     Go to the next image (with the same resolution)
	  p/BACKSPACE Go to the previous image (with the same resolution)
	  s	      Start/Stop the slideshow
	  +/-	      Increase/Decrease by one second the slideshow's period
	  h	      Show shortcut and help
	  i	      Show Exif information
	  z	      Change to the higher resolution [NOT YET IMPLEMENTED]

SEE ALSO

	  gimp(1)

AUTHOR

	  Written by Luc Saillard, <luc@saillard.org>

	  Main web site: http://www.saillard.org/programs_and_patches/photon/

	  This manual page was written by Kevin Coyner <kcoyner@debian.org> for the Debian project but may be used by others.

								    12/16/2006								 PHOTON(1)
All times are GMT -4. The time now is 06:06 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy