Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Parse apache log file with three different time formats
Top Forums UNIX for Beginners Questions & Answers Parse apache log file with three different time formats Post 303038270 by sahil_shine on Thursday 29th of August 2019 09:18:52 AM
Old 08-29-2019
Parse apache log file with three different time formats
Hi,

I want to parse below file and Write a function to extract the logs between two given timestamp.

Apache (Unix) Log Samples - MonitorWare

The challenge here is there are three date and time format.

First :- 07/Mar/2004:16:05:49
Second :- Sun Mar 7 16:02:00 2004
Third :- 29-Mar 15:18:20.54

I have sed command which can help to get this but we should force user to mention format . I want this to be general . How can i achieve this. I will like to parse log file and create a new file to keep time format same and then using sed or grep it's pretty simple.

Code:
sed -n '/07\/Mar\/2004:16:05:49/,/07\/Mar\/2004:16:31:48/p' log

sed -n '/Sun Mar 7 16:02:00 2004/,/Mon Mar 8 00:11:22 2004/p' log
sed -n '/29-Mar 15:18:20.50/,/29-Mar 15:18:20.54/p' log

Please let me know a good way to achieve this. Any pointers will also help
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Processing a log file based on date/time input and the date/time on the log file

Hi, I'm trying to accomplish the following and would like some suggestions or possible bash script examples that may work I have a directory that has a list of log files that's periodically dumped from a script that is crontab that are rotated 4 generations. There will be a time stamp that is... (4 Replies)
Discussion started by: primp
4 Replies

2. Shell Programming and Scripting

Setting of two time formats in one machine

Hi, Is it possible to set the two time formats in a single machine. My machine time is in EST and the logs are in PST. What would be the issue, and how to make change of this.? (5 Replies)
Discussion started by: gsiva
5 Replies

3. Shell Programming and Scripting

sed command to parse Apache config file

Hi there, am trying to parse an Apache 'server' config file. A snippet of the config file is shown below: ..... ProxyPassReverse /foo http://foo.example.com/bar ..... ..... RewriteRule ^/(.*) http://www.example.com/$1 RewriteRule /redirect https://www.example1.com/$1 ........ (7 Replies)
Discussion started by: jy2k7ca
7 Replies

4. Shell Programming and Scripting

Extracting data from a log file with date formats

Hello, I have a log file for the year, which contains lines starting with the data in the format of YYYY-MM-DD. I need to get all the lines that contain the DD being 04, how would I do this? I tried using grep "*-*04" but it didn't work. Any quick one liners I should know about? Thank you. (2 Replies)
Discussion started by: cpickering
2 Replies

5. Shell Programming and Scripting

Check/Parse log file's lines using time difference/timestamp

I was looking at this script which outputs the two lines which differs less than one sec. #!/usr/bin/perl -w use strict; use warnings; use Time::Local; use constant SEC_MILIC => 1000; my $file='infile'; ## Open for reading argument file. open my $fh, "<", $file or die "Cannot... (1 Reply)
Discussion started by: cele_82
1 Replies

6. Shell Programming and Scripting

Using awk to parse a file with mixed formats in columns

Greetings I have a file formatted like this: rhino grey weight=1003;height=231;class=heaviest;histology=9,0,0,8 bird white weight=23;height=88;class=light;histology=7,5,1,0,0 turtle green weight=40;height=9;class=light;histology=6,0,2,0... (2 Replies)
Discussion started by: Twinklefingers
2 Replies

7. Shell Programming and Scripting

Parse A Log File

Hello All, Below is the excerpt from my Informatica log file which has 4 blocks of lines (starting with WRITER_1_*_1). Like these my log file will have multiple blocks of same pattern. WRITER_1_*_1> WRT_8161 TARGET BASED COMMIT POINT Thu May 08 09:33:21 2014... (13 Replies)
Discussion started by: Ariean
13 Replies

8. Shell Programming and Scripting

Shell Script | Parse log file after a given date and time stamp

I am developing one script which will take log file name, output file name, date, hour and minute as an argument and based on these inputs, the script will scan and capture all the error(s) that have been triggered from a given time. Example: script should capture all the error after 13:50 on Jan... (2 Replies)
Discussion started by: ROMA3
2 Replies

9. Shell Programming and Scripting

Comparing different time formats

I am trying to do a comparison of files based on their last modified date. I am pulling the first file from a webapp folder using curl. curl --silent -I http://localhost:8023/conf/log4j2.xml | grep Last Last-Modified: Tue, 22 Mar 2016 22:02:18 GMT The second file is on local disk. stat... (2 Replies)
Discussion started by: Junaid Subhani
2 Replies

10. Shell Programming and Scripting

Perl to parse a variety of formats

The below perl script parses a variety of formats. If I use the numeric text file as input the script works correctly. However using the alpha text file as input there is a black output file. The portion in bold splits the field to parse f or NC_000023.10:g.153297761C>A into a variable $common but... (3 Replies)
Discussion started by: cmccabe
3 Replies

LEARN ABOUT DEBIAN

sys::filesystem::aix

Sys::Filesystem::Aix(3pm)				User Contributed Perl Documentation				 Sys::Filesystem::Aix(3pm)

NAME

       Sys::Filesystem::Aix - Return AIX filesystem information to Sys::Filesystem

SYNOPSIS

       See Sys::Filesystem.

INHERITANCE

	 Sys::Filesystem::Aix
	 ISA UNIVERSAL

METHODS

       version ()
	   Return the version of the (sub)module.

ATTRIBUTES

       The following is a list of filesystem properties which may be queried as methods through the parent Sys::Filesystem object.

       account
	   Used by the dodisk command to determine the filesystems to be processed by the accounting system.

       boot
	   Used by the mkfs command to initialize the boot block of a new filesystem.

       check
	   Used by the fsck command to determine the default filesystems to be checked.

       dev Identifies, for local mounts, either the block special file where the filesystem resides or the file or directory to be mounted.

       free
	   This value can be either true or false. (Obsolete and ignored).

       mount
	   Used by the mount command to determine whether this file system should be mounted by default.

       nodename
	   Used by the mount command to determine which node contains the remote filesystem.

       size
	   Used by the mkfs command for reference and to build the file system.

       type
	   Used to group related mounts.

       vfs Specifies the type of mount. For example, vfs=nfs specifies the virtual filesystem being mounted is an NFS filesystem.

       vol Used by the mkfs command when initializing the label on a new filesystem. The value is a volume or pack label using a maximum of 6
	   characters.

       log The LVName must be the full path name of the filesystem logging logical volume name to which log data is written as this file system is
	   modified. This is only valid for journaled filesystems.

SEE ALSO

       Sys::Filesystem

   Example /etc/filesystems
	       * @(#)filesystems @(#)29        1.22  src/bos/etc/filesystems/filesystems, cmdfs, bos530 9/8/00 13:57:45
	       * IBM_PROLOG_BEGIN_TAG
	       * This is an automatically generated prolog.
	       *
	       * <snip>
	       *
	       * This version of /etc/filesystems assumes that only the root file system
	       * is created and ready.	As new file systems are added, change the check,
	       * mount, free, log, vol and vfs entries for the appropriate stanza.

	       /:
		       dev	 = /dev/hd4
		       vol	 = "root"
		       mount	 = automatic
		       check	 = false
		       free	 = true
		       vfs	 = jfs2
		       log	 = /dev/hd8
		       type	 = bootfs

	       /proc:
		       dev	 = /proc
		       vol	 = "/proc"
		       mount	 = true
		       check	 = false
		       free	 = false
		       vfs	 = procfs

	       /scratch:
		       dev	 = /dev/fslv02
		       vfs	 = jfs2
		       log	 = INLINE
		       mount	 = true
		       account	 = false

   Example /usr/sbin/mount output
		 node	    mounted	   mounted over    vfs	     date	 options
	       -------- ---------------  ---------------  ------ ------------ ---------------
				/dev/hd4	 /		  jfs2	 Mar 24 12:14 rw,log=/dev/hd8
				/proc		 /proc		  procfs Mar 24 12:15 rw
				/dev/fslv02	 /scratch	  jfs2	 Mar 24 12:15 rw,log=INLINE

   filesystems(4)
       Manpage includes all known options, describes the format and comment char's.

VERSION

       $Id: Aix.pm 128 2010-05-12 13:16:44Z trevor $

AUTHOR

       Nicola Worthington <nicolaw@cpan.org> - <http://perlgirl.org.uk>

       Jens Rehsack <rehsack@cpan.org> - <http://www.rehsack.de/>

COPYRIGHT

       Copyright 2004,2005,2006 Nicola Worthington.

       Copyright 2008-2010 Jens Rehsack.

       This software is licensed under The Apache Software License, Version 2.0.

       <http://www.apache.org/licenses/LICENSE-2.0>

perl v5.10.1							    2010-05-18						 Sys::Filesystem::Aix(3pm)
All times are GMT -4. The time now is 08:37 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy