Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Parse apache log file with three different time formats
Top Forums UNIX for Beginners Questions & Answers Parse apache log file with three different time formats Post 303038285 by RudiC on Thursday 29th of August 2019 01:51:46 PM
Old 08-29-2019
Try this to prefix the date/time to every log line:
Code:
awk -vDM="$(LC_ALL=C locale abday abmon)" '
BEGIN           {gsub (/;/, "|", DM)
                 split (DM, T)
                 MStr1 = "(" T[1] ") (" T[2] ") *[0-9]* [0-9:]* [0-9]*"
                 MStr2 = "[0-9]*/(" T[2] ")/[0-9:]* -[0-9]*"
                 MStr3 = "[0-9]*-(" T[2] ") [0-9:.]*"
                 MStr  = "(" MStr1 ")|(" MStr2 ")|(" MStr3 ")"
                }
match ($0, MStr)        {print substr ($0, RSTART, RLENGTH), $0
                        }
 ' /tmp/*log


EDIT: or, somewhat simplified,



Code:
awk -vDM="$(LC_ALL=C locale abday abmon)" '
BEGIN           {gsub (/;/, "|", DM)
                 split (DM, T)
                 MStr1 = "(" T[1] ") (" T[2] ") *[0-9]* [0-9:]* [0-9]*"
                 MStr2 = "[0-9]*[-/](" T[2] ")(/[0-9:]* -| )*[0-9:.]*"
                 MStr  = "(" MStr1 ")|(" MStr2 ")"
                }
match ($0, MStr)        {print substr ($0, RSTART, RLENGTH), $0
                        }
' /tmp/*log

These 2 Users Gave Thanks to RudiC For This Post:
drl stomp
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Processing a log file based on date/time input and the date/time on the log file

Hi, I'm trying to accomplish the following and would like some suggestions or possible bash script examples that may work I have a directory that has a list of log files that's periodically dumped from a script that is crontab that are rotated 4 generations. There will be a time stamp that is... (4 Replies)
Discussion started by: primp
4 Replies

2. Shell Programming and Scripting

Setting of two time formats in one machine

Hi, Is it possible to set the two time formats in a single machine. My machine time is in EST and the logs are in PST. What would be the issue, and how to make change of this.? (5 Replies)
Discussion started by: gsiva
5 Replies

3. Shell Programming and Scripting

sed command to parse Apache config file

Hi there, am trying to parse an Apache 'server' config file. A snippet of the config file is shown below: ..... ProxyPassReverse /foo http://foo.example.com/bar ..... ..... RewriteRule ^/(.*) http://www.example.com/$1 RewriteRule /redirect https://www.example1.com/$1 ........ (7 Replies)
Discussion started by: jy2k7ca
7 Replies

4. Shell Programming and Scripting

Extracting data from a log file with date formats

Hello, I have a log file for the year, which contains lines starting with the data in the format of YYYY-MM-DD. I need to get all the lines that contain the DD being 04, how would I do this? I tried using grep "*-*04" but it didn't work. Any quick one liners I should know about? Thank you. (2 Replies)
Discussion started by: cpickering
2 Replies

5. Shell Programming and Scripting

Check/Parse log file's lines using time difference/timestamp

I was looking at this script which outputs the two lines which differs less than one sec. #!/usr/bin/perl -w use strict; use warnings; use Time::Local; use constant SEC_MILIC => 1000; my $file='infile'; ## Open for reading argument file. open my $fh, "<", $file or die "Cannot... (1 Reply)
Discussion started by: cele_82
1 Replies

6. Shell Programming and Scripting

Using awk to parse a file with mixed formats in columns

Greetings I have a file formatted like this: rhino grey weight=1003;height=231;class=heaviest;histology=9,0,0,8 bird white weight=23;height=88;class=light;histology=7,5,1,0,0 turtle green weight=40;height=9;class=light;histology=6,0,2,0... (2 Replies)
Discussion started by: Twinklefingers
2 Replies

7. Shell Programming and Scripting

Parse A Log File

Hello All, Below is the excerpt from my Informatica log file which has 4 blocks of lines (starting with WRITER_1_*_1). Like these my log file will have multiple blocks of same pattern. WRITER_1_*_1> WRT_8161 TARGET BASED COMMIT POINT Thu May 08 09:33:21 2014... (13 Replies)
Discussion started by: Ariean
13 Replies

8. Shell Programming and Scripting

Shell Script | Parse log file after a given date and time stamp

I am developing one script which will take log file name, output file name, date, hour and minute as an argument and based on these inputs, the script will scan and capture all the error(s) that have been triggered from a given time. Example: script should capture all the error after 13:50 on Jan... (2 Replies)
Discussion started by: ROMA3
2 Replies

9. Shell Programming and Scripting

Comparing different time formats

I am trying to do a comparison of files based on their last modified date. I am pulling the first file from a webapp folder using curl. curl --silent -I http://localhost:8023/conf/log4j2.xml | grep Last Last-Modified: Tue, 22 Mar 2016 22:02:18 GMT The second file is on local disk. stat... (2 Replies)
Discussion started by: Junaid Subhani
2 Replies

10. Shell Programming and Scripting

Perl to parse a variety of formats

The below perl script parses a variety of formats. If I use the numeric text file as input the script works correctly. However using the alpha text file as input there is a black output file. The portion in bold splits the field to parse f or NC_000023.10:g.153297761C>A into a variable $common but... (3 Replies)
Discussion started by: cmccabe
3 Replies

LEARN ABOUT OSX

apache

apache(1M)						  System Administration Commands						apache(1M)

NAME

       apache - Apache hypertext transfer protocol server overview

DESCRIPTION

	apache	consists  of a main server daemon, loadable server modules, some additional support utilities, configuration files, and documenta-
       tion.

FILES

       The apache HTTPD server is integrated with Solaris.

       The following files specify the installation locations for apache:

       /etc/apache	       Contains server configuration files.

			       A newly-installed server must be manually configured before use. Typically this involves copying httpd.conf-example
			       to the httpd.conf file and making local configuration adjustments.

       /usr/apache/bin	       Contains the httpd executable as well as other utility programs.

       /usr/apache/htdocs      Contains  the  Apache  manual  in HTML format. This documentation is accessible by way of a link on the server test
			       page that gets installed upon fresh installation.

       /usr/apache/include     Contains the Apache header files, which are needed for building various optional server extensions with apxs(8)

       /usr/apache/jserv       Contains documention for the mod_jserv java servlet module. Documention can be read with a web  browser	using  the
			       url:

			       file:/usr/apache/jserv/docs/index.html

       /usr/apache/libexec     Contains loadable modules (DSOs) supplied with the server. Any modules which are added using apxs(8)are also copied
			       into this directory.

       /usr/apache/man	       Contains man pages for the server, utility programs, and mod_perl.

			       Add this directory to your MANPATH to read the Apache man pages. See NOTES.

       /usr/apache/perl5       Contains the modules and library files used by the mod_perl extension to Apache.

       /var/apache/cgi-bin     Default location for the CGI scripts.

			       This can be changed by altering the httpd.conf file and restarting the server.

       /var/apache/htdocs      Default document root.

			       This can be changed by altering the httpd.conf file and restarting the server.

       /var/apache/icons       Icons used by the server.

			       This normally shouldn't need to be changed.

       /var/apache/logs        Contains server log files.

			       The formats, names, and locations of the files in this directory can be altered by various configuration directives
			       in the httpd.conf file.

       /var/apache/proxy       Directory used to cache pages if the caching feature of mod_proxy is enabled in the httpd.conf file.

			       The location of the cache can also be changed by changing the proxy configuration in the httpd.conf file.

ATTRIBUTES

       See attributes(5) for descriptions of the following attributes:

       +-----------------------------+-----------------------------+
       |      ATTRIBUTE TYPE	     |	    ATTRIBUTE VALUE	   |
       +-----------------------------+-----------------------------+
       |Availability		     |SUNWapchr 		   |
       +-----------------------------+-----------------------------+
       |			     |SUNWapchu 		   |
       +-----------------------------+-----------------------------+
       |			     |SUNWapchd 		   |
       +-----------------------------+-----------------------------+

SEE ALSO

       attributes(5)

       http://www.apache.org

NOTES

       In addition to the documentation and man pages included with Solaris, more information is available at http://www.apache.org

       The  Apache  man pages are provided with the programming modules. To view the manual pages for the Apache modules with the man command, add
       /usr/apache/man to the MANPATH environment  variable. See man(1) for  more information. Running catman(1M) on the Apache  manual  pages	is
       not supported.

SunOS 5.10							    8 Aug 2000								apache(1M)
All times are GMT -4. The time now is 11:21 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy