03-05-2009
Parsing log files, displaying logs between specific dates
Sorry, couldn't really think of a simple subject/title.
So, I have a log file, and the dates are displayed like so:
2009-03-05 02:49:44
So the first and second field are the date/time. I can change them into a unix timestamp easily with:
date -d "2009-03-05 02:49:44" +%s
However, trying to do that is not as easy as I thought. I wanted to get all logs between X and Y time (lets say for a few hours on Z day). To make this easily reusable, I would rather do it this way.
I have tried to use awk with the system() function, but maybe I did not use it correctly..
awk '{ system("date -d " $1,$2 " +%s"); }'
Of course, I have tried other varieties of this, but to no avail. I have thought of possibly doing it other ways, but I am not even sure what will work now.. Anyone have any suggestions?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
assume files are in a directory
/data
$ ls -ltr
Just displaying Data and file name:
01/01/2004 file_3434_typea.dat
01/01/2004 file_3423_typea.dat
01/01/2004 file_3436_typea.dat
01/01/2004 file_3434_typeb.dat
01/01/2004 file_3423_typeb.dat
01/01/2004 file_3436_typeb.dat ... (3 Replies)
Discussion started by: siva_jm
3 Replies
2. Shell Programming and Scripting
I need to get the list of all the log files for a particular duration, say between two dates,i.e I need to get the list of all the log files between date1 and date2.The two dates are entered by the user.
The format of the log file is :
/path_name/graph_name_20080801180308.log.
I dont... (1 Reply)
Discussion started by: avishekp
1 Replies
3. Shell Programming and Scripting
My file will contain following(log.txt):
start testcase: config loading
......
error XXXX
.....
end testcase: config loading, result failed
start testcase: ping check
.....
error ZZZZZ
.....
error AAAAA
end testcase: Ping check, result failed
I am expecting below output. ... (4 Replies)
Discussion started by: shellscripter
4 Replies
4. UNIX for Dummies Questions & Answers
Hi all,
We have an existing script:
find /u03/oraprod/perpcomn/admin/out -type f -ctime +7 \
-exec cp {} "/u08/oraprod/backup/cout" \;
Which is to find all files more than 7 days and copy to another folder. However I would like to only list files with Sep 29, and cp to another folder.
... (2 Replies)
Discussion started by: *Jess*
2 Replies
5. Shell Programming and Scripting
I would like to parse through some logs looking for things like exception or failed (grep -i failed). Ideal would be if it were in a menu format so someone without unix ability could just choose option 1 2 or 3 etc. If I could pass the hostname to a variable also that would be awesome, so someone... (5 Replies)
Discussion started by: taekwondo
5 Replies
6. UNIX and Linux Applications
Right now I am parsing Tuxedo logs to calculate response times for various services. I was hoping to find a log tool that had support for Tuxedo and would generate drill down html reports.
---------- Post updated at 02:35 PM ---------- Previous update was at 02:33 PM ----------
I just wanted... (0 Replies)
Discussion started by: Lurch
0 Replies
7. Debian
Hi,
Yesterday I installed and configured logrotate on my Debian machine. I was expecting this to run at 06:25 in the morning and it actually did. All my old logs were compressed and zipped but the new logs were all with size equal to 0 bytes. Processes, while still running ok, they were not... (2 Replies)
Discussion started by: pmatsinopoulos
2 Replies
8. Shell Programming and Scripting
Hi ,
I have a Data cleansing process which creates different log file for each step , when the process runs it creates following log files in below order:
p1_tranfrmr_log.txt
p1_tranfrmr_stats.txt
p2_globrtr_log.txt
p2_globrtr_stats.txt
p3_cusparse_log.txt
p3_cusparse_stats.txt
'
'... (8 Replies)
Discussion started by: sonu_pal
8 Replies
9. Shell Programming and Scripting
HI,
I want to search for a logs which are trace between specific date and time from logs file.
My logs are generated like this :-
Tue Jun 18 05:00:02 EEST 2013 | file_check.sh| Message:script has files to process.
Thu Jun 20 05:00:02 EEST 2013 | file_check.sh| Message:script has files to... (5 Replies)
Discussion started by: ketanraut
5 Replies
10. Red Hat
Hi,
These are the list of files in one directory in the server :
# ls -lrt
total 10120
-rw-r--r-- 1 root root 4484 Jul 8 2011 install.log.syslog
-rw-r--r-- 1 root root 51890 Jul 8 2011 install.log
-rw------- 1 root root 3140 Jul 8 2011 anaconda-ks.cfg
drwxr-xr-x 2 root root... (2 Replies)
Discussion started by: anaigini45
2 Replies
LEARN ABOUT PHP
date_parse_from_format
DATE_PARSE_FROM_FORMAT(3) 1 DATE_PARSE_FROM_FORMAT(3)
date_parse_from_format - Get info about given date formatted according to the specified format
SYNOPSIS
array date_parse_from_format (string $format, string $date)
DESCRIPTION
Returns associative array with detailed info about given date.
PARAMETERS
o $format
- Format accepted by DateTime.createFromFormat(3).
o $date
- String representing the date.
RETURN VALUES
Returns associative array with detailed info about given date.
EXAMPLES
Example #1
date_parse_from_format(3) example
<?php
$date = "6.1.2009 13:00+01:00";
print_r(date_parse_from_format("j.n.Y H:iP", $date));
?>
The above example will output:
Array
(
[year] => 2009
[month] => 1
[day] => 6
[hour] => 13
[minute] => 0
[second] => 0
[fraction] =>
[warning_count] => 0
[warnings] => Array
(
)
[error_count] => 0
[errors] => Array
(
)
[is_localtime] => 1
[zone_type] => 1
[zone] => -60
[is_dst] =>
)
SEE ALSO
DateTime.createFromFormat(3), checkdate(3).
PHP Documentation Group DATE_PARSE_FROM_FORMAT(3)