03-05-2009
Parsing log files, displaying logs between specific dates
Sorry, couldn't really think of a simple subject/title.
So, I have a log file, and the dates are displayed like so:
2009-03-05 02:49:44
So the first and second field are the date/time. I can change them into a unix timestamp easily with:
date -d "2009-03-05 02:49:44" +%s
However, trying to do that is not as easy as I thought. I wanted to get all logs between X and Y time (lets say for a few hours on Z day). To make this easily reusable, I would rather do it this way.
I have tried to use awk with the system() function, but maybe I did not use it correctly..
awk '{ system("date -d " $1,$2 " +%s"); }'
Of course, I have tried other varieties of this, but to no avail. I have thought of possibly doing it other ways, but I am not even sure what will work now.. Anyone have any suggestions?
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
assume files are in a directory
/data
$ ls -ltr
Just displaying Data and file name:
01/01/2004 file_3434_typea.dat
01/01/2004 file_3423_typea.dat
01/01/2004 file_3436_typea.dat
01/01/2004 file_3434_typeb.dat
01/01/2004 file_3423_typeb.dat
01/01/2004 file_3436_typeb.dat ... (3 Replies)
Discussion started by: siva_jm
3 Replies
2. Shell Programming and Scripting
I need to get the list of all the log files for a particular duration, say between two dates,i.e I need to get the list of all the log files between date1 and date2.The two dates are entered by the user.
The format of the log file is :
/path_name/graph_name_20080801180308.log.
I dont... (1 Reply)
Discussion started by: avishekp
1 Replies
3. Shell Programming and Scripting
My file will contain following(log.txt):
start testcase: config loading
......
error XXXX
.....
end testcase: config loading, result failed
start testcase: ping check
.....
error ZZZZZ
.....
error AAAAA
end testcase: Ping check, result failed
I am expecting below output. ... (4 Replies)
Discussion started by: shellscripter
4 Replies
4. UNIX for Dummies Questions & Answers
Hi all,
We have an existing script:
find /u03/oraprod/perpcomn/admin/out -type f -ctime +7 \
-exec cp {} "/u08/oraprod/backup/cout" \;
Which is to find all files more than 7 days and copy to another folder. However I would like to only list files with Sep 29, and cp to another folder.
... (2 Replies)
Discussion started by: *Jess*
2 Replies
5. Shell Programming and Scripting
I would like to parse through some logs looking for things like exception or failed (grep -i failed). Ideal would be if it were in a menu format so someone without unix ability could just choose option 1 2 or 3 etc. If I could pass the hostname to a variable also that would be awesome, so someone... (5 Replies)
Discussion started by: taekwondo
5 Replies
6. UNIX and Linux Applications
Right now I am parsing Tuxedo logs to calculate response times for various services. I was hoping to find a log tool that had support for Tuxedo and would generate drill down html reports.
---------- Post updated at 02:35 PM ---------- Previous update was at 02:33 PM ----------
I just wanted... (0 Replies)
Discussion started by: Lurch
0 Replies
7. Debian
Hi,
Yesterday I installed and configured logrotate on my Debian machine. I was expecting this to run at 06:25 in the morning and it actually did. All my old logs were compressed and zipped but the new logs were all with size equal to 0 bytes. Processes, while still running ok, they were not... (2 Replies)
Discussion started by: pmatsinopoulos
2 Replies
8. Shell Programming and Scripting
Hi ,
I have a Data cleansing process which creates different log file for each step , when the process runs it creates following log files in below order:
p1_tranfrmr_log.txt
p1_tranfrmr_stats.txt
p2_globrtr_log.txt
p2_globrtr_stats.txt
p3_cusparse_log.txt
p3_cusparse_stats.txt
'
'... (8 Replies)
Discussion started by: sonu_pal
8 Replies
9. Shell Programming and Scripting
HI,
I want to search for a logs which are trace between specific date and time from logs file.
My logs are generated like this :-
Tue Jun 18 05:00:02 EEST 2013 | file_check.sh| Message:script has files to process.
Thu Jun 20 05:00:02 EEST 2013 | file_check.sh| Message:script has files to... (5 Replies)
Discussion started by: ketanraut
5 Replies
10. Red Hat
Hi,
These are the list of files in one directory in the server :
# ls -lrt
total 10120
-rw-r--r-- 1 root root 4484 Jul 8 2011 install.log.syslog
-rw-r--r-- 1 root root 51890 Jul 8 2011 install.log
-rw------- 1 root root 3140 Jul 8 2011 anaconda-ks.cfg
drwxr-xr-x 2 root root... (2 Replies)
Discussion started by: anaigini45
2 Replies
LEARN ABOUT PHP
date_sunrise
DATE_SUNRISE(3) 1 DATE_SUNRISE(3)
date_sunrise - Returns time of sunrise for a given day and location
SYNOPSIS
mixed date_sunrise (int $timestamp, [int $format = SUNFUNCS_RET_STRING], [float $latitude = ini_get("date.default_latitude")], [float
$longitude = ini_get("date.default_longitude")], [float $zenith = ini_get("date.sunrise_zenith")], [float $gmt_offset])
DESCRIPTION
date_sunrise(3) returns the sunrise time for a given day (specified as a $timestamp) and location.
PARAMETERS
o $timestamp
- The $timestamp of the day from which the sunrise time is taken.
o $format
-
$format constants
+-----------------------+-------------------------------------------+
| constant | |
| | |
| | description |
| | |
| | example |
| | |
+-----------------------+-------------------------------------------+
| SUNFUNCS_RET_STRING | |
| | |
| | returns the result as string |
| | |
| | 16:46 |
| | |
| SUNFUNCS_RET_DOUBLE | |
| | |
| | returns the result as float |
| | |
| | 16.78243132 |
| | |
|SUNFUNCS_RET_TIMESTAMP | |
| | |
| | returns the result as integer (timestamp) |
| | |
| | 1095034606 |
| | |
+-----------------------+-------------------------------------------+
o $latitude
- Defaults to North, pass in a negative value for South. See also: date.default_latitude
o $longitude
- Defaults to East, pass in a negative value for West. See also: date.default_longitude
o $zenith
- Default: date.sunrise_zenith
o $gmtoffset
- Specified in hours.
RETURN VALUES
Returns the sunrise time in a specified $format on success or FALSE on failure.
ERRORS
/EXCEPTIONS
Every call to a date/time function will generate a E_NOTICE if the time zone is not valid, and/or a E_STRICT or E_WARNING message if using
the system settings or the $TZ environment variable. See also date_default_timezone_set(3)
CHANGELOG
+--------+---------------------------------------------------+
|Version | |
| | |
| | Description |
| | |
+--------+---------------------------------------------------+
| 5.1.0 | |
| | |
| | Now issues the E_STRICT and E_NOTICE time zone |
| | errors. |
| | |
+--------+---------------------------------------------------+
EXAMPLES
Example #1
date_sunrise(3) example
<?php
/* calculate the sunrise time for Lisbon, Portugal
Latitude: 38.4 North
Longitude: 9 West
Zenith ~= 90
offset: +1 GMT
*/
echo date("D M d Y"). ', sunrise time : ' .date_sunrise(time(), SUNFUNCS_RET_STRING, 38.4, -9, 90, 1);
?>
The above example will output something similar to:
Mon Dec 20 2004, sunrise time : 08:54
SEE ALSO
date_sunset(3).
PHP Documentation Group DATE_SUNRISE(3)