Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Collecting all lines between two time stamp from the log

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Collecting all lines between two time stamp from the log
# 1  
Old 11-18-2015
Collecting all lines between two time stamp from the log
Can you help me to collect the entire logs between two time stamp. The below awk command collecting the logs only if the line has time stamp.

Code:
awk '$0>=from && $0<=to' from="150318 23:19:04" to="150318 23:55:04" log file

150318 23:19:04 logentries 
150318 23:29:04 logentries 
150318 23:39:04 logentries 
150318 23:49:04 logentries 
150318 23:55:04 logentries

I am looking the awk command or script to collect the entire lines between two time stamp like below

Code:
150318 23:19:04 logentries 
150318 23:29:04 logentries 
150318 23:39:04 logentries 
logentries 
logentries 
logentries 
150318 23:49:04 logentries 
150318 23:55:04 logentries

# 2  
Old 11-18-2015
Change the awk script to
Code:
'$0>=from {pr=1} $0>to {pr=0} pr'

# 3  
Old 11-18-2015
Thanks for the reply!

Code:
awk '$0>=from && $0<=to'

and
Code:
'$0>=from {pr=1} $0>to {pr=0} pr'

both output looks the same, both are not printing the lines which do not have the time stamp.
# 4  
Old 11-19-2015
The problem is that the string comparison is not precise enough.
So before the comparisons one needs to ensure that there is a time stamp.
Code:
awk '/^[0-9][0-9][0-9][0-9][0-9][0-9] [0-9][0-9]:[0-9][0-9]:[0-9][0-9] / {if ($0>=from) {pr=1} if ($0>to) {pr=0}} pr' from="150318 23:19:04" to="150318 23:55:04" logfile

This User Gave Thanks to MadeInGermany For This Post:
zenkarthi
# 5  
Old 11-20-2015
try below sed
Code:
sed -n '/150318 23:19:04/,/150318 23:55:04/{p}'

# 6  
Old 11-20-2015
awk equivalent:
Code:
awk '/150318 23:19:04/,/150318 23:55:04/' file
150318 23:19:04 logentries 
150318 23:29:04 logentries 
150318 23:39:04 logentries 
logentries 
logentries 
logentries 
150318 23:49:04 logentries 
150318 23:55:04 logentries

But all of these would work only if the exact time stamps are known and given. Should that not be the case, you'll need to read every line and interpret/calculate the time values before comparing to the lower and upper limits.
# 7  
Old 11-20-2015
Thank you all!

@MadeInGermany - your suggestion is working if the time value is lower to higher but if the time value is higher to lower then the output is completely different .

RudiC , The idea, script to collect the logs for every 45 mins and check the errors automatically.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Shell Script | Parse log file after a given date and time stamp

I am developing one script which will take log file name, output file name, date, hour and minute as an argument and based on these inputs, the script will scan and capture all the error(s) that have been triggered from a given time. Example: script should capture all the error after 13:50 on Jan... (2 Replies)
Discussion started by: ROMA3
2 Replies

2. Shell Programming and Scripting

Need Time Stamp Range On Log Files

I have created this script #!/bin/sh FILES=/data/log/access_*.log for f in $FILES do echo "Processing $f file" cat $f | awk '{print $1}' | sort | uniq -c | sort -n | tail done It produces this output Processing /data/log/access_abc.log file 114 1.1.1.1 167 2.2.2.2 ... (38 Replies)
Discussion started by: sharingsunshine
38 Replies

3. Shell Programming and Scripting

Collecting logs between two time stamps

Hi, please help me to collect the entire log files between two time stamp. for example, I am looking script to collect the entire log between "2015-03-27 15:59" to "2015-03-27 16:15" in the below sample log file. OS : RHEL 6.3 Date/Time : 24 hours format, the time is printing each log... (12 Replies)
Discussion started by: jerryknj
12 Replies

4. Shell Programming and Scripting

To check time stamp in log file and calculate.

Hi Friends, I have the following logfile. i want to make a script for calculate time by time2 - time1 1600266278|random|1|2014-09-19 02:08:56.024|2014-09-19 02:08:59.398|A|B|ROOM|Num0208559970111101788|1|dog|dos 1600266200|random|4|2014-09-19 02:08:06.572|2014-09-19... (2 Replies)
Discussion started by: ooilinlove
2 Replies

5. Shell Programming and Scripting

awk : collecting all data between two time frame

Hi Experts , I need your help to collect the complete data between two time frame from the log files, when I try awk it's collecting the data only which is printed with time stamp for example, awk works well from "16:00 to 17:30" but its not collecting <line*> "from 17:30 to 18:00" ... (8 Replies)
Discussion started by: zenkarthi
8 Replies

6. Shell Programming and Scripting

How to get time duration between two human readable time stamp in Unix?

Here is two time I have: Jul 12 16:02:01 Jul 13 01:02:01 and how can I do a simple match to get difference between two time which is 09:00:00 Thanks in advance. (3 Replies)
Discussion started by: ford99
3 Replies

7. Shell Programming and Scripting

Identify log files based on time stamp,zip and then copy..HELP

Hi All, PFB is a requirement. I am new to shell scripting. So plz help. It would be highly appreciated. 1. choose all the log files based on a particular date (files location is '/test/domain')--i.e,we should choose all the files that are modified on 29th November, neither 28th nor 30th 2.... (3 Replies)
Discussion started by: skdas_niladri
3 Replies

8. Shell Programming and Scripting

Remove lines of the same time stamp leaving the highest

Hi guys, I have a log that looks like that below. Columns 2 3 4 5 6 7 is the date/time stamp separated by comma. UUU,02,06,2010,10,00,00,00,0000000000000000,0000000000000000,0000000000001224 UUU,02,06,2010,10,05,00,00,0000000000000000,0000000000000000,0000000000001502... (2 Replies)
Discussion started by: borderblaster
2 Replies

9. Shell Programming and Scripting

Extract info from log file and compute using time date stamp

Looking for a shell script or a simple perl script . I am new to scripting and not very good at it . I have 2 directories . One of them holds a text file with list of files in it and the second one is a daily log which shows the file completion time. I need to co-relate both and make a report. ... (0 Replies)
Discussion started by: breez_drew
0 Replies

10. UNIX for Dummies Questions & Answers

Inserting Date&Time Stamp In Existing Log File

I am trying to insert a line with a date stamp in a file that is used to monitor activity in one of our directories. By doing this, I want to grep that file each day and go to the last entry for each time a error occurred and pull all errors generated if any exist. If error exists I want that error... (3 Replies)
Discussion started by: shephardfamily
3 Replies
Login or Register to Ask a Question