How to get the Logs between two Time Stamps?


 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting How to get the Logs between two Time Stamps?
# 1  
Old 01-10-2015
Display How to get the Logs between two Time Stamps?

Hi,

I have been working on the error Log script, where errors are pulled from server.

I need to pull the data of the error logs between two dates & time, for example :
22/12/2014 20:00:00
22/12/2014 22:00:00

Whatever error have came during this duration.
Now the question is the record which is stored in the path is having data as "Timestamp" keyword and i need to enter two time stamp, which will generate 2 files, i need the data between the duration.
# 2  
Old 01-10-2015
Please show us a sample of the logs, give us sample starting and ending periods, and show us the output that should be produced from that input. Without seeing how timestamps are formatted in your logs and you telling us how we know which log entries are "errors" and which log entries are non-error log entries, we have little chance of guessing how to get you what you want.
# 3  
Old 01-10-2015
Hi,

The code which is used to generate the logs is :


Code:
searchTerm="Application Code:"

tomcatServerList=("nt-fdsi-005513")
timestamp =$( date %H+%M+%S)
fileName=xyz_"$timestamp".txt

for i in "${tomcatServerList[@]}"
do
	logList=( `find /net/default.log*  -mtime -1` )
	for j in "${logList[@]}"
	do
		IFS=$'\n'
		resultsList=( "${resultsList[@]}" `grep -A2 "$searchTerm" $j| sed '/--/d'|grep -v "$searchTerm"`)
		
	done
done



* This code is generating data for last 24 hours, i need get the logs for definite time duration, upon user input. And input sample is like :
Code:
22-12-2014 22:00:00
22-12-2014 23:42:00

It would be helpful if you can suggest some thing, if you require anything else let me know.

Last edited by Don Cragun; 01-10-2015 at 03:46 PM.. Reason: Add CODE tags.
# 4  
Old 01-10-2015
This code is not generating any output. Please post actual starting and ending period log samples.

Using a sortable date (eg: 2014-12-22) might also help.
# 5  
Old 01-10-2015
I mostly agree with jlliagre. The code that you showed us will NOT produce any log files. It will, however, generate diagnostic output from the unknown command timestamp, from the invalid format string argument passed to the date command, or both. (But, if you ignore the diagnostics, it might not matter because $timestamp is never used.)

And, since $i is never used and there is exactly one element in the array tomcatServerList[], the outer for loop in this script can be removed with no change in the acton of the inner for loop.

If you're unwilling to show us a (possibly sanitized) example of the data you're trying to process, we can't help you.
# 6  
Old 01-12-2015
Hi,

I need to input 2 dates & time and get the log based on the time, i am able to get the logs for 24 hours using "mtime-1" for the file say xLOG in a directory.

I just need a code to get between two time periods


The sample Logs are stored in this time format:-
Timestamp: Mon Jan 12 01:59:53 EST 2015
# 7  
Old 01-12-2015
You have been asked to provide a sample of a log file to be processed three times. You have repeatedly ignored that request. This thread is closed.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Windows & DOS: Issues & Discussions

Cygwin_openssh time stamps

I've installed cygwin_openssh on Windows 2012 R2 and it's working great. My issue is when a file is uploaded say from a different timezone, when it is uploaded, it doesnt pick up the sftp servers time.. Is there a way to fix that? i.e. When someone in PST uploads a file to this server in EST,... (0 Replies)
Discussion started by: MikeAdkins
0 Replies

2. Shell Programming and Scripting

Collecting logs between two time stamps

Hi, please help me to collect the entire log files between two time stamp. for example, I am looking script to collect the entire log between "2015-03-27 15:59" to "2015-03-27 16:15" in the below sample log file. OS : RHEL 6.3 Date/Time : 24 hours format, the time is printing each log... (12 Replies)
Discussion started by: jerryknj
12 Replies

3. Shell Programming and Scripting

Increment time stamps.

Hi Gents. Please can you help me to solve a problem. I have a long list of files, which I need to change the time stamp. -r--r--r-- 1 geo2 geovect 47096216 Feb 8 10:40 00000009.segd -r--r--r-- 1 geo2 geovect 47096216 Feb 8 10:40 00000010.segd -r--r--r-- 1 geo2 geovect 47096216 Feb ... (11 Replies)
Discussion started by: jiam912
11 Replies

4. Shell Programming and Scripting

date time stamps in bash

I'm looking for a way to have the "date" command output the date in a specific format. I'm not familiar with the different ways to use the date command at all. i read up on it, but i dont get how to manipulate it. i know that i can get the date format to give me a format like: 2012-10-13... (6 Replies)
Discussion started by: SkySmart
6 Replies

5. Shell Programming and Scripting

Time difference between two time stamps

Hi Friends, I have 2 varaibles which contain START=`date '+ %m/%d/%y %H:%M:%S'` END=`date '+ %m/%d/%y %H:%M:%S'` i want the time difference between the two variables in Seconds. Plz help. (2 Replies)
Discussion started by: i150371485
2 Replies

6. Shell Programming and Scripting

Perl - Search file between two time stamps

Hi, I am on a windows system that receives files from differnet host, I have to find the count of files that we receive between specific time. The code below is what i use to count the number of file, how do i change this to count files between specfic time opendir ( DIR, $dir ) || die... (1 Reply)
Discussion started by: amit1_x
1 Replies

7. Shell Programming and Scripting

comparing time stamps

Hello All, I'm generating timestamps (file creation timestamps) for all the files in a directory. I need to compare all the timestamps. for example if i have 4 files and their timestamps are 20091125114556, 20091125114556,20091125114556,20091125114556 respectively. I need to differentiate... (9 Replies)
Discussion started by: RSC1985
9 Replies

8. UNIX for Dummies Questions & Answers

comparing time stamps

Hello All, I'm generating timestamps (file creation timestamps) for all the files in a directory. I need to compare all the timestamps. for example if i have 4 files and their timestamps are 20091125114556, 20091125114556,20091125114556,20091125114556 respectively. I need to differentiate... (1 Reply)
Discussion started by: RSC1985
1 Replies

9. UNIX for Dummies Questions & Answers

Problem with subtracting time stamps in excel..

Hi All, I need an unix script/command to delete the milliseconds from the time stamps so that it becomes compatible with Excel sheet while displaying finally. I have the following data in 2 columns which was obtained with some unix script(awk based) on some log files. Finally i want to... (1 Reply)
Discussion started by: ks_reddy
1 Replies

10. UNIX for Dummies Questions & Answers

List files with date and time stamps only

Hi there, I'm using terminal on mac and using the ls -l command to list all the files in a directory. However, I only want to display the date and time stamp of each file rather than permissions, owner, group etc... Is this possible? Many thanks in advance Dave (2 Replies)
Discussion started by: davewg
2 Replies
Login or Register to Ask a Question

Featured Tech Videos