Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Searching for gaps in huge (2.2G) log file?
Operating Systems Linux Searching for gaps in huge (2.2G) log file? Post 94988 by rhfrommn on Thursday 5th of January 2006 11:19:08 AM
Old 01-05-2006
I have an idea, but I'm not much for scripting so I'll let you do that part. :-)

You could use awk to pick just the field with the timestamp in it. Then for each line subtract the timestamp from the next one. If the difference is greater than some number of minutes you choose output both lines to another file. That way you could use the (hopefully much smaller) secondary file to pinpoint exactly when the gaps occur.
 

9 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

help searching log file with dates

Im tyring to create a script that will show me any lines in a file with todays date and yesterdays, the date format in the file is as follows ----- amqxfdcx.c : 728 -------------------------------------------------------- 07/12/05 09:53:20 AMQ6109: An internal WebSphere MQ error has... (3 Replies)
Discussion started by: csaunders
3 Replies

2. Shell Programming and Scripting

searching a log file and appending to a .txt file

I'm new to shell scripting and am writing a script to help me log the free memory and hd space on a server. As of now, the script just runs 'df -h' and appends the output to a file and then runs 'top' and appends the output to a log file. What I want to do, is have the script also search the... (3 Replies)
Discussion started by: enator45
3 Replies

3. Shell Programming and Scripting

Searching for a string in a log file with little movement

I have a script which tails a log file and if it finds certain strings in the data tailed it sends an email, basically like this: tail -f logfile > tmp.file & sleep 10 kill $! STRING=$(grep -c "string" tmp.file) && echo $STRING | mailx -s "Warning.." admin@123.com When the string is... (10 Replies)
Discussion started by: Moxy
10 Replies

4. Shell Programming and Scripting

Searching for Gaps in Time

I am very new to shell scripting. We use C-Shell here and I know the issues that surround it. I hope a solution can be created using awk, sed, etc... instead of having to write a program. I have an input file that is sorted by date and time in ascending order ... (2 Replies)
Discussion started by: jclanc8
2 Replies

5. Shell Programming and Scripting

Searching for Log / Bad file and Reading and writing to a flat file

Need to develop a unix shell script for the below requirement and I need your assistance: 1) search for file.log and file.bad file in a directory and read them 2) pull out "Load_Start_Time", "Data_File_Name", "Error_Type" from log file 4) concatinate each row from bad file as... (3 Replies)
Discussion started by: mlpathir
3 Replies

6. Shell Programming and Scripting

Sorting and moving file sequence with gaps

Hello, I have lots of sequentially numbered files which make up an image sequence. I'm trying to do two things with it: #1: Find gaps in the sequence and move each range of sequencial files into their own subfolder. #2: Designate a starting point (file) and move every 24th file into... (4 Replies)
Discussion started by: ex_H
4 Replies

7. Shell Programming and Scripting

searching a file with a specified text without using conventional file searching commands

without using conventional file searching commands like find etc, is it possible to locate a file if i just know that the file that i'm searching for contains a particular text like "Hello world" or something? (5 Replies)
Discussion started by: arindamlive
5 Replies

8. Shell Programming and Scripting

Getting info from a huge log file

Hello everyone. I am having problem with parsing a data from the huge log file. the log file is an application log with around 5 Gb in size and it rotates every midnight. Now if the application encountered such issue, it sends an email with a specific info but without further details. So I... (13 Replies)
Discussion started by: cwiggler
13 Replies

9. UNIX for Dummies Questions & Answers

Gaps and frequencies

I have this infile: >GHL8OVD01BNNCA Freq 10 TAGATGTGCCCGTGGGTTTCCCGTCAACACCGGATAGT-GCAGCA-TA >GHL8OVD01CMQVT Freq 1 TTGATGTCGTGGGTTTCCCGTCAACACCGGCAAATAGT-GCAGCA-TA >GHL8OVD01CMQVT Freq 1 TTGATGTGCCAGTTTCCCGTCTAGCAGCACTACCAGGACCTTCGC-TA >GHL8OVD01CMQVW Freq 1... (1 Reply)
Discussion started by: Xterra
1 Replies

LEARN ABOUT XFREE86

syslog

SYSLOG(8)							  System Logging							 SYSLOG(8)

NAME

       syslog-ng, syslogd

DESCRIPTION

       There are different syslog daemon implementations supported as the system's syslog service, currently syslogd, syslog-ng and rsyslogd

       The  first  installed daemon activates itself for the syslog service. Starting with openSUSE-11.2, it is rsyslogd, before it was syslog-ng.
       But this depends on the software selection during the installation.

       The name of the daemon used as syslog service is specified in the
       SYSLOG_DAEMON variable in /etc/sysconfig/syslog.

       The yast2 sysconfig module provides a comfortable way to switch to another installed daemon and restart the service.

       The /etc/init.d/syslog init script is able to handle all supported daemons.

BUGS

       Please report bugs at <http://www.suse.de/feedback>

AUTHOR

       Juergen Weigert <jw@novell.com>
       Marius Tomaschewski <mt@novell.com>

SEE ALSO

       sysklogd(8) syslogd(8) syslog.conf(5) syslog-ng(8) syslog-ng.conf(5) rsyslogd(8) rsyslog.conf(5)

syslog								     May 2008								 SYSLOG(8)
All times are GMT -4. The time now is 04:36 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy