Sponsored Content
Top Forums UNIX for Dummies Questions & Answers Best approach for a 10 min extract out of several log files with timestamped records Post 89602 by Browser_ice on Monday 14th of November 2005 02:58:51 PM
Old 11-14-2005
Sample data

sample file to have 10 min extracted. It is the result of an fgrep done on several log files on specific keywords :

/export/home/..../filea.log:2005-11-14 12:01:03,999 xxxxxxxxxxxxxxx
/export/home/..../filea.log:2005-11-14 12:01:02,123 xxxxxxxxxxxxxxx
/export/home/..../filea.log:2005-11-14 12:01:01,345 xxxxxxxxxxxxxxx
...

The logs are live and therefore always updated.

Once I have the date-10min value, wouldn't it be possible to somehow get the line# of where the 10 min matches and have a command that only gets from the start up to that line# ?
 

10 More Discussions You Might Find Interesting

1. AIX

need to extract info from log files

hi guys i need to extract information from log files generated by an application. log file has the following lines for each process.. ---------------------------------------------- Fri Aug 03 12:06:43 WST 2007 INFO: Running project PROJECT1 Fri Aug 03 12:06:43 WST 2007 INFO: Source Files... (7 Replies)
Discussion started by: kirantalla
7 Replies

2. Shell Programming and Scripting

Need to Extract Data From 94000 records

i have a input file which does not have a delimiter All i Need to do is to identify a line and extract the data from it and run the loop again and need to ensure that it was not extracted earlier Input file ------------ abcd 12345 egfhijk ip 192.168.0.1 CNN.com abcd 12345 egfhijk ip... (12 Replies)
Discussion started by: vasimm
12 Replies

3. Shell Programming and Scripting

Compare Records between to files and extract it

I am not an expert in awk, SED, etc... but I really hope there is a way to do this, because I don't want to have to right a program. I am using C shell. FILE 1 FILE 2 H0000000 H0000000 MA1 MA1 CA1DDDDDD CA1AAAAAA MA2 ... (2 Replies)
Discussion started by: jclanc8
2 Replies

4. Shell Programming and Scripting

Creating timestamped directories/files in expect

Hi, I am looking for the syntax to provide a timestamped log_file in expect. Basically I want the equivalent of: /outputs/`date +%d%m%y`/session`date +%H%M` But scripted in expect so it can be handed over to the logfile function. I have tried playing around with the timestamp... (1 Reply)
Discussion started by: krypton
1 Replies

5. Shell Programming and Scripting

Compare two files with different number of records and output only the Extra records from file1

Hi Freinds , I have 2 files . File 1 |nag|HYd|1|Che |esw|Gun|2|hyd |pra|bhe|3|hyd |omu|hei|4|bnsj |uer|oeri|5|uery File 2 |nag|HYd|1|Che |esw|Gun|2|hyd |uer|oi|3|uery output : (9 Replies)
Discussion started by: i150371485
9 Replies

6. Shell Programming and Scripting

Extract records from list

Hi Gents, I have a file 1 like this 1 1000 20 2 2000 30 3 1000 40 5 1000 50 And I have other file 1 like 2 1 I would like to get from the file 1 the complete line which are in file 2, the key to compare is the column 2 then output should be. 2 2000 30. I was trying to get it... (5 Replies)
Discussion started by: jiam912
5 Replies

7. Shell Programming and Scripting

Can you extract (remove) lines from log files?

I use "MineOS" (a linux distro with python scripts and web ui included for managing a Minecraft Server). The author of the scripts is currently having a problem with the Minecraft server log file being spammed with certain entries. He's working on clearing up the spam. But in the meantime, I'm... (8 Replies)
Discussion started by: nbsparks
8 Replies

8. Shell Programming and Scripting

Extract lines with min value, using two field separators.

I have a file with two ID columns followed by five columns of counts in fraction form. I'd like to print lines that have a count of at least 4 (so at least 4 in the numerator, e.g. 4/17) in at least one of the five columns. Input file: comp51820_c1_seq1 693 0/29 0/50 0/69 0/36 0/31... (6 Replies)
Discussion started by: pathunkathunk
6 Replies

9. Shell Programming and Scripting

How to extract part of string from all log files.?

Hi All, Let us say we have 5 log files, extract the data from all log files and save the output in a file. home/log/first.log home/log/second.log home/log/third.log home/log/four.log home/log/five.log I want to extract the following text from the log files and save the output in a file.... (7 Replies)
Discussion started by: ROCK_PLSQL
7 Replies

10. UNIX for Beginners Questions & Answers

Extract lines if string found from last 30 min only

Hi guys, Appreciate your help as I am stuck with searching the logs for last 30 minutes from the current time. Current time is time when you execute the script and it will search for <string> through the logs for last 30 minutes only and if <string> found then print those lines only. The... (18 Replies)
Discussion started by: rockstar
18 Replies
AMTOC(8)						  System Administration Commands						  AMTOC(8)

NAME
amtoc - generate TOC (Table Of Contents) for an Amanda run SYNOPSIS
amtoc [-a] [-i] [-t] [-f file] [-s subs] [-w] [--] logfile DESCRIPTION
Amtoc generates a table of contents for an Amanda run. It's a perl script (if you don't have perl, install it first!). OPTIONS
-a The output file name will be label-of-the-tape.toc in the same directory as logfile. -i Display help about amtoc. -t Generate the output in tabular form. -f file Write the output to a file ('-' for stdout). -s subs Evaluate the output file name from subs, with $_ set to label-of-the-tape. The -a option is equivalent to -s 's/$_/.toc/'. -w Separate tapes with form-feeds and display blank lines before totals. -- Marks the last option so the next parameter is the logfile. logfile (use '-' for stdin) OUTPUT FORMAT
The standard output has five fields separated by two spaces: # Server:/partition date level size[Kb] 0 daily-05: 19991005 - - 1 cuisun15:/cuisun15/home 19991005 1 96 2 cuinfs:/export/dentiste 19991005 1 96 ... 103 cuisg11:/ 19991005 0 4139136 103 total: - - 16716288 In tabular format (-t), this would look like: # Server:/partition date lev size[Kb] 0 daily-05: 19991005 - - 1 cuisun15:/cuisun15/home 19991005 1 96 2 cuinfs:/export/dentiste 19991005 1 96 ... 103 cuisg11:/ 19991005 0 4139136 103 total: - - 16716288 USAGE
The easiest way to use it is to run amtoc right after amdump in the cron job: amdump daily ; logdir=`amgetconf daily logdir` ; log=`ls -1t $logdir/log.*.[0-9] | head -1` ; amtoc -a $log which will generate /usr/local/etc/amanda//daily/tape_label.toc. You may also want to call amtoc after an amflush. SEE ALSO
amanda(8), amdump(8), amflush(8), amgetconf(8) The Amanda Wiki: : http://wiki.zmanda.com/ AUTHORS
Nicolas Mayencourt <Nicolas.Mayencourt@cui.unige.ch> University of Geneva/Switzerland Stefan G. Weichinger <sgw@amanda.org> Amanda 3.3.3 01/10/2013 AMTOC(8)
All times are GMT -4. The time now is 05:15 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy