Extracting the last 10mins worth of data in a log file

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Extracting data from rsync log

Hi I have a daily rsync that runs and i am trying to find a easy way of extracting the start time and end time of the sync and extract the details of how much data was copied. I would like to use this information to see if i can increase the amount of rsyncs that run in a day. so the log...

2. Shell Programming and Scripting

Error while extracting data from log file

I am running awk command to extract data from log file to calculate last 15 minutes log using below command and now i am getting bellow error: awk '$0>=$from' from=$(`date -u +"####<%d-%b-%Y %H:%M:%S o'clock GMT>"-15min`) test.log Error: date: 0551-402 Invalid character in date/time...

3. Shell Programming and Scripting

Need Help in extracting data from XML File

Hi All My input file is an XML and it has some tags and data rows at end. Starting of data rows is <rs:data> and ending of data rows is </rs:data>. Within sample data rows (2 rows) shown below, I want to extract data value after equal to sign (until space or "/" sign). So if XML data...

4. Shell Programming and Scripting

Extracting Delimiter 'TAG' Data From log files

Hi I am trying to extract data from within a log file and output format to a new file for further manipulation can someone provide script to do this? For example I have a file as below and just want to extract all delimited variances of tag 32=* up to the delimiter "|" and output to a new file...

5. UNIX for Dummies Questions & Answers

Extracting data from file

I am trying to compare the data in lines 3 & 5 to see if they match up to the '-S570' (see first code set, all proprietary information has been removed from code set) spawn telnet Trying ... Connected to CA-LOS1234-ASE-S570.cl . Escape character is '^]'. CA-LOS1234-ASE-S570 Username: ...

6. Shell Programming and Scripting

Extracting specific lines of data from a file and related lines of data based on a grep value range?

Hi, I have one file, say file 1, that has data like below where 19900107 is the date, 19900107 12 144 129 0.7380047 19900108 12 168 129 0.3149017 19900109 12 192 129 3.2766666E-02 ...

7. Shell Programming and Scripting

Extracting data from a log file with date formats

Hello, I have a log file for the year, which contains lines starting with the data in the format of YYYY-MM-DD. I need to get all the lines that contain the DD being 04, how would I do this? I tried using grep "*-*04" but it didn't work. Any quick one liners I should know about? Thank you.

8. Shell Programming and Scripting

extracting data from a .csv file

I have a .csv file equipment,bandtype abc,aws def,mmds ghi,umts jkl,mmds I can get the equipment from `hostname`. In my script i want to check what is the hostname. then see if it exists in the.csv file. if it does then i want to store the second parameter(bandtype) for the corresponding...

9. Shell Programming and Scripting

How do i get only last 5 minute worth of data

I have a text file called 'tomcat_temp_out'. I want to get only last 5 minute worth of data from this file and redirect those data into another fule. Could you please help to work on this?

10. UNIX for Dummies Questions & Answers

Extracting Data from a File

Hi I need to calculate the number of occurrences of a item in a number of files using Perl. The item appears continually throughout the files but in each case I only want to calculate it in certain blocks of the file. Example - Calculalte the number of occurrences of a 'pass' in a block of...

LEARN ABOUT DEBIAN

canto-fetch

Canto-fetch(1)							    Canto-fetch 						    Canto-fetch(1)

NAME

       Canto-fetch - A quiet feed fetcher.

DESCRIPTION

       Canto-fetch  is	designed  to  be run through a cron job, every minute. Every time it's run, it checks the timestamp on each index file and
       updates the feed, if necessary. The format it produces is a simple UTF-8 encoded, NULL delimited text file on disk, readable by	the  canto
       client.

GETTING STARTED

       Canto-fetch is meant to be used through a cron, adding this line to your crontab will cause canto-fetch to poll every minute.

       * * * * * canto-fetch

       Alternatively,  if  you're unable/uncomfortable using cron, canto-fetch has a background daemon mode so you can invoke it in your X session
       scripts. Just use

       canto-fetch -b

USAGE

       These options correspond to options to the canto client.

       -h / --help
	      Print usage and quit.

       -v / --version
	      Print version and quit.

       -V / --verbose
	      Output status while updating.

       -d / --daemon
	      Continue to check for updates every minute. Mostly for debugging with -V, users probably want -b to background.

       -b / --background
	      Detach from the terminal (implies -d)

       -f / --force
	      Force updates on all feeds, ignoring timestamps.

       -s / --sysfp
	      Use feedparser on system instead of builtin copy.

       -C / --conf [PATH]
	      Set path to configuration file (default: ~/.canto/conf)

       -F / --fdir [PATH]
	      Set path to feed directory (default: ~/.canto/feeds/)

       -L / --log [PATH]
	      Set path to log (default: ~/.canto/fetchlog)

       -S / --sdir [PATH]
	      Set the path to execurl scripts (default ~/.canto/scripts/)

FILES

       ~/.canto/fetchlog
	      Canto-fetch log file.

       ~/.canto/feeds/
	      This is the directory where canto-fetch records stories.

BUGS

       None known, but it's not outside of the realm of possibility =P.

HOMEPAGE

       http://codezen.org/canto

AUTHOR

       Jack Miller <jack@codezen.org>

Version 0.7.10							   27 July 2010 						    Canto-fetch(1)

Shell Programming and Scripting