Sponsored Content
Full Discussion: Extract a value from log
Top Forums Shell Programming and Scripting Extract a value from log Post 302533880 by ctsgnb on Saturday 25th of June 2011 08:39:38 AM
Old 06-25-2011
please post an example of your input as well as an example of the output you need

---------- Post updated at 02:39 PM ---------- Previous update was at 02:36 PM ----------

Code:
$ cat logfile
130.37.129.78 - - [25/Jun/2011:12:35:07 +0000] "GET /ganglia/graph.php?m=load_one&z=small&c=cluster1&h=xen02.das3.cs.vu.nl&l=e2ecff&v=0.00&x=0.22&n=0&r=hour&su=1 &st=1309005296 HTTP/1.0" 200 6818 "http://130.37.197.12/ganglia/index.php" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0) Gecko/20100101 Firefox/5.0" request:0.265
130.37.129.78 - - [25/Jun/2011:12:35:07 +0000] "GET /ganglia/graph.php?m=load_one&z=small&c=cluster1&h=xen02.das3.cs.vu.nl&l=e2ecff&v=0.00&x=0.22&n=0&r=hour&su=1 &st=1309005296 HTTP/1.0" 200 6818 "http://130.37.197.12/ganglia/index.php" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0) Gecko/20100101 Firefox/5.0" request:0.857
130.37.129.78 - - [25/Jun/2011:12:35:07 +0000] "GET /ganglia/graph.php?m=load_one&z=small&c=cluster1&h=xen02.das3.cs.vu.nl&l=e2ecff&v=0.00&x=0.22&n=0&r=hour&su=1 &st=1309005296 HTTP/1.0" 200 6818 "http://130.37.197.12/ganglia/index.php" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:5.0) Gecko/20100101 Firefox/5.0" request:0.376
$ awk -F: '{print $NF}' logfile
0.265
0.857
0.376
$

 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

extract a portion of log file

hello, I want to grep the log file according to time and get the portion of log from one particular time to other. I can grep for individual lines by time but how should I print lines continuously from given start time till end till given end time. Appreciate your ideas, Thanks chandra (8 Replies)
Discussion started by: chandra004
8 Replies

2. AIX

need to extract info from log files

hi guys i need to extract information from log files generated by an application. log file has the following lines for each process.. ---------------------------------------------- Fri Aug 03 12:06:43 WST 2007 INFO: Running project PROJECT1 Fri Aug 03 12:06:43 WST 2007 INFO: Source Files... (7 Replies)
Discussion started by: kirantalla
7 Replies

3. Shell Programming and Scripting

Help: Log data extract

So I got this old webapp doing some strange format with its logging and I need to extract only specific parts. Basically the format of the log goes: Date:<space>timestamp User:<space>userid AppID:<space>applicationid Duration:<space>time(ms) <line> <line> Date:<space>timestamp... (1 Reply)
Discussion started by: kenm0j0
1 Replies

4. Shell Programming and Scripting

How to extract last week data from a log

HI, I have a log file (sync.log) in the following format. 05-14 05:34:56 INFO Hxxx Start: Id:xxx 05-14 05:45:32 INFO Hxxx End: Id:xxxx 05-19 11:23:21 INFO Hxxx Start: Id:xxx 05-19 11:34:45 INFO Hxxx End: Id:xxxx 05-20 02:09:47 INFO Hxxx Start: Id:xxx 05-20 02:36:03 INFO Hxxx End: Id:xxx... (5 Replies)
Discussion started by: praveenvi
5 Replies

5. Shell Programming and Scripting

How to extract certain part of log file?

Hi there, I'm having some problem with UNIX scripting (ksh), perhaps somebody can help me out? For example: ------------ Sample content of my log file (text file): -------------------------------------- File1: .... info_1 ... info_2 ... info_3 ... File2: .... info_1 ... info_2 ...... (10 Replies)
Discussion started by: superHonda123
10 Replies

6. Shell Programming and Scripting

Extract various information from a log file

Hye ShamRock If you can help me with this difficult task for me then it will save my day Logs : ================================================================================================================== ... (4 Replies)
Discussion started by: SilvesterJ
4 Replies

7. Shell Programming and Scripting

Extract all ERROR's on LOG File

Hello, As I am still in trouble to easly extract all error's by date in log file, I am deply requesting your help ... Here is an example of one error (the log file may contain a huge amont of error's, I must be able to extract all error for a day in parameter): ***** L1 FILE... (4 Replies)
Discussion started by: Aswex
4 Replies

8. Shell Programming and Scripting

Extract IP Address from Log File

I have a log file with several IP addresses in it:- 2012-12-06 16:05:05,885 NOTICE **SNMP** Alarm was created: (LicenseClientRejected) Client Remote Peer /125.111.64.125:2573 was Rejected Property=/125.111.64.125:2573, Client Remote Peer /125.111.64.125:2573 was Rejected **SNMP**.... (5 Replies)
Discussion started by: BHM
5 Replies

9. UNIX for Dummies Questions & Answers

Extract Numbers from a log file

Hi, I am trying to grep/extract the number list from this log file, can I get some help on this. I can grep the word 'href' to see the numbers, but it is resulting with the complete line. Content of my file: <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2 Final//EN"> <html> <head>... (4 Replies)
Discussion started by: Sajjadmehdi
4 Replies

10. Shell Programming and Scripting

Extract data from log

I have logs in format ####<01-Mar-2015 03:48:18 o'clock GMT> <info> ####<01-Mar-2015 03:48:20 o'clock GMT> <info> ####<01-Mar-2015 03:48:30 o'clock GMT> <info> ####<01-Mar-2015 03:48:39 o'clock GMT> <info> I am looking out for a script which can extract data of last 15 minutes from the... (5 Replies)
Discussion started by: oberoi1403
5 Replies
ipv6loganon(8)															    ipv6loganon(8)

NAME
ipv6loganon - HTTP server log file anonymizer SYNOPSIS
ipv6loganon [ -d value ] [ -V ] [ -n ] [ -c value ] [ --mask-ipv4 bits ] [ --no-mask-iid ] [ --anonymize-standard ] DESCRIPTION
ipv6loganon is a HTTP server log file anonymizer It expects a log line on stdin with an IPv4/IPv6 address as first token. This token would be anonymized according to given/default options. The anonymizer would keep as much information as possible for IPv6 address types. Client-side IID would be anonymized by o EUI-48 based: serial number would be zero'ed, keeping OID o EUI-64 based: serial number would be zero'ed, keeping OID o ISATAP: client IPv4 address would be anonymized by given IPv4 mask o TEREDO: client IPv4 address would be anonymized by given IPv4 mask, client port would be zero'ed o 6to4(Microsoft): client IPv4 address would be anonymized by given IPv4 mask o local: whole IID would be zero'ed Client-side SLA would be anonymized by o SLA would be zero'ed Prefix would be anonymized by o 6to4: client IPv4 address would be anonymized by given IPv4 mask Compat/Mapped IPv4 addresses would be anonymized by o IPv4 address would be anonymized by given IPv4 mask Afterwards, the modified address and the trailing line would be printed to stdout. OPTIONS
GENERAL -d, --debug <debug value> debug value (bitwise like) -V, --verbose be verbose -n, --nocache disable caching -c, --cachelimit set cache limit (default: 20, maximum: 200) OUTPUT ANONYMIZATION --mask-ipv4 <bits> mask all IPv4 addresses [0-32], default 8 even if occurs in IPv6-IID --no-mask-iid do not mask non-IPv4 based IPv6-IID --anonymize-standard preset for standard anonymization Default settings: mask-ipv4=8 mask-iid EXAMPLE
Original lines (stdin): 207.46.98.53 - - [01/Jan/2007:00:01:15 +0100] "GET /Linux+IPv6-HOWTO/x1112.html HTTP/1.0" 200 6162 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)" 253 6334 2002:52b6:6b01:1:216:17ff:fe01:2345 - - [10/Jan/2007:15:04:28 +0100] "GET /favicon.ico HTTP/1.1" 200 4710 "http://www.bieringer.de/linux/IPv6/" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.9) Gecko/20061219 Fedora/1.5.0.9-1.fc6 Fire- fox/1.5.0.9 pango-text" 413 5005 Modified lines (stdout): 207.46.98.0 - - [01/Jan/2007:00:01:15 +0100] "GET /Linux+IPv6-HOWTO/x1112.html HTTP/1.0" 200 6162 "-" "msnbot/1.0 (+http://search.msn.com/msnbot.htm)" 253 6334 2002:52b6:6b00:0:216:17ff:fe00:0 - - [10/Jan/2007:15:04:28 +0100] "GET /favicon.ico HTTP/1.1" 200 4710 "http://www.bieringer.de/linux/IPv6/" "Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.8.0.9) Gecko/20061219 Fedora/1.5.0.9-1.fc6 Fire- fox/1.5.0.9 pango-text" 413 5005 AUTHORS
Peter Bieringer <pb@bieringer.de> SEE ALSO
ipv6calc(8) Niko Tyni <;ntyni@iki.fi> 2007-02-01 ipv6loganon(8)
All times are GMT -4. The time now is 04:41 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy