09-03-2009
It looks like an http apache access log. Wouldn't it be easier to change the log format and to use another character than space as separator?
Look for the CustomLog and LogFormat directive in the apache.conf config file.
Log Files - Apache HTTP Server
You can use tab as separator. It is easy to parse and to read on a console.
Have also a look at mod_log_sql module for apache
http://freshmeat.net/projects/mod_log_sql/
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
I am trying to check each line and based on first two digits, the comma needs to be place. I checked in the earlier post where the text is converted to csv with a tab delimited.
Here is the test file that needs to be changed to csv
11 051701
22 051701
330123405170105170112345... (13 Replies)
Discussion started by: gthokala
13 Replies
2. UNIX for Advanced & Expert Users
Hello All,
I have a sql report with 50 columns and 1000 rows result in a file ( txt / csv). is there is any way that we can move them to excel in KSH.
Thanks,
Sateesh (7 Replies)
Discussion started by: kotasateesh
7 Replies
3. Shell Programming and Scripting
Hi,
I have a document with a lot of data, it is structured like this,
UNIQUESTRING
To be acquited of a crime is to be deemed to be innocent of
the charges after a court hearing. This is different from a
<a href=lawglos_Discharge.html>Discharge</a>, where the case is never heard. In... (1 Reply)
Discussion started by: lawstudent
1 Replies
4. Shell Programming and Scripting
I was looking at a library that lets me parse comma delimited csv files without a problem, but unfortunately, I'm not allowed to make use of that library. I understand that the library probably does something similar to a string split(), but I don't quite know what kind of regular expression is... (1 Reply)
Discussion started by: mrwatkin
1 Replies
5. Shell Programming and Scripting
Thank u every body ......just need a help so that a text file needs to be converted into CSV.............
my log file is as follows
Host scsi3: usb-storage
Vendor: Maxtor
Product: OneTouch III
Serial Number: 044303E5
Protocol: Transparent SCSI
Transport: Bulk
... (4 Replies)
Discussion started by: tangotango
4 Replies
6. Shell Programming and Scripting
Hi Gurus
I need urgent help to convert a flat log file into csv format to load into database.
Log looks like:
a=1
b=2
c=3
a=4
b=5
c=6
Only the values at right side of = will come into csv and it should create a new line once it receives "a" field. (8 Replies)
Discussion started by: sandipjee
8 Replies
7. Shell Programming and Scripting
Hi Folks
Need some help with this and my Perl isnt the hottest I also have text::csv installed on my perl install
The large text with a few million entries is in a format below
example text file
Fig Leafs
Cake No: 0000001
Author: King s.
Record No: 995-34343-232-232... (5 Replies)
Discussion started by: messiah1
5 Replies
8. Shell Programming and Scripting
Gents,
I am trying to create a csv file using the file attached.
I have a problem to get all information required because the rows are not continues.
Here is my code till now.
awk ' /"ffid"/{if(s){print s;s=$NF}else{s=$NF}}
/"LineNumber"/{s=s $NF}
/"PointNumber"/{s=s $NF}... (4 Replies)
Discussion started by: jiam912
4 Replies
9. Shell Programming and Scripting
Gents,
Attached there is a input.txt and code.txt file.
I use that code to create a csv file from txt file.
Is there the possibility to generate other code more faster to generate the CVS file using the input file.
I have deleted many data in the input file to avoid load a lot data.
... (10 Replies)
Discussion started by: jiam912
10 Replies
10. Shell Programming and Scripting
Hi,
Is there somebody there to post an idea on how to convert this 5 liner row to 1 liner or tab delimiter to be import to database.
Here the text file format:
Description: Description1
Link: https://www.google.com
Date: June 2, 2018
Time: 00:07:44
Age: 1 days ago
Description:... (2 Replies)
Discussion started by: lxdorney
2 Replies
LEARN ABOUT DEBIAN
lire::firewall::ipfilterdlfconverter
IpfilterDlfConverter(3pm) LogReport's Lire Documentation IpfilterDlfConverter(3pm)
NAME
Lire::Firewall::IpfilterDlfConverter - convert ipf (ipmon) logs to firewall DLF
DESCRIPTION
Lire::Firewall::IpfilterDlfConverter converts Ipfilter logs into firewall DLF format. Input for this converter is the standard ipf syslog
log file as produced by ipmon. IP Filter is shipped with FreeBSD, OpenBSD (up to 2.9) and some other OS's.
EXAMPLE
A ipfilter logfile which looks like
Oct 30 07:42:29 rolle ipmon[16747]: 07:42:28.585962 ie0 @0:9
b 192.168.48.1,45085 -> 192.168.48.2,22 PR tcp len 20 64 -S OUT
Oct 30 07:40:24 rolle ipmon[16747]: 07:40:23.631307 ep1 @0:6
b 192.168.26.5,113 -> 192.168.26.1,3717 PR tcp len 20 40 -AR OUT
Oct 30 07:42:29 rolle ipmon[16747]: 07:42:28.585962 ie0 @0:9
b 192.168.48.1,45085 -> 192.168.48.2,22 PR tcp len 20 64 -S OUT
Oct 30 07:44:11 rolle ipmon[16747]: 07:44:10.605416 2x ep1 @0:15
b 192.168.26.1,138 -> 192.168.26.255,138 PR udp len 20 257 IN
Oct 30 07:44:34 rolle ipmon[16747]: 07:44:33.891869 ie0 @0:10
b 192.168.48.1,23406 -> 192.168.48.2,22 PR tcp len 20 64 -S OUT
Oct 30 07:49:13 rolle ipmon[16747]: 07:49:12.554420 ep1 @0:15
b 210.132.100.117 -> 192.168.26.5 PR icmp len 20 56 icmp 3/3 for
192.168.26.5,61915 - 210.132.100.117,53 PR udp len 20 23040 IN
Oct 30 07:50:23 rolle ipmon[16747]: 07:50:22.908107 ep1 @0:15
b 210.132.100.117 -> 192.168.26.5 PR icmp len 20 56 icmp 3/3 for
192.168.26.5,4480 - 210.132.100.117,53 PR udp len 20 19712 IN
Oct 30 07:56:11 rolle ipmon[16747]: 07:56:11.113029 2x ep1 @0:15
b 192.168.26.1,138 -> 192.168.26.255,138 PR udp len 20 257 IN
(that's: .... 'PR' protocol 'len' length_of_ip_headers_saved packetlength direction) will get converted to something like
994398737 denied igmp 100.187.115.1 - ep1 LIRE_NOTAVAIL
224.0.0.2 - 56
994398861 denied igmp 100.187.115.1 - ep1 LIRE_NOTAVAIL
224.0.0.1 - 56
994398862 denied igmp 100.187.115.1 - ep1 LIRE_NOTAVAIL
224.0.0.2 - 56
994406849 denied udp 192.168.26.4 137 ie0 LIRE_NOTAVAIL
192.168.26.255 137 116
994406850 denied udp 192.168.26.4 137 ie0 LIRE_NOTAVAIL
192.168.26.255 137 116
994406866 denied udp 192.168.26.4 137 ie0 LIRE_NOTAVAIL
192.168.26.255 137 98
SEE ALSO
ipl(4) for description of log structure.
The ipmon.c source (e.g. on
http://www.openbsd.org/cgi-bin/cvsweb/~checkout~/
src/usr.sbin/ipmon/Attic/ipmon.c?rev=1.27&
content-type=text/plain&hideattic=0
) for the specification of the log syntax.
The IP Filter webpage on http://coombs.anu.edu.au/~avalon/ip-filter.html
AUTHOR
Joost van Baal <joostvb@logreport.org>, Wessel Dankers <wsl@logreport.org>
VERSION
$Id: IpfilterDlfConverter.pm,v 1.7 2009/03/15 08:10:55 vanbaal Exp $
COPYRIGHT
Copyright (C) 2001-2003 Stichting LogReport Foundation LogReport@LogReport.org
This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by
the Free Software Foundation; either version 2 of the License, or (at your option) any later version.
This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.
You should have received a copy of the GNU General Public License along with this program (see COPYING); if not, check with
http://www.gnu.org/copyleft/gpl.html.
Lire 2.1.1 2009-03-15 IpfilterDlfConverter(3pm)