clfsplit(1) logtools clfsplit(1)NAME
clfsplit - split Common-Log Format web logs based on IP address
SYNOPSIS
clfsplit [--help] [-i input] -d defaultfile -f file -s spec [-f file -s spec]
DESCRIPTION
The clfsplit will split up large CLF format web logs based on IP address. This is for creating separate log analysis passes for internal
and external users of web pages.
OVERVIEW
The defaultfile parameter specifies where data goes if it doesn't match any of the IP ranges. This could be /dev/null depending on your
aims.
The -i input parameter gives the file to take input from (default standard input).
The -f file parameter must be given before the list of IP addresses.
The spec parameter is the IP addresses that go to the file in question. It is of the form start[-end][:start[-end]] where start and end
specify the start and ends of ranges of IPs. Also the CIDR notation can be used or a single IP address. If there is a large number of IP
ranges then a file name can be given which contains a set of IP ranges, one range per line.
EXIT STATUS
0 No errors
1 Bad parameters
2 Can't open input
3 Can't open/write to output file
4 Can't open and read from spec file
AUTHOR
This program, its manual page, and the Debian package were written by Russell Coker <russell@coker.com.au>.
SEE ALSO clfmerge(1),clfdomainsplit(1)Russell Coker <;russell@coker.com.au> 0.06 clfsplit(1)
Check Out this Related Man Page
logprn(1) logtools logprn(1)NAME
logprn - merge Common-Log Format web logs based on time-stamps
SYNOPSIS
logprn logfile idle-time[:max-wait] command
DESCRIPTION
The logprn program is designed to print new data that is appended to log files. It will wait until a specified amount of time has elapsed
since the last write to the file before printing the data. It will print the data by pipeing it to a specified command. The command will
be run by popen(3) so the usual shell commands will operate (whether this is a bug or a feature is a matter of opinion).
OPTIONS
logfile
specifies a file to read data from. It should be a regular file not a pipe, device, or anything else.
idle-time
max-wait
command
EXIT STATUS
0 Never happens, this program will run forever.
1 Bad command-line parameters or couldn't stat the log file on startup - couldn't start the program.
2 File disappeared or became unreadable at run-time.
3 Can't run the specified command.
AUTHOR
This program, its manual page, and the Debian package were written by Russell Coker <russell@coker.com.au>.
BUGS
Uses popen (3) but I consider this a feature not a bug.
SEE ALSO popen(3)Russell Coker <;russell@coker.com.au> 0.06 logprn(1)
Okay, absolute newbie here...
I'm on a Mac trying to split an almost 2 Gig log file on a Unix box into manageable chunks for my web-based log analysis tool.
What do I need to do, what programs do I need to do it?
All and any help appreciated/needed :-)
Cheers (8 Replies)
Hi All,
Can't find any documentation on the web for this anywhere, except about three web pages that are in Chinese.
When I enter SMIT on this box, I get
ERROR MESSAGE: Unable to open temp file
I suspected smit.log, but it is universal readable, writeable by root, and I am root.... (6 Replies)
Hello everybody,
I'm coding a network program and i need it to "understand" ip ranges, but i don't know how to make to parse an IP CIDR range, let's say "172.16.10.0/24" to work with the specified IP range.
I've found a program which does it, but i don't understand the code. Here is the... (3 Replies)
Hi All,
The developers want me to search and capture the weblogic log, you know this big logs of htmls.
They want to me to have ranges on the date and time. Like
from "2010-01-20 14:04:46,186" to "2010-01-20 15:00:12,490"
I can only do this,
cat /usr/local/bea/logs_prod1/debug.log |... (1 Reply)
Hi All,
The developers want me to search and capture the weblogic log, you know this big logs of htmls.
They want to me to have ranges on the date and time. Like
from "2010-01-20 14:04:46,186" to "2010-01-20 15:00:12,490"
I can only do this,
cat /usr/local/bea/logs_prod1/debug.log... (1 Reply)
I am trying to find a script that will generate all the ip addresses in particular range.
Example: start: 41.0.0.0 end ip 41.1.1.2
32.32.35.3 to 32.32.36.0
Please help.
Thanks (9 Replies)
I'm looking for good web log analysis software for 95% Apache / 5% IIS logs. There's a lot out there, but our needs are unusual. We're a web hosting company with a large number of VPS servers. For a variety of reasons, we like to develop models of virtual server activity. Among other things,... (1 Reply)
Im completely new to programming and dont really know much about it. I want to start learning about Web Development but i have no idea where to start. Any suggestions? (3 Replies)
Please pardon my ignorance, but I need to create a web-based form which can be used to request access to the unix servers in our environment. It just needs to have input fields for basic info (name, dept., etc.), and perhaps a drop-down box with the names of the servers. The form will be submitted... (2 Replies)
Hi.,
I need transfer as parameter into shell script some spec. characters, for example " or ' or & or \ at the end of second parameter. (this parameter used as changed password).
How I can transfer it into shell script.
Thanks Staas,. (5 Replies)
Hello,
I'm trying to find an nice solution for the following:
1) I have ranges of numbers (begin-end): 10-15, 20-30, 45-50
2) I have begin limit=0 and end limit=60.
3) I need to find out number ranges between begin limit and end limit that do not overlap with the ranges in item1.
In this... (6 Replies)
Hi Team,
My requirement is to get the details from a file or DB (sources) and post it on a web address from where users can see latest data.
Please help me in following :
1. How to create a web address that could be shared to multiple users.
2. How to post the this data on that web address... (5 Replies)
Hi UNIX Members,
I've been tasked with performing the following:
Extract a block of data in column form
#This data changes each time, therefore automating future procedures
Please Note the following:
line = reading a line from a file_list that leads to the data
The filename is called... (16 Replies)
I need write a Korn shell which accept input parameter. But this input paramter must match one of the string in an existsing file (listkeyword). Can someone one help, how this can be done ? (3 Replies)
I have a file which looks something as following, I would like to split to several files, The start and end of each file is 'FILE' and end with 'ASCII... ' .
At the same time for each file in the first column add 100 and also second column add 100 the rest of the column as it is , see example of... (2 Replies)