perl script to filter logfile Post: 27414

Sponsored Content

Top Forums Shell Programming and Scripting perl script to filter logfile Post 27414 by auswipe on Friday 30th of August 2002 04:14:39 PM

08-30-2002

Registered User

Re: perl script to filter logfile

Quote:

Originally posted by norsk hedensk
i was wondering if anyone can help me, how could i write in perl a a script that would look through a log file and print onscreen the contents of the log file excluding lines that contain '192.168.1.' and entries that contain directory paths that arent in the directory /usr/local/httpd/htdocs/ i have no expierience in perl. what i want to do is this, i want to be able to run this script to view one log file, the access_log in /var/log/httpd/ at first i would do this with 'grep -v 192.168.1. access_log that works to get rid of my internal network hits, but im tired of havintg to sift through all the people with port scanners hits on my server, most of the traffic on the site is just people running port scanners on my ip block. so if anyone can help i would apreaciate it alot, also i am thinking that this will start me off learning perl. if more info is needed i will gladly provide, thanks alot!

Actually, you can do this with a piped grep command if I am following you correctly.

How about this?

Code:

grep -v "192.168.1" access_log | grep -v "/usr/local/httpd/htdocs/" | less

auswipe

View Public Profile for auswipe

Find all posts by auswipe

8 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Script to manipulate logfile text

Hi guys, I was wandering if a Shell guru could give me some advice on tackling a problem. I have used a mixture of grep, cut and awk to get data from a log file in the following format: 14/11/08 10:39: Checking currenly : Enabled 14/11/08 10:39: Records allocated : 221...

2. Shell Programming and Scripting

Attaching a logfile to the Script

Hello guys. I've recently written a basic utilities script just for home use. and i want to attach a logfile to it that will record all the commands that where executed in that script. Then just so i can add the d%b%y% and make each logfile unique and i can look back in each logfile to see what i...

3. Shell Programming and Scripting

Logfile rotation script.

I'm trying to find or create a Perl script that: Checks for and creates these files: notes notes.1 notes.2 notes.3 notes.4 The first represents the current log file and the others are older versions. Each time the script runs it would check for the existence of notes.3 and, if it exists,...

4. Shell Programming and Scripting

Logfile monitor script

Hi, I'm trying to write a logfile monitor script that reads the logfile and then emails out once there is an error with SQL in. Here is my attempt below which does not work. I'm not much of a scripter as you can probably see but some pointers in the right direction would be much appreciated. ...

5. Shell Programming and Scripting

Unable to create logfile with local time stamp using perl

Hello All, Morning, I am facing problem with my code while creating a log with name as current time stamp using perl. Here is the code. #!/usr/bin/perl my $time=localtime; my ($day,$month,$date,$tm,$year)=split(/ /,$time); my $stamp=$year."_".$month."_".$date; my...

6. UNIX for Dummies Questions & Answers

perl filter unique and concatenate

Hi experts, I have some input like below, TEST A function W TEST A function X TEST B function Y TEST C function Z TEST C function ZY i would like to have below output, TEST A function W&X TEST B function Y TEST C function Z&ZY Please kindly help on this, i am cracking my head...

7. Shell Programming and Scripting

Perl script to filter the string

Hi folks, I have a log file with the lines in the below format. Jul 1 23:00:51 10.212.3.251 SS: %SYS-7-CLI_SCHEDULE: some error occured I want to split the line based on the " %SYS-7-CLI_SCHEDULE: " value. The criteria is the should store the word that starts with % i.e., ...

8. Shell Programming and Scripting

Logfile monitoring with logfile replacement

Bonjour, I've wrote a script to monitor a logfile in realtime. It is working almost perfeclty except for two things. The script use the following technique : tail -fn0 $logfile | \ while read line ; do ... some stuff done First one, I'd like a way to end the monitoring script if a...

LEARN ABOUT DEBIAN

build-lives-rfx-plugin

build-lives-rfx-plugin(1)				      General Commands Manual					 build-lives-rfx-plugin(1)

NAME

       build-lives-rfx-plugin - builds rendered effects for LiVES

SYNOPSIS

       build-lives-rfx-plugin script_name [plugin_dir] -get section file

DESCRIPTION

       This perl script is used by LiVES to compile an RFX (rendered effect) plugin for LiVES. It is generally called from build-lives-rfx-plugin-
       multi for a script which has a language code representing LiVES-perl. The script_name must be  the  full  (absolute)  path  to  the  plugin
       script,	and  plugin_dir  can  be  used to specify the output directory where the compiled plugin should be generated. If plugin_dir is not
       defined then /tmp is assumed.

       The second variant with -get is used to print out a script section from a plugin script to stdout. It is generally only used internally	by
       LiVES.

       Return values The script returns the following values

       0 - success 1 - the value of a trigger was greater than the number of parameters 2 - a value could not be read from the script file 3 - the
       language code of the plugin script was not equivalent to LiVES-perl 4 - the API version level of the plugin script  was	invalid  5  -  the
       <define> section was missing from the plugin script

SEE ALSO

       build-lives-rfx-plugin-multi(1), lives(1)

AUTHOR

       Gabriel Finch a.k.a Salsaman (salsaman@xs4all.nl)

								    May 9 2010						 build-lives-rfx-plugin(1)