Sponsored Content
Top Forums Shell Programming and Scripting shell scripts that parse log files Post 302097081 by trueman82 on Tuesday 21st of November 2006 12:49:58 PM
Old 11-21-2006
shell script that look through the contents of logfiles

hi there,thanks for your replies.

What i meant to say was I need a shell script that look through the contents of multiple logfiles to locate anomolies, system attacks and faults.

Furthermore to be able to report via email the list of entries that do not match list of acceptable log entries.

Im more interested in the first part but if u can also do the second part,Your help would be highly appreciated.
Thanks.
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

How to parse large numbers of shell scripts

I am trying to parse hundreds of shell scripts to determine how they related to each other. Ideally for every script, I would get an output of: What other scripts it calls What files it reads Environment variables it accesses Any ideas on how to do this? TIA! (2 Replies)
Discussion started by: bliss
2 Replies

2. Shell Programming and Scripting

Creating Log files from Scripts

Hi I would like to create a log file to track the execution of my script. Example, if there were any errors, if it passed or failed etc. How do I go about doing this. My log file will be saved to this location: /var/log/import.log How do I specify the directory? I have been... (1 Reply)
Discussion started by: ladyAnne
1 Replies

3. Shell Programming and Scripting

Help to create a script to parse log files

Hello everybody, I need some help here to create a script to parse a log file. Here is a sample of the log file : 0x42258940 (Debug) Cache SUMMARY attrs now/668 min/668 max/668. 0x42258940 (Debug) RSVD SUMMARY reserved space max requested/128 MB accounted now/0 MB 0x42258940 (Debug)... (12 Replies)
Discussion started by: Samb95
12 Replies

4. UNIX for Dummies Questions & Answers

How can i parse my Unix log files??

Hello, i would like to parse Unix log files and i would like to use a Unix syslog analyzer. I'm going to use Eucalyptus and i would like to parse its log files. Is there any open source/free syslog parser?? Thanks, in advance! (2 Replies)
Discussion started by: g_p
2 Replies

5. Shell Programming and Scripting

Help for shell scripts for moving all files from one directory to another

Hi , Can you please check this code .I am getting the follwing error while executing the script. Please help me out. #rm /tmp/$$ #!/bin/ksh dir_one="/usr/bin/sou" dir_two="usr/bin/sou/temp" for files in $dir_one/*.txt do ... (31 Replies)
Discussion started by: soumyamishra
31 Replies

6. Shell Programming and Scripting

Help with Shell Scripts Using sed in multiple files.

Hi, I was hoping that someone could help me. I have a problem that i am trying to work on and it requires me to change text within multiple files using sed. I use the program to change an occurance of a word throughout different files that are being tested. At first i had to Create a new script,... (1 Reply)
Discussion started by: Johnny2518
1 Replies

7. Homework & Coursework Questions

Help with Shell Scripts Using sed in multiple files.

Hi, I was hoping that someone could help me. I have a problem that i am trying to work on and it requires me to change text within multiple files using sed. What i have so far is !/bin/sh File1="$3" File2="$4" File3="$5" testNum="$File1" while test "$testNum" <= "$File3"; do echo... (12 Replies)
Discussion started by: Johnny2518
12 Replies

8. Shell Programming and Scripting

Having a single Log file for all the shell scripts

Bash on RHEL 6.2 We have multiple shell scripts executed by cron jobs. Each Shell script has its own log files currently. Most of them have logs generated using spool command from Oracle RDBMS's sqlplus commmand. Sample: #!/bin/bash sqlplus -s scott/tiger << EOF spool... (5 Replies)
Discussion started by: kraljic
5 Replies

9. Shell Programming and Scripting

Parse log files

Hi all, We are having a sample log like .... test.log:2015.03.17 06:16:24 >> ABC.generateMethod() MethodAException while processing Request! DataForm: Header --- dtd: template.dtd, titleName: berger, requestId: 1503170032131, documentName: invoice123, hostName: acme.net, userName: userABC... (10 Replies)
Discussion started by: tandrei
10 Replies

10. Shell Programming and Scripting

Shell Script | Parse log file after a given date and time stamp

I am developing one script which will take log file name, output file name, date, hour and minute as an argument and based on these inputs, the script will scan and capture all the error(s) that have been triggered from a given time. Example: script should capture all the error after 13:50 on Jan... (2 Replies)
Discussion started by: ROMA3
2 Replies
VARNISHTOP(1)															     VARNISHTOP(1)

NAME
varnishtop - Varnish log entry ranking SYNOPSIS
varnishtop [-1] [-b] [-C] [-c] [-d] [-f] [-I regex] [-i tag] [-n varnish_name] [-r file] [-V] [-X regex] [-x tag] DESCRIPTION
The varnishtop utility reads varnishd(1) shared memory logs and presents a continuously updated list of the most commonly occurring log entries. With suitable filtering using the -I, -i, -X and -x options, it can be used to display a ranking of requested documents, clients, user agents, or any other information which is recorded in the log. The following options are available: -1 Instead of presenting of a continuously updated display, print the statistics once and exit. Implies -d. -b Include log entries which result from communication with a backend server. If neither -b nor -c is specified, varnishtop acts as if they both were. -C Ignore case when matching regular expressions. -c Include log entries which result from communication with a client. If neither -b nor -c is specified, varnishtop acts as if they both were. -d Process old log entries on startup. Normally, varnishtop will only process entries which are written to the log after it starts. -f Sort and group only on the first field of each log entry. This is useful when displaying e.g. stataddr entries, where the first field is the client IP address. -I regex Include log entries which match the specified regular expression. If neither -I nor -i is specified, all log entries are included. -i tag Include log entries with the specified tag. If neither -I nor -i is specified, all log entries are included. -p period Specifies the number of seconds to measure over, the default is 60 seconds. The first number in the list is the average number of requests seen over this time period. -n Specifies the name of the varnishd instance to get logs from. If -n is not specified, the host name is used. -r file Read log entries from file instead of shared memory. -V Display the version number and exit. -X regex Exclude log entries which match the specified regular expression. -x tag Exclude log entries with the specified tag. EXAMPLES
The following example displays a continuously updated list of the most frequently requested URLs:: varnishtop -i RxURL The following example displays a continuously updated list of the most commonly used user agents:: varnishtop -i RxHeader -C -I ^User-Agent SEE ALSO
o varnishd(1) o varnishhist(1) o varnishlog(1) o varnishncsa(1) o varnishstat(1) HISTORY
The varnishtop utility was originally developed by Poul-Henning Kamp in cooperation with Verdens Gang AS and Varnish Software AS, and later substantially rewritten by Dag-Erling Smorgrav. This manual page was written by Dag-Erling Smorgrav. COPYRIGHT
This document is licensed under the same licence as Varnish itself. See LICENCE for details. o Copyright (c) 2006 Verdens Gang AS o Copyright (c) 2006-2011 Varnish Software AS AUTHOR
Dag-Erling Smorgrav 1.0 2010-05-31 VARNISHTOP(1)
All times are GMT -4. The time now is 09:29 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy