07-03-2012
Help needed to extract distinct logs from a Log File
Hi,
I urgently need some help how to extract distinct entries from a Log file.
The Log File may have same error occuring many times so how do i count the occurance of an error in file and also extract out distinct errors in a file.
Eg:-
I have a file name A.log
it contains entries as below:-
Error 1
Error 2
Error 1
Error 1
Error 2
I want distinct errors and their occurances.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hello,
I would like to write a bash script that would monitor a log file for a certain number of logs, let's say 500 logs and when it reaches that number to write the last log to another file. For example, I want to watch the /var/adm/messages and everytime, there is 500 new logs that are... (1 Reply)
Discussion started by: Pouchie1
1 Replies
2. Shell Programming and Scripting
HI All,
I have a log file where the logs will be in the format as given below:
2011-05-25 02:32:51 INFO PROCESS STARTING
2011-05-25 02:32:52 INFO PROCESS STARTED
.
.
.
I want to retrieve only the logs which are less than 5 mins older than current time using grep... (3 Replies)
Discussion started by: rvhg16
3 Replies
3. Shell Programming and Scripting
Hi ,
I have a Data cleansing process which creates different log file for each step , when the process runs it creates following log files in below order:
p1_tranfrmr_log.txt
p1_tranfrmr_stats.txt
p2_globrtr_log.txt
p2_globrtr_stats.txt
p3_cusparse_log.txt
p3_cusparse_stats.txt
'
'... (8 Replies)
Discussion started by: sonu_pal
8 Replies
4. Shell Programming and Scripting
I am executing a stored procedure through shell script. In the procedure, i have dbms_output.put_line to log the comments. This is working fine and but logs are available only after the execution of the pl/sql procedure's completion.
I want to print the log comments while executing the procedure... (2 Replies)
Discussion started by: vel4ever
2 Replies
5. Shell Programming and Scripting
Hello,
I need a utility script or command that will extract the following lines from a file based on a 'word' contain in a line. For example my file contains lot of lines.
So if i pass 1800182 to the script/command it should return everything between 1st RequestNetRates tag before it and 1st... (4 Replies)
Discussion started by: jakSun8
4 Replies
6. Shell Programming and Scripting
story
------------------------
The file is a.out, it consist a set of logs from user access to my system ( email system)
question
--------------------------
using shell script, how can we extract 2 sets of IP output from the a.out log by separate the IP, determine human and non-human... (21 Replies)
Discussion started by: Mr_47
21 Replies
7. Shell Programming and Scripting
HI,
I want to search for a logs which are trace between specific date and time from logs file.
My logs are generated like this :-
Tue Jun 18 05:00:02 EEST 2013 | file_check.sh| Message:script has files to process.
Thu Jun 20 05:00:02 EEST 2013 | file_check.sh| Message:script has files to... (5 Replies)
Discussion started by: ketanraut
5 Replies
8. Shell Programming and Scripting
I have a log file with the below contents :
log_file_updated.txt :
Jul 5 03:33:06 rsyslogd: was
Jul 5 03:33:09 adcsdb1 rhsmd: This system is registered.
Sep 2 02:45:48 adcsdb1 UDSAgent: 2015-07-05 04:24:48.959 INFO Worker_Thread_4032813936 Accepted connection from host <unknown>... (3 Replies)
Discussion started by: rahul2662
3 Replies
9. Shell Programming and Scripting
I want to extract the logs between the current time stamp and 15 minutes before and sent an email to the people configured. I developed the below script but it's not working properly; can someone help me?? I have a log file containing this pattern:
Constructor QuartzJob
... (3 Replies)
Discussion started by: puneetkhullar
3 Replies
10. Shell Programming and Scripting
I have been searching and reading about syslog. I would like to know how to Transfer the logs being thrown into /var/log/messages into another file example /var/log/volumelog.
tail -f /var/log/messages
dblogger: msg_to_dbrow: no logtype using missing
dblogger: msg_to_dbrow_str: val ==... (2 Replies)
Discussion started by: kenshinhimura
2 Replies
LEARN ABOUT DEBIAN
log::agent::file::rotate
File::Rotate(3pm) User Contributed Perl Documentation File::Rotate(3pm)
NAME
Log::Agent::File::Rotate - a rotating logfile set
SYNOPSIS
#
# This class is not user-visible.
#
# It is documented only for programmers wishing to inherit
# from it to further extend its behaviour.
#
require Log::Agent::Driver::File;
require Log::Agent::Rotate;
require Log::Agent::File::Rotate;
my $config = Log::Agent::Rotate->make(...);
my $driver = Log::Agent::Driver::File->make(...);
my $fh = Log::Agent::File::Rotate->make("file", $config, $driver);
DESCRIPTION
This class represents a rotating logfile and is used drivers wishing to rotate their logfiles periodically. From the outside, it exports a
single "print" routine, just like "Log::Agent::File::Native".
Internally, it uses the parameters given by a "Log::Agent::Rotate" object to transparently close the current logfile and cycle the older
logs.
Before rotating the current logfile, the string:
*** LOGFILE ROTATED ON <local date>
is emitted, so that people monitoring the file via "tail -f" know about it and are not surprised by the sudden stop of messages.
Its exported interface is:
make file, config
This is the creation routine. The config object is an instance of "Log::Agent::Rotate".
print args
Prints args to the file. After having printed the data, monitor the file against the thresholds defined in the configuration, and
possibly rotate the logfiles according to the parameters held in the same configuration object.
When the "is_alone" flag is not set in the configuration, the logfile is checked everytime a "print" is issued to see if its inode
changed. Indeed, when several instances of the same program using rotating logfiles are running, each of them may decide to cycle the
logs at some point in time, and therefore our opened handle could point to an already renamed or unlinked file.
AUTHORS
Originally written by Raphael Manfredi <Raphael_Manfredi@pobox.com>, currently maintained by Mark Rogaski <mrogaski@pobox.com>.
SEE ALSO
Log::Agent::Rotate(3), Log::Agent::Driver::File(3).
perl v5.10.0 2002-05-14 File::Rotate(3pm)