Searching exception keyword in all logs in last 5 minutes Post: 303029055

Sponsored Content

Top Forums UNIX for Beginners Questions & Answers Searching exception keyword in all logs in last 5 minutes Post 303029055 by RudiC on Sunday 20th of January 2019 05:05:46 AM

01-20-2019

Registered User

@punpun26262626: Welcome to the forum.
It is usually well received in here if you put some more effort into formulating the spec than "Now please advise". What OS / shell / tools versions do you use? What thoughts / logics lead to the desired result? Any attempts from your side on the solution?

@sadique.manzar: nice idea, with three drawbacks:
- the patterns will match more than "last 5 minutes", e.g. the day(s) before, or matching "min:sec" values (in above: /07:40/), or any other similar data.
- the key word "Exception" is requested.
- no "command substitution" for the final sed command.

Combining the two proposals this far we come up with

Code:

$ e="\("
$ DL=
$ for (( i = 5; i >= 0; i-- )) ; do  e=$(date +"$e$DL%dT%R:" -d "-$i min"); DL="\|"; done
$ e=$e"\).*[Ee]xception"
$ grep $e file
OMM 2018-11-29T02:07:40,713 DEBUG AM-abcLogCron  java.sql.SQLException: Numeric Overflow

This User Gave Thanks to RudiC For This Post:

RudiC

View Public Profile for RudiC

Find all posts by RudiC

10 More Discussions You Might Find Interesting

1. OS X (Apple)

keyword searching of documents

Unix based fix-it needed? Platform and feature: search programs on Apple computers (Leopard or Tiger; 10.4 and above; Spotlight) Problem: the document search feature of these programs produce hits when keyword(s) used appear anywhere in the document's content. Change required: we need to...

2. Shell Programming and Scripting

Searching *.gz logs

I have been trying to search for a string from close to 200 *.gz file, But i get a error. Can someone suggest a bulletproof solution Please. zgrep 20/Aug/2008:13:50:23 request.log.*.gz -bash: /usr/bin/zgrep: /bin/sh: bad interpreter: Argument list too long also zgrep 20/Aug/2008:13:50:23...

3. OS X (Apple)

Keyword Searching

Hi all, I am in the process of building a shell script as part of a auditing utility. It will search a specified directory for keywords and output results of the file path, and line number that the word was found on. I built a test script (shown below) that does just this, but egrep apparently...

4. Shell Programming and Scripting

Searching set of string from Live Running Logs

Hey just need one simple syntax to search for the string from the Live Running Logs. The strings are placed in a $infile & everytime the script should pull each string from $infile and should provide as an input for grepping from Live running logs on a rotational basis. So here are the Contents...

5. Shell Programming and Scripting

Monitor logs for exception and if exception come then sent an email

Hi Folks, please advise , I have logs generated on unix machine at location /ops/opt/aaa/bvg.log , now sometimes there come exception in these logs also, so I want to write such a script such that it should continuously monitor these logs and whenever any exception comes that is it try to find...

6. Shell Programming and Scripting

Line numbers and exception to be caught in logs

Hi Folks, I have just basic queries is that suppose I have to monitor the logs then there is a command , suppose I have to monitor the abc.log which is updating dynamically within seconds so the command will be after going to that directory is .. tail -f abc.log Now please advise what about...

7. Shell Programming and Scripting

Catching the exception in multiple logs

Hi folks, I have logs folder in which different type of logs are generated , I am monitoring them by the below command tail -f *.log but I want that if exception come in any of the logs then it should be catch so what i should prefix with tail -f *.log so that it imeediatley catches and...

8. Shell Programming and Scripting

Searching Error Message from a log life between timestamp of every 10 minutes

HI Everyone, My task is to search error messages last 10 minutes everytime from a log file. My script, date1=`date -d '10 minutes ago' "+%H:%M:%S"` date2=`date "+%H:%M:%S"` awk -v d1="${date1}" -v d2="${date2}" '$0~d1{p=1} $0~d2{p=0} p' filename No error getting in...

9. Shell Programming and Scripting

Need help in getting the Last 30 minutes logs from the Log File

I have a log file with the below contents : log_file_updated.txt : Jul 5 03:33:06 rsyslogd: was Jul 5 03:33:09 adcsdb1 rhsmd: This system is registered. Sep 2 02:45:48 adcsdb1 UDSAgent: 2015-07-05 04:24:48.959 INFO Worker_Thread_4032813936 Accepted connection from host <unknown>...

10. Shell Programming and Scripting

How to extract logs between the current time and the last 15 minutes ?

I want to extract the logs between the current time stamp and 15 minutes before and sent an email to the people configured. I developed the below script but it's not working properly; can someone help me?? I have a log file containing this pattern: Constructor QuartzJob ...

LEARN ABOUT REDHAT

scanlogs

SCANLOGS(8)						      System Manager's Manual						       SCANLOGS(8)

NAME

       scanlogs - summarize INN log files.

SYNOPSIS

       scanlogs [ norotate ]

DESCRIPTION

       Scanlogs  summarizes  the information recorded in the INN log files (see newslog(5)).  By default, it also rotates and cleans out the logs.
       It is normally invoked by the news.daily(8) script.

KEYWORDS

       The following keywords are accepted:

       norotate
	      Using this keyword disables the rotating and cleaning aspect of the log processing: the logs files are only scanned for  information
	      and no contents are altered.

       If scanlogs is invoked more than once a day, the ``norotate'' keyword should be used to prevent premature log cleaning.

HISTORY

       Written by Landon Curt Noll <chongo@toad.com> and Rich $alz <rsalz@uunet.uu.net> for InterNetNews.  This is revision 1.2, dated 1998/01/28.

SEE ALSO

       innd(8), newslog(5), news.daily(8), nnrpd(8).

																       SCANLOGS(8)