05-12-2008
Grep logs on the fly
Hi,
We use an application that is dumping logs to a file on disk. However, this is dumping very verbosely and there is no method of turning down the logging level. We need to remove certain contents from these before they are commited to disk.
Has anybody got any ideas how I can do this using grep maybe? This will have to run continually as long as the application runs.
Thanks
Harperonline
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I am trying to write a script which would go search and get the info from the logs based on yesterday timestamp and write yesterday logs in new file. The log file format is as follows:
""""""""""""""""""""""""""... (3 Replies)
Discussion started by: harish.parker
3 Replies
2. Shell Programming and Scripting
I want to find the unique url in a apache logs which got 404 error .
I can do something like
"cat apache.log|grep 404|awk '{print $2,$3}'|grep 404
this will give me say
/foo.html 404
/foo.html 404
/foo.html 404
/bar.html 404
/cat.html 404
However my output should only find... (3 Replies)
Discussion started by: gubbu
3 Replies
3. Shell Programming and Scripting
Hi,
could anyone help me out how to write a script, to grep the two timestamp from a particular file, so that it will list out all the logs between the particular timestamp
I have a pattern of log:
servicename operationname starttime endtime
eg.,
servicename1 operationname1 01:11:11... (1 Reply)
Discussion started by: jacktolearn
1 Replies
4. Shell Programming and Scripting
I have prepare script to grep for outofmemory messages in the logs. I need help in modifying script. I have implemented small logic. The outofmemory messages form six logs will store in variables.
var1=`grep -i outofmemory $tomcat1logs | sed -n '$p'| sed -n -e "s/.*\(outofmemory\).*/\1/p"`... (6 Replies)
Discussion started by: coolguyamy
6 Replies
5. Shell Programming and Scripting
I have requirement to prepare script which will grep for latest outofmemory message from the logs. I have used following command to grep the string from the logs,this script is not effective when logs are not getting updated as it will grep for old message.
f=catalina.out
var=`tail -10 $f |... (17 Replies)
Discussion started by: coolguyamy
17 Replies
6. UNIX for Dummies Questions & Answers
Hello all. I am new to this forum and also very new to using grep - so please excuse me if this question is not in the correct forum and/or is not pertinent to this website.
I use greps like this:
gunzip -c L:\System1\SailLogger_20071019* L:\System2\SailLogger_20071019*... (14 Replies)
Discussion started by: Carl2013
14 Replies
7. Shell Programming and Scripting
Hi Guys,
I want to write a script which can grep the logs (server.log) from a file for Error String and output to a other file.
Problems:
How to know about the errors only between the current restart and not in previous as server.log has earlier restarts also?
thanks for the help! Much... (5 Replies)
Discussion started by: ankur328
5 Replies
8. Shell Programming and Scripting
Hello,
I need to write one script which should search particular pattern like ABCD in log file name hello.txt only in current date logs.
in current directory i have so many past date logs but grep should be applied on current date logs.
on daily basis current date logs are in number 30 and... (2 Replies)
Discussion started by: ajju
2 Replies
9. Shell Programming and Scripting
I'm in need of some kind of script that will search for a string in each logfile in a directory but we don't want to use GREP. GREP seems to use up to much of our memory causing the server to use up a lot of swap space. Our log files are bigger than 500M on a daily basis. We lately started... (8 Replies)
Discussion started by: senormarquez
8 Replies
10. UNIX for Beginners Questions & Answers
Hi,
system date format
Thu Jun 13 12:55:18 EDT 2019
My log date format
09.148.192.60 - - "GET /akamai/sureroute-test-object.html HTTP/1.1" 404 231
can someone please help me, how to get last 5mins of logs please ? I need the command
Please wrap your samples/codes in CODE TAGS,... (3 Replies)
Discussion started by: scazed
3 Replies
LEARN ABOUT HPUX
getbuildlog
GETBUILDLOG(1) General Commands Manual GETBUILDLOG(1)
NAME
getbuildlog - download build logs from Debian auto-builders
SYNOPSIS
getbuildlog package [version-pattern] [architecture-pattern]
DESCRIPTION
getbuildlog downloads build logs of package from Debian auto-builders. It downloads build logs of all versions and for all architectures if
version-pattern and architecture-pattern are not specified or empty, otherwise only build logs whose versions match version-pattern and
build logs whose architectures match architecture-pattern will be downloaded. The version and architecture patterns are interpreted as
extended regular expressions as described in grep(1).
If version-pattern is "last" then only the logs for the most recent version of package found on buildd.debian.org will be downloaded.
If version-pattern is "last-all" then the logs for the most recent version found on each build log index will be downloaded.
OPTIONS
-h, --help
Show usage information and examples.
-V, --version
Show version and copyright information.
EXAMPLES
getbuildlog hello 2.2-1 amd64
Download amd64 build log for hello version 2.2-1.
getbuildlog glibc "" mips.*
Download mips(el) build logs of all glibc versions.
getbuildlog wesnoth .*bpo.*
Download all build logs of backported wesnoth versions.
AUTHOR
Written by Frank S. Thomas <fst@debian.org>.
DEBIAN
Debian Utilities GETBUILDLOG(1)