10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I want to monitor a log file using tail -f command and search for a specific string on the most recent entry from the file. If the search string matches with the most recent or last line from the file, I want send an email to the people with the message.
tail -f service.log|tail -n 1
... (5 Replies)
Discussion started by: svajhala
5 Replies
2. Shell Programming and Scripting
Hi there
I am trying to write a script where I will need to look for a specific word in the log file and I am aware this can be done by grep for example.
As there will be multiple entries for this I want to grep the last one to enter the log... how would I go about this - would I have to use... (5 Replies)
Discussion started by: simpsa27
5 Replies
3. UNIX for Dummies Questions & Answers
Hello friends, I have a question.
Sometimes I have to search for an entry in a file that is repeated thousands of times. Can you tell me how to search so that i get limited results?
For example:
file: myfile.txt
grep "hello world" myfile.txt
this above grep will generate 5000... (4 Replies)
Discussion started by: DallasT
4 Replies
4. Shell Programming and Scripting
Hello,
I want to grep a log ("server.log") for words in a separate file ("white-list.txt") and generate a separate log file containing each line that uses a word from the "white-list.txt" file.
Putting that in bullet points:
Search through "server.log" for lines that contain any word... (15 Replies)
Discussion started by: nbsparks
15 Replies
5. Shell Programming and Scripting
hi all,
i need to combine these files into one csv file.
Bounce_Mail_Event_Daily_Report_01_Jul_2012.csv
Bounce_Mail_Event_Daily_Report_02_Jul_2012.csv
Bounce_Mail_Event_Daily_Report_03_Jul_2012.csv
Bounce_Mail_Event_Daily_Report_04_Jul_2012.csv... (10 Replies)
Discussion started by: makan
10 Replies
6. Shell Programming and Scripting
Hi Ladies and Gents,
Explanation of my question with an example:
Let's consider the script: backup_every_hour.sh
#!/bin/bash
rsync -auv $dir $backup_dir >> backup_every_hour_script.log
Each time this script is called there will be a new entry at the end of the file... (1 Reply)
Discussion started by: freddie50
1 Replies
7. UNIX for Dummies Questions & Answers
I have 1300 files (SearchFiles0001.txt, SearchFiles0002.txt, etc.) , each with 650,000 lines, tab-delimited data.
I have a pattern file, with about 1000 lines with a single word. Each single word is found in the 1300 files once.
If I grep -f PatternFile.txt SearchFiles*.txt >OutputFile.txt... (2 Replies)
Discussion started by: newhavendweeb
2 Replies
8. UNIX Desktop Questions & Answers
How would I grep for password file entry without using
grep 'username' /etc/passwd?
perhaps with who?
I want to create alias that will find the password file entry regardless of the user who is using it.
Thanks (4 Replies)
Discussion started by: alis
4 Replies
9. UNIX for Dummies Questions & Answers
How would I grep for password file entry without using
grep 'username' /etc/passwd?
perhaps with who?
I want to create alias that will find the password file entry regardless of the user who is using it.
I am trying to get the same exact line from the file entry like:
Name : Password : UserID... (7 Replies)
Discussion started by: alis
7 Replies
10. Shell Programming and Scripting
Hi,
I have a table which looks like this
Line a b c
0 10 0 0
1 0 0
2 0 ... (1 Reply)
Discussion started by: ahjiefreak
1 Replies
YAZ-LOG(7) Conventions and miscellaneous YAZ-LOG(7)
NAME
yaz-log - Log handling in all yaz-based programs
SYNOPSIS
yaz-XXXX [-v loglevel,...] [-l logfile]
DESCRIPTION
All YAZ-based programs use a common log subsystem, and should support common command line options for controlling it. This man page
documents those.
OPTIONS
-l logfile
Specify the file where the log is to be written. If none is specified, stderr is used. The log is appended to this file. If the file
grows overly large, it is silently rotated: It is renamed to logfile.1, logfile.2, .., 9 (old such file is deleted), and a new file is
opened. The limit defaults to 1GB, but can be set by the program. The rotating limit can be specified with option -r for the YAZ
frontend server (yaz-ztest).
Rotation can also be implicitly enabled by using a filename which gets changed for a given date, due to substitutions as given by the
strftime(3) function.
-v loglevel
Specify the logging level. The argument is a set of log level names, separated by commas (no whitespace!), optionally preceded by a '-'
to negate that level. Most programs have their own default, often containing fatal,warn,log, and some application-specific values. The
default list can be cleared with the word none, or individual bits can be removed by prefixing them with a dash '-'.
LOG LEVELS TO CONTROL LOGGING
Some of the log levels control the way the log is written.
flush causes the log to be flushed after every write. This can have serious implications to performance, and should not be used in
production. On the other hand, when debugging a program crash, this can be extremely useful. The option debug implies flush as well.
notime prevents the writing of time stamps. This is intended for automatic test scripts, which should produce predictable log files that
are easy to compare.
GENERAL LOG LEVELS IN YAZ ITSELF
YAZ itself uses the following log levels:
fatal for fatal errors, that prevent further execution of the program.
warn for warnings about things that should be corrected.
debug for debugging. This flag may be used temporarily when developing or debugging yaz, or a program that uses yaz. It is practically
deprecated, you should be defining and using your own log levels (see below).
all turns on almost all hard-coded log levels.
loglevel logs information about the log levels used by the program. Every time the log level is changed, lists all bits that are on. Every
time a module asks for its log bits, this is logged. This can be used for getting an idea of what log levels are available in any program
that uses yaz-log. Start the program with -v none,loglevel, and do some common operations with it. Another way is to grep for
yaz_log_module_level in the source code, as in
find . -name '*.[ch]' -print |
xargs grep yaz_log_module_level |
grep '"' |
cut -d'"' -f2 |
sort -u
eventl, malloc, nmem, odr are used internally for debugging yaz.
LOG LEVELS FOR CLIENTS
zoom logs the calls to the zoom API, which may be useful in debugging client applications.
LOG LEVELS FOR SERVERS
server logs the server functions on a high level, starting up, listening on a port, etc.
session logs individual sessions (connections).
request logs a one-liner for each request (init, search, etc).
requestdetail logs the details of every request, before it is passed to the back-end, and the results received from it.
Each server program (zebra, etc) is supposed to define its own log levels in addition to these. As they depend on the server in question,
they can not be described here. See above how to find out about them.
LOGGING EXAMPLES
See what log levels yaz-ztest is using:
yaz-ztest -1 -v none,loglevel
14:43:29-23/11 [loglevel] Setting log level to 4096 = 0x00001000
14:43:29-23/11 [loglevel] Static log bit 00000001 'fatal' is off
14:43:29-23/11 [loglevel] Static log bit 00000002 'debug' is off
14:43:29-23/11 [loglevel] Static log bit 00000004 'warn' is off
14:43:29-23/11 [loglevel] Static log bit 00000008 'log' is off
14:43:29-23/11 [loglevel] Static log bit 00000080 'malloc' is off
14:43:29-23/11 [loglevel] Static log bit 00000800 'flush' is off
14:43:29-23/11 [loglevel] Static log bit 00001000 'loglevel' is ON
14:43:29-23/11 [loglevel] Static log bit 00002000 'server' is off
14:43:29-23/11 [loglevel] Dynamic log bit 00004000 'session' is off
14:43:29-23/11 [loglevel] Dynamic log bit 00008000 'request' is off
14:44:13-23/11 yaz-ztest [loglevel] returning log bit 0x4000 for 'session'
14:44:13-23/11 yaz-ztest [loglevel] returning log bit 0x2000 for 'server'
14:44:13-23/11 yaz-ztest [loglevel] returning NO log bit for 'eventl'
14:44:20-23/11 yaz-ztest [loglevel] returning log bit 0x4000 for 'session'
14:44:20-23/11 yaz-ztest [loglevel] returning log bit 0x8000 for 'request'
14:44:20-23/11 yaz-ztest [loglevel] returning NO log bit for 'requestdetail'
14:44:20-23/11 yaz-ztest [loglevel] returning NO log bit for 'odr'
14:44:20-23/11 yaz-ztest [loglevel] returning NO log bit for 'ztest'
See the details of the requests for yaz-ztest
./yaz-ztest -1 -v requestdetail
14:45:35-23/11 yaz-ztest [server] Adding static Z3950 listener on tcp:@:9999
14:45:35-23/11 yaz-ztest [server] Starting server ./yaz-ztest pid=32200
14:45:38-23/11 yaz-ztest [session] Starting session from tcp:127.0.0.1 (pid=32200)
14:45:38-23/11 yaz-ztest [requestdetail] Got initRequest
14:45:38-23/11 yaz-ztest [requestdetail] Id: 81
14:45:38-23/11 yaz-ztest [requestdetail] Name: YAZ
14:45:38-23/11 yaz-ztest [requestdetail] Version: 2.0.28
14:45:38-23/11 yaz-ztest [requestdetail] Negotiated to v3: srch prst del extendedServices namedresults scan sort
14:45:38-23/11 yaz-ztest [request] Init from 'YAZ' (81) (ver 2.0.28) OK
14:45:39-23/11 yaz-ztest [requestdetail] Got SearchRequest.
14:45:39-23/11 yaz-ztest [requestdetail] ResultSet '1'
14:45:39-23/11 yaz-ztest [requestdetail] Database 'Default'
14:45:39-23/11 yaz-ztest [requestdetail] RPN query. Type: Bib-1
14:45:39-23/11 yaz-ztest [requestdetail] term 'foo' (general)
14:45:39-23/11 yaz-ztest [requestdetail] resultCount: 7
14:45:39-23/11 yaz-ztest [request] Search Z: @attrset Bib-1 foo OK:7 hits
14:45:41-23/11 yaz-ztest [requestdetail] Got PresentRequest.
14:45:41-23/11 yaz-ztest [requestdetail] Request to pack 1+1 1
14:45:41-23/11 yaz-ztest [requestdetail] pms=1048576, mrs=1048576
14:45:41-23/11 yaz-ztest [request] Present: [1] 1+1 OK 1 records returned
LOG FILENAME EXAMPLES
A file with format my_YYYYMMDD.log is where Y, M, D is year, month, and day digits is given as follows -l my_%Y%m%d.log . And since the
filename is depending on day, rotaion will occur on midnight.
A weekly log could be specified as -l my_%Y%U.log.
FILES
prefix/include/yaz/log.h prefix/src/log.c
SEE ALSO
yaz(7) yaz-ztest(8) yaz-client(1) strftime(3)
YAZ 4.2.30 04/16/2012 YAZ-LOG(7)