Visit Our UNIX and Linux User Community


Controlling logfiles


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers Controlling logfiles
# 1  
Old 08-07-2002
Question Controlling logfiles

I support an app that outputs alert and audit messages to one log file (vendor says they can't be separated). The script that I have written takes a copy (mv cmd) of the file to do the separation and reformatting. I have a problem that I loose records (messages are being written constantly, upto 3+ a second) between doing the mv and touch command on the log file. What could I do to stop these records being missed? feed the output straight into a script? Can I name pipes (this should allow for the script to read one message at a time)? any ideas would be great. Easier the better.
# 2  
Old 08-07-2002
Shutdown the app. Save the old log. Restart the app.
# 3  
Old 08-07-2002
Sounds good....I would luv to turn it off and keep it off but it is in a 24x7 app and I would have to turn it off every 10 minutes in order to keep file size down (plus, it takes about 3-5mins to start and stop).

How do you become a UNIX Daemon? Who do I have to fight.....bring it on.
# 4  
Old 08-07-2002
I guess it must be opening the log file in append mode for each write since your move works at all. So maybe you can something like this....

cd /log/directory
kill -STOP $pid
mv log olog
kill -CONT $pid
sleep 3

That sleep is needed because the app may have opened the old log file prior to the first kill. We need to give time to do the write after the second kill.

But the real answer is that the app needs to be re-written to this by itself.
# 5  
Old 08-07-2002
How about a script that when fired up, counts the number of lines in the log (`wc -l`) and then starts at the first of the file and has it processes log entries it deletes the log entries until the line count of the log file has been reached?

That way, you process messages, reduce the size of the log, but will not miss any added log entries, and because you start with the initial count of the lines of the log, you won't miss new log entries.

The only problem that I can think of is a situation where you delete and the app writes at the exact same time.
# 6  
Old 08-08-2002
Hammer & Screwdriver

All log file to config at: /etc/syslog.conf = = > You can view and edit it. If you want control a log file:

- Add
- Del
- Stop
....
 

Previous Thread | Next Thread
Test Your Knowledge in Computers #249
Difficulty: Easy
Senator Albert Gore, Jr. authored the High Performance Computing and Communication Act of 1991, creating what Gore referred to as the information superhighway.
True or False?

10 More Discussions You Might Find Interesting

1. Red Hat

"rhgb quiet" controlling the display of commands in single user mode ?"rhgb quiet" controlling the d

Why does removing "rhgb quiet" from the kernel boot parameters control whether or not the commands I enter are displayed in single user mode ? For instance, if I do not remove "rhgb quiet", when I am in single user mode, whatever command I type will not be displayed on the screen. The... (0 Replies)
Discussion started by: Hijanoqu
0 Replies

2. Shell Programming and Scripting

How to find ip addresses in logfiles?

Hi guys, I need to check a few log files as below to find out whether certain ip addresses is present on these log files. type8code0: ls -alt -rw-r--r-- 1 root other 796219588 Mar 20 02:25 logfile drwxr-xr-x 2 root root 1536 Mar 20 02:00 . -rw-r--r-- ... (3 Replies)
Discussion started by: type8code0
3 Replies

3. Shell Programming and Scripting

How to write a bourne shell to do with logfiles??

Hi,I have a task have to do is writing an only Bourne shell to do with logfiles. Because I am not really a programmer,just unix administrator. So I need someone can do this for me. The requirement is 1,be able to run in an environment that does not include a path. (i.e. the environment... (2 Replies)
Discussion started by: lemon_06
2 Replies

4. Red Hat

logrotate httpd logfiles

Hi, I need to logrotate logs in directories in /var/log/httpd/. There are 4 directories in /var/log/httpd/... these directories are /var/log/httpd/access/ /var/log/httpd/debug/ /var/log/httpd/error/ /var/log/httpd/required/ Each of the access, required, error and debug directories have around... (1 Reply)
Discussion started by: renuka
1 Replies

5. UNIX for Dummies Questions & Answers

Gzip many logfiles in one time

Hi All, I am working on a script and i am now been stuck in the mid of it.. My Script actually list the files consuming large disk it need compress the log files.. Here are the files Hello_2009_10_22.log Hello_2009_10_23.log.gz Hello_2009_10_24.log.gz Hello_2009_10_22.log... (2 Replies)
Discussion started by: sumithra
2 Replies

6. Shell Programming and Scripting

Logfiles

Hi All, I have a peculiar problem. I will call a script from another script. Script abc.ksh is called by ABC.ksh as ABC.ksh abc.ksh in abc.ksh I will create and redirect all the statements to log file. ABC.ksh will also has a log file. I want all the logs generated in file abc in ABC... (5 Replies)
Discussion started by: javeed7
5 Replies

7. Shell Programming and Scripting

split monthly logfiles into daily logfiles

Hi, I have a lot of logfiles like fooYYYYMM.log (foo200301.log, foo200810.log) with lines like YYYY-MM-DD TIMESTAMP,text1,text2,text3... but I need (for postprocessing) the form fooYYYYMMDD.log (so foo200402.log becomes foo20040201.log, foo20040202.log...) with unmodified content of lines. ... (1 Reply)
Discussion started by: clzupp
1 Replies

8. Shell Programming and Scripting

Logfiles E-mailed

Hi All There are some cron jobs ,which runs 24 hrs. Log files are generated when one job fails. So I need the log files to be emailed to my personal e-mail id. So that I can see the log files at my home If there is any error. How can I implement this in Unix shell programming. Thanks... (4 Replies)
Discussion started by: deep_kol
4 Replies

9. UNIX for Advanced & Expert Users

Output all commands to logfiles ???

Dear Forum, My .cshrc settings are embedded in a massive jungle of code distributed all over the place, where finding anything is a "needle in a haystack" daily pain in the royal backside. Is there anyway, i can dump out every command and file executed to STDOUT after sourcing my .cshrc ??? ... (2 Replies)
Discussion started by: fawqati
2 Replies

10. UNIX for Dummies Questions & Answers

Logfiles

My server has only has access logs turned on. How do I turn on the other standard logs (i.e. I'd like to see the referring urls). Thanks in advance. (3 Replies)
Discussion started by: pingdom
3 Replies

Featured Tech Videos