11-07-2008
split monthly logfiles into daily logfiles
Hi,
I have a lot of logfiles like fooYYYYMM.log (foo200301.log, foo200810.log) with lines like
YYYY-MM-DD TIMESTAMP,text1,text2,text3...
but I need (for postprocessing) the form fooYYYYMMDD.log (so foo200402.log becomes foo20040201.log, foo20040202.log...)
with unmodified content of lines.
Thanks for any help!
Uwe
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
My server has only has access logs turned on. How do I turn on the other standard logs (i.e. I'd like to see the referring urls).
Thanks in advance. (3 Replies)
Discussion started by: pingdom
3 Replies
2. UNIX for Dummies Questions & Answers
I support an app that outputs alert and audit messages to one log file (vendor says they can't be separated). The script that I have written takes a copy (mv cmd) of the file to do the separation and reformatting. I have a problem that I loose records (messages are being written constantly, upto 3+... (5 Replies)
Discussion started by: nhatch
5 Replies
3. UNIX for Advanced & Expert Users
Dear Forum,
My .cshrc settings are embedded in a massive jungle of code distributed all over the place, where finding anything is a "needle in a haystack" daily pain in the royal backside.
Is there anyway, i can dump out every command and file executed to STDOUT after sourcing my .cshrc ???
... (2 Replies)
Discussion started by: fawqati
2 Replies
4. Shell Programming and Scripting
Hi All
There are some cron jobs ,which runs 24 hrs. Log files are generated when one job fails.
So I need the log files to be emailed to my personal e-mail id. So that I can see the log files at my home If there is any error.
How can I implement this in Unix shell programming.
Thanks... (4 Replies)
Discussion started by: deep_kol
4 Replies
5. Shell Programming and Scripting
--------------------------------------------------------------------------------
Hi All,
I am reading some logfiles and parsing data and printing to some textfile.
Here is my code
OLDIFS=$IFS
IFS='
' # just a newline, in single quotes
while read data
do
if
then
#Parsing the... (4 Replies)
Discussion started by: subin_bala
4 Replies
6. Shell Programming and Scripting
Hi All,
I have a peculiar problem. I will call a script from another script.
Script abc.ksh is called by ABC.ksh as
ABC.ksh abc.ksh
in abc.ksh I will create and redirect all the statements to log file.
ABC.ksh will also has a log file. I want all the logs generated in file abc in ABC... (5 Replies)
Discussion started by: javeed7
5 Replies
7. UNIX for Dummies Questions & Answers
Hi All,
I am working on a script and i am now been stuck in the mid of it..
My Script actually list the files consuming large disk it need compress the log files..
Here are the files
Hello_2009_10_22.log
Hello_2009_10_23.log.gz
Hello_2009_10_24.log.gz
Hello_2009_10_22.log... (2 Replies)
Discussion started by: sumithra
2 Replies
8. Red Hat
Hi,
I need to logrotate logs in directories in /var/log/httpd/. There are 4 directories in /var/log/httpd/... these directories are /var/log/httpd/access/
/var/log/httpd/debug/
/var/log/httpd/error/
/var/log/httpd/required/
Each of the access, required, error and debug directories have around... (1 Reply)
Discussion started by: renuka
1 Replies
9. Shell Programming and Scripting
Hi guys,
I need to check a few log files as below to find out whether certain ip addresses is present on these log files.
type8code0: ls -alt
-rw-r--r-- 1 root other 796219588 Mar 20 02:25 logfile
drwxr-xr-x 2 root root 1536 Mar 20 02:00 .
-rw-r--r-- ... (3 Replies)
Discussion started by: type8code0
3 Replies
10. HP-UX
Hi ,
The log files of the system are located in /var/admin/syslog , I want to know on which way the files are generated. To be more clear for example old log files are deleted automatically from the sytem ( is that configured ? if yes what is the criteria: is it file volume or file date or ..)... (5 Replies)
Discussion started by: enabbou
5 Replies
LEARN ABOUT DEBIAN
atsadc
ATSADC(1) local ATSADC(1)
NAME
atsadc, atsa1, atsaftp, atsahttp -- counter-collection
SYNOPSIS
atsadc [ t n ] [ ofile ]
atsa1 [ t n ]
atsaftp
atsahttp
DESCRIPTION
System activity-data can be gathered on special request of a user [see atsar(1) ] or automatically, on a routine basis, as described here.
Usually the kernel maintains statistical counters that are incremented as various system actions occur. These include counters for CPU uti-
lization, disk utilization, memory utilization and various network statistics.
The program atsadc and the shell-script atsa1 are used to collect, save, and process these counters.
The program atsadc (the data collector) samples system data n times with an interval of t seconds between samples, and writes in binary
format to ofile or (default) to standard output. The sampling interval t should be greater than 1 second. If t and n are omitted, a special
reset-record is written. This facility is used when booting to a multi-user state, to mark the time at which the counters restart from
zero. For example, the reset-mark can be added to the daily data by the command:
/usr/local/bin/atsadc /var/log/atsar/atsa`date +%d`
Note that this entry is written to the /etc/rc.d/init.d/atsar file.
The shell-script atsa1 is used to collect and store data in the binary file /var/log/atsar/atsadd where dd is the current day of the month.
The arguments t and n cause records to be written n times at an interval of t seconds, or once if omitted. Furthermore this script takes
care that log-files older than a week are removed once a day.
A file containing following entries should be added to the /etc/cron.d directory to produce records every 20 minutes during working hours
and hourly otherwise:
0 * * * 0-6 root /usr/local/bin/atsa1
20,40 8-17 * * 1-5 root /usr/local/bin/atsa1
See crontab(1) for details.
The shell-script atsaftp counts the new transfers registered in the FTP-logfile(s) since the previous time this script was activated; the
new counters are stored in the /var/log/atsar/ftpstat file in ASCII-format. The names of the FTP-logfiles to be watched are specified in
the /etc/atsar.conf configuration-file.
The shell-script atsahttp counts the new transfers registered in the HTTP-logfile(s) since the previous time this script was activated; the
new counters are stored in the /var/log/atsar/httpstat file in ASCII-format. The names of the HTTP-logfiles to be watched are specified in
the /etc/atsar.conf configuration-file.
Both scripts must be activated just before the program atsadc is started, which also collects these counters.
FILES
/var/log/atsar/atsadd
Daily data file, where dd are digits representing the day of the month.
SEE ALSO
atsar(1), crontab(1)
AUTHOR
Gerlof Langeveld, AT Computing (gerlof@ATComputing.nl)
AT Computing July 2004 ATSADC(1)