Cleanup a log file data every 2 days Post: 302722121

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Maintain 30 days data

Hi Folks, I have a log file that keeps the information pn the date and time a specific transaction is firedup. I found that the log file keeps growing and I intend to limit the entry to the log file to 30 days. Log file name is transaction.log, here is the content: 120802_23:47:37 ...

2. Shell Programming and Scripting

Add data in days:hours:min:sec format

I want to add these no. these are in the format of days:hours:minutes:sec I want result in this format only 0:00:04:59 0:00:00:12 0:00:00:28 0:00:00:03 0:01:29:35 0:00:00:19 0:01:05:21 Is any body ca help me????? To get This.. Thanks Nishant

3. Shell Programming and Scripting

awk/sed/ksh script to cleanup /etc/group file

Many of my servers' /etc/group file have many userid's that does not exist in /etc/passwd file and they need to be deleted. This happened due to manual manipulation of /etc/passwd files. I need to do this for 40 servers. Can anyone help me in achieving this? Even reducing a step or two will be...

4. Shell Programming and Scripting

extract information from a log file (last days)

I'm still new to bash script , I have a log file and I want to extract the items within the last 5 days . and also within the last 10 hours the log file is like this : it has 14000 items started from march 2002 to january 2003 awk '{print $4}' < *.log |uniq -c|sort -g|tail -10 but...

5. Shell Programming and Scripting

Delete log files content older than 30 days and append the lastest date log file date

To delete log files content older than 30 days and append the lastest date log file date in the respective logs I want to write a shell script that deletes all log files content older than 30 days and append the lastest log file date in the respective logs This is my script cd...

6. UNIX for Dummies Questions & Answers

Find all log files under all file systems older than 2 days and zip them

Hi All, Problem Statement:Find all log files under all file systems older than 2 days and zip them. Find all zip files older than 3days and remove them. Also this has to be set under cron. I have a concerns here find . -mtime +2 -iname "*.log" -exec gzip {} Not sure if this will work as...

7. Shell Programming and Scripting

Collect last 2 days data from /var/log/messages

I need to collect last 2 days data from /var/log/messages into a separate file (file format: flmessagetimedaymonth). I have collect today's month, date, time information in separate variable. Please help me in this issue (Probably need awk and grep function). month=$(date|awk '{print $2}')...

8. OS X (Apple)

Text file cleanup

Hi there, i do get some text files that i'd lile to clean them up based on following rule: if a line starts with " then remove return (new line, carriage return) before ". Example, my input text file line 1 line 2 "line 3 I'd like this to come as line 1 line 2line3 How can i...

9. Shell Programming and Scripting

Filtering log file with lines older than 10 days.

Hi, I am trying to compare epoch time in a huge log file (2 million lines) with todays date. I have to create two files one which has lines older than 10 days and another file with less than 10 days. I am using while do but it takes forever to complete the script. It would be helpful if you can...

10. UNIX for Beginners Questions & Answers

How to find a file that's modified more than 2 days ago but less than 5 days ago?

How to find a file that's modified more than 2 days ago but was modified less than 5 days ago by use of any Linux utility ?

LEARN ABOUT DEBIAN

make_combined_log2

make_combined_log.pl(1) 				      General Commands Manual					   make_combined_log.pl(1)

NAME

       make_combined_log.pl - make combined logfile from SQL database

SYNOPSIS

       make_combined_log.pl <days> <virtual host>

DESCRIPTION

       This perl script extracts the httpd access data from a MySQL database and formats it properly for parsing by 3rd-party log analysis tools.

       The  script  is	intended  to  be run out by cron. Its commandline arguments tell it how many days' worth of access records to extract, and
       which virtual_host you are interested in (because many people log several virthosts to one MySQL db.) This permits you  to  run	it  daily,
       weekly, every 9 days -- whatever you decide.

NOTE

       By  "days"  I  mean "chunks of 24 hours prior to the moment this script is run." So if you run it at 4:34 p.m. on the 12th, it will go back
       through 4:34 p.m. on the 11th.

KNOWN ISSUES

       Because GET and POST are not discriminated in the MySQL log, we'll just assume that all requests are  GETs.  This  should  have	negligible
       effect  on  any analysis software. This could be remedied IF you stored the full HTTP request in your database instead of just the URI, but
       that's going to cost you a LOT of space really quickly...

       Because this is somewhat of a quick hack it doesn't do the most robust error checking in the world. Run it by hand to  confirm  your  usage
       before putting it in crontab.

AUTHOR

       Edward Rudd <eddie@omegaware.com>

MAN PAGE CREATED BY

       Michael A. Toth <lirul.lists@gmail.com> - based on comments of script

COMMENTS

       This man page was written using xml2man (1) by the same author.

Manuals 							       User						   make_combined_log.pl(1)

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Maintain 30 days data

Discussion started by: odogbolu98

2. Shell Programming and Scripting

Add data in days:hours:min:sec format

Discussion started by: krishna_sicsr

3. Shell Programming and Scripting

awk/sed/ksh script to cleanup /etc/group file

Discussion started by: pdtak

4. Shell Programming and Scripting

extract information from a log file (last days)

Discussion started by: matarsak