cleaning log files Post: 41618

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers cleaning log files Post 41618 by thehoghunter on Thursday 9th of October 2003 04:21:52 PM

10-09-2003

Registered User

You could do any of the following or a combination -

This one grabs the last 5000 lines and copies to tmp file - then you copy it back to the original - it removes everything in the original and replaces it with only those 5000 lines.
# tail -5000 rptlog1 > rptlog.tmp
# cat rptlog.tmp > rptlog1

Same type of thing but you search for "Oct" - the assumption is that you grabbed enough lines (only you can tell for sure) AND that this file has the date posted in it for each entry. This would leave you with just the entries for October in the file.
# tail - 10000 rptlog1|egrep "Oct" > rptlog.tmp
# cat rptlog.tmp > rptlog1

You can use those commands plus the ones mentioned earlier by Kelam to do different searches, grab out different lines (starting from the start of the file with the head command)....

thehoghunter

View Public Profile for thehoghunter

Find all posts by thehoghunter

9 More Discussions You Might Find Interesting

1. AIX

doing some spring cleaning....

USERS="me you jim joe sue" for user in ${USERS}; do rmuser -p $user usrdir=`cat /etc/passwd|grep $user|awk -F":" '{ print $6 }'` rm -fr `cat /etc/passwd|grep $user|awk -F":" '{ print $6 }'` echo Deleting: $user '\t' REMOVING: $usrdir done This is for AIX ONLY!!! but easily ported to...

2. UNIX for Dummies Questions & Answers

Cleaning text files

I wish to clean a text file of the following characters 1/2, 1/4, o (degrees) I cant display these characters. I have tried ALT+189 etc (my terminal emulator is set to ASCII). How do I display the above ? I am using HP UX 10.

3. UNIX for Dummies Questions & Answers

Database cleaning software

Hi everybody, I have been given a task to find the names of some products that can clean up databases by removing confidential information. The situation is that a client imports data from public sources (government websites, etc.) but that this data sometimes includes things like Social...

4. Shell Programming and Scripting

Cleaning the content of log files

Hi, I am facing problems while trying to clean a log file(Means making its file Size zero). I am not the owner of this file. From the command line, I can clean it by becoming a Sudo. (">logfilename"). I want to automate it using perl. But inside a script, sudo somehow doesnt seem to work. ...

5. UNIX for Dummies Questions & Answers

Cleaning core files

Hello *! Just a short question. Where on the system i can find core files. I have one SUN server (Solaris 8) and from time to time I must clean core files on it. But i am not sure where i can find those files. Thank you in advance. :)

6. Shell Programming and Scripting

File cleaning

HI , I am getting the source data as below. Source Data CDR_Data,,,,, F1,F2,F3,F4,F5,F6 5,5,6,7,8,7 6,6,g,,, 7,7,76,,, 8,8,gt,,, 9,9,df ,d,d,d ,,,,,

7. Shell Programming and Scripting

cleaning the file

Hi, I have a file with multiple rows. each row has 8 columns. Column 8 has entries separated by commas. I want to exclude all the rows in which column 8 has more than 3 commas. 1234#0/1 - ABC_1234 3 ATGCATGCATGC HHHIIIGIHVF 1 49:T>C,60:T>C,78:C>A,76:G>T,65:T>G Thanks, Diya

8. Shell Programming and Scripting

cleaning up files using find...

I am trying to cleanup a directory with around 4000 files, and using the below command to delete all .gz files older than 60 days, I am having the same issue of arguments being too long. is there a way i can use the same command to do what I intend to do. find /opt/et/logs/Archive/*.log.*.gz...

9. Shell Programming and Scripting

OCR text that needs cleaning

Hi, I have OCR'ed text that needs cleaning. Lines are delimited by parts of speech (POS), for example, each line will have either an adj. OR s. f. OR s. m. etc I need to uppercase all text before the POS but all text within parentheses to be lowercase Text after (and including) the POS...

LEARN ABOUT HPUX

strclean

strclean(1M)															      strclean(1M)

NAME

       strclean - remove outdated STREAMS error log files

SYNOPSIS

       logdir] age]

DESCRIPTION

       cleans  the  STREAMS  error logger directory of log files mm-dd) that contain error messages sent by the STREAMS log driver, strlog(7).	If
       the option is not used to specify another directory, removes error log files in the directory.  If  the	option	is  not  used  to  specify
       another age, removes error log files that have not been modified in three days.

   Options
       recognizes the following options and command-line arguments:

       Specifies a directory for the location of the
		      STREAMS error log files to be removed if this is not the default directory

       Specifies a maximum age in days for the
		      STREAMS error log files if this not the default age of 3.  The value of age must be an integer greater than or less than 3.

EXAMPLES

       Remove day-old error log files from a directory called

FILES

       One or more error log file or files on which	 operates.   The  mm-dd  in  the filename indicates the month and day of the messages con-
							 tained in the file.

       NLS catalog for

SEE ALSO

       strerr(1M), strlog(7).

																      strclean(1M)