Login or Register to Ask a Question and Join Our Community


Shell Programming and Scripting

Help with a rotate log script

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Top Forums Shell Programming and Scripting Help with a rotate log script
# 1  
Old 09-06-2012
Help with a rotate log script
Hi all,

Am trying to write my own log rotate script. Curremtly, what I have is as below:

Code:
 
#!/bin/ksh
file_to_rotate=${1}
x=${2}
while [[ ${x} -ge 1 ]]
do
   let curr=${x}
   let prev=${x}-1
   if [[ $x -eq 1 ]] ; then
      #echo "cp -p ${file_to_rotate} ${file_to_rotate}.${curr}"
      cp -p ${file_to_rotate} ${file_to_rotate}.${curr}
      let x=${x}-1
   else
      if [[ ! -f ${file_to_rotate}.${prev} ]] ; then
         let x=${x}-1
      else
         #echo "cp -p ${file_to_rotate}.${prev} ${file_to_rotate}.${curr}"
         cp -p ${file_to_rotate}.${prev} ${file_to_rotate}.${curr}
         let x=${x}-1
      fi
   fi
done

I run the script as ./x.ksh x.log 10 and it works like how I want it to. Unfortunately, sometimes, I have some files missing like and my number of rotated log files turns out as below:

Code:
[tmp]$ ls -ltr
total 36
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.9
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.8
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.7
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.6
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.2
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.10
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.1
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log
-rwxr--r-- 1 oracle oinstall 549 Sep  7 01:38 x.ksh


Note that I have x.log.5, x.log.4, x.log.3 missing. Can anyone suggest how I can include some sort of re-ordering/renaming loop so that after I run the rotate script, I will end up with the rotated logs renamed as below:

Code:
 
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.9
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.8
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.7
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.6
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.2
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.10
-rw-r--r-- 1 oracle oinstall 198 Sep  7 00:38 x.log.1

x.log.10 should be x.log.7
x.log.9 should be x.log.6
x.log.8 should be x.log.5
x.log.7 should be x.log.4
x.log.6 should be x.log.3
x.log.2 should be x.log.2
x.log.1 should be x.log.1

Help much appreciated. Thanks in advance.
# 2  
Old 09-06-2012
If it is ok for you, I suggest to use the unix weekday like date +%w in the file name when wrapping/copying the current log file at the end of a day (0-6).
So you won't have to track the numbers in the file names and after 1 week they are overwritten. If 7 days is not enough you could use the month's day this way for example (1-31).
# 3  
Old 09-06-2012
what about using - if available on your system - the backup control option of cp:
Code:
cp --backup=numbered file file.bck

# 4  
Old 09-06-2012
Quote:
Originally Posted by RudiC
what about using - if available on your system - the backup control option of cp:
Code:
cp --backup=numbered file file.bck


Unfortunately, don't have the --backup option. Never heard of that option actually. Will check on that in any case.

---------- Post updated at 05:53 PM ---------- Previous update was at 05:45 PM ----------

Quote:
Originally Posted by zaxxon
If it is ok for you, I suggest to use the unix weekday like date +%w in the file name when wrapping/copying the current log file at the end of a day (0-6).
So you won't have to track the numbers in the file names and after 1 week they are overwritten. If 7 days is not enough you could use the month's day this way for example (1-31).
Hhhhmmmm ... that's a good thought actually but run the script weekly but very good suggestion.

BTW, just noted, I actually need to do the re-order/re-numbering before doing the rotate, not after ....
# 5  
Old 09-06-2012
Quote:
Originally Posted by newbie_01
...
BTW, just noted, I actually need to do the re-order/re-numbering before doing the rotate, not after ....
Don't know if you mean that you want help with this, bur here is a suggestion, I kept your syntax (with small adjustments) because I have never used ksh.
Code:
#!/bin/ksh
file_to_rotate=${1}
max=${2}
let curr=1
while [[ ${curr} -lt ${max} ]]; do
  if [[ ! -f ${file_to_rotate}.${curr} ]]; then
    let next=${curr}+1
    while [[ ${next} -le ${max} ]]; do
      if [[ -f ${file_to_rotate}.${next} ]]; then
        mv ${file_to_rotate}.${next} ${file_to_rotate}.${curr}
        let next=${max}+1 # don't know about ksh, if you can use break here instead
      else
        let next=${next}+1
      fi
    done
  fi
  let curr=${curr}+1
done

In your script in your first post I would have preferred mv x y instead of cp -p x y, on both places where you do the copy. For the first occurrence the "file_to_rotate" is not "rotated", it is copied to "file_to_rotate.1" but "file_to_rotate" still remains.
For second occurrence it will be the same result at the end, but if the script for some reason crashes in the middle you will have a confusing copy.
Last edited by 244an; 09-07-2012 at 08:19 AM..
# 6  
Old 09-08-2012
Hi,

I tried your script and I didn't seem to have done anything. I copy and paste your script and run it as
Code:
./x.ksh x.log 10

and nothing happens.

I do need some help with re-generating/re-naming the files with however x.log.[n] file there is before I run the log rotation.

What am trying to do is kinda like checking a set of consecutive numbers and if there is a number sequence re-do the number sequence.

For example, if am suppose to have a series of number from 1 to 10 like 1.2.3.4.5.6.7.8.9.10 and suddenly I have it a number missing that it now becomes 1.2.5.7.9.10, then I need to re-generate the number to 1.2.3.4.5.6.

It's kinda like working on a set of array where some array numbers has been pop'ed hence you need to push up some of the members. Not sure if am explaining it correctly.
# 7  
Old 09-08-2012
Like this (using ksh93)?:
Code:
#!/usr/bin/ksh93

file_to_rotate=$1
max=$2

[[ ! -f $file_to_rotate ]] && { echo "$file_to_rotate is not valid"; exit;}
((max==1)) && { cp -p "$file_to_rotate" "$file_to_rotate".1; exit;}

filearr=($(ls "$file_to_rotate".*|sort -t. -nk2))
numfiles=${#filearr[*]}
((x=$((numfiles>=max?max-2:numfiles-2))))

while (( x >= 0 ))
do
 cp -p "${filearr[$x]}" "${filearr[$((x+1))]}"
 ((x--))
done

((x==-1)) && cp -p "$file_to_rotate" "$file_to_rotate".1

Hope your filenames don't contain spaces.
Last edited by elixir_sinari; 09-08-2012 at 09:10 AM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Log rotate

Hi, I have below script in logrotate.d to rotate logs. logs are not rotating after the file grow to 1k, do you have any idea? Is it because of it just only 1K? Please let me know if the below syntax is in correct. # more trotate /sourcepath/*/servers/*/logs/*log... (2 Replies)
Discussion started by: lpprasad321
2 Replies

2. Shell Programming and Scripting

Script to rotate file log

Hi Experts, I have script on crontab and give output quite large. I would like to know how to create rotate log when the size of log maximum 50MB if the test.log is 50MB then create test.0 Thanks Edy (2 Replies)
Discussion started by: edydsuranta
2 Replies

3. Shell Programming and Scripting

"Customized" log rotate script - some advice please

Hi, Am trying to write my own version of a log rotate scripts 'coz I don't have the logrotate for other flavors of *nix servers. Probably should try and download the source and re-compile but our SA don't want to do so. Anyway, just want to know if there is any way to improve on the code... (0 Replies)
Discussion started by: newbie_01
0 Replies

4. Shell Programming and Scripting

Rotate log everyday on existing script

quick question: I have a current script that will put the output on a log file. See snapshot of the code below. I wanted this to be rotated everyday based on date. So if anyone execute the script today there will be a filecreated such as sys.log.(datetoday), if tomorrow it would be... (1 Reply)
Discussion started by: lhareigh890
1 Replies

5. Shell Programming and Scripting

Rotate log files

I have a big log,separated by the character:, one of the fields is the date in the format "day / month / year" and I need to remove the lines prior to 30 days. Can help me? (7 Replies)
Discussion started by: msanbrug
7 Replies

6. Shell Programming and Scripting

cron script to rotate log files

I have a mac server. I have been having problems with my logs. My hard disk became full, when i researched into why it was full it was due to massive log files. There was barley any log rotation policies in place on the server. I tired to use logrotate. This doesn't work on my server. It is a MAC... (19 Replies)
Discussion started by: timgolding
19 Replies

7. Shell Programming and Scripting

Script for Log Rotate

Hello, I only know the basic for shell programing. I need help for this, I thinks this is a basic for anyone who know a litle of shell scripting. I need creat a script for a rotatate logs, when a filesystem is full. I have a filesystem. The rotate consist in zip the current log (copy) and... (1 Reply)
Discussion started by: El Rengo
1 Replies

8. UNIX for Advanced & Expert Users

log rotate

hi , what is the meaning of log rotate? how do i rotate /var/adm/wtmps log and gzip it? (6 Replies)
Discussion started by: cromohawk
6 Replies

9. Shell Programming and Scripting

how to rotate log files

hi friends i need a shell script to rotate the logs in a directory, dated n days back. can anybody of help. appreciate.. (0 Replies)
Discussion started by: satya_skm
0 Replies

10. HP-UX

Check size and rotate log script.

Hi Can you suggest some perl script. My OS is HP-UX 11.11 I want to it into a cron job. Every night it will backup the file with that day's date and open a dummy file. Thanks Ash (3 Replies)
Discussion started by: ashishT
3 Replies
Login or Register to Ask a Question