Script to clear filesystem


 
Thread Tools Search this Thread
Operating Systems HP-UX Script to clear filesystem
# 1  
Old 05-09-2017
Script to clear filesystem

Hi,

I have created a script to clear up the /var filesystem once it reaches > 90%.
This is part of the script :

Code:
#!/bin/bash

DIR = ./adm
DIR2=./adm/sw
DIR3 = ./spool/mqueue
DIR4 = ./adm/syslog
DIR5 = ./adm/sulog
DIR6 = ./tmp
F1 = ./tmp/dead.letter
F2 = ./adm/wtmps
file1 = dead.letter
file2 = wtmps

dir=`du -x | sort -rn | head -20`
cd /var
for i in $dir;
do
	if [ -d "$DIR1" ]; then
		cd "$DIR1"
			if [ -f "$file2" ]; then
			 cat /dev/null > "$file2"
	elif [ -d "$DIR2" ]; then
		tar -cvf /temp/admsw.arch "$DIR2";
		rm -rf "$DIR2"
	elif [ -d "$DIR3" ]; then
		find "$DIR3" -mtime +100 -exec rm {} \;			
	elif [ -d "$DIR4" ]; then

	elif [ -d "$DIR5" ]; then	
		
	elif [ -d "$DIR6" ]; then
		cd "$DIR6"
			if [ -f "$file1" ]; then
				rm -f "$file1"
 			fi
	elif [ -f "$F1" ]; then
		rm -f "$F1"
	elif [ -f "$F2" ]; then
		cat /dev/null > "$F2"
	fi
done

To test if this script works, I execute the command in the terminal (only to clear one of the filesystems above). However it seemed to run for an extremely long time. Therefore I sensed that something could be wrong with the statements I used - perhaps the for loop?

These are the steps I executed :

Code:
# cd /var
# dir=`du -x | sort -rn | head -20`
# DIR2=./adm/sw
#for i in $dir;
>do
>if [ -d "$DIR2" ]; then
>tar -cvf /temp/admsw.tar "$DIR2";
>fi
>done

Are the above steps correct? Why does the command run for a long time?

Last edited by anaigini45; 05-09-2017 at 07:58 AM..
# 2  
Old 05-09-2017
Have you tried removing all of your ELIF commands, and only work with each DIR one-by-one? That would allow you to se which of those eight commands is your culprit.
# 3  
Old 05-09-2017
Is /temp part of root volume group or separated ?
Can you check sar -d 3 10 # <-- example 10 times every 3 sec
You can use -b options as well to check how the I/O is going on.

Do you have databases or other applications running on root vg disk(s) ?

Check out the process table using ps command and top
You are looking for 'runaway' processes, zombies or anything that actually is issuing intensive I/O.

Feel free to post those here, obfuscating information if any.

Omiting -v tar option could provide some performance benefit as well, again depending on the mostly CPU resources available.
# 4  
Old 05-10-2017
Why do you run a for loop with variable i but then do nothing with $i?
# 5  
Old 05-10-2017
A suggestion for an alternate approach:

Code:
#!/bin/bash

DIRS=(./adm ./adm/sw ./tmp)
FILES=(dead.letter wtmps)

for CURRENT_DIR in "${DIRS[@]}" ; do
  if [ -d $CURRENT_DIR ] ; then
      for CURRENT_FILE in "${FILES[@]}" ; do
        if [ -f $CURRENT_DIR/$CURRENT_FILE ] ; then
           cat /dev/null >$CURRENT_DIR/$CURRENT_FILE
        fi
      done
  fi
done

Not exactly what you are doing. But maybe it helps with optimizing.
# 6  
Old 05-10-2017
Your script does not work for several reasons.
The du -x ... is run in the current directory.
root's home directory is / so it takes very long to traverse all the files. Then, the du output consists of numbers and directories. The for loop cycles through all of them. The code in the loop is run over and over again.
Now you know why it takes so long.
--
Once upon a time I created a script that rotates HP-UX system log files.
Useful on systems that are not regularly rebooted.
It is run by the crontab entry:
Code:
10 3 1 * * /usr/lib/newsyslog

And the executable /usr/lib/newsyslog looks like this
Code:
#!/bin/sh
# idea from Sun's newsyslog script
# HP-UX version
#
MIN_BLOCKS=2048 # rotate if >1MB
MAX_HIST=3 # .0 through .3
#
# access rotated files with
# last -f /var/adm/wtmp.0
# last -Xf /var/adm/wtmps.0
# lastb -f /var/adm/btmp.0
# lastb -Xf /var/adm/btmps.0
#
pgrepx(){
UNIX95=1 ps -C "$1" -o pid=
}
#
testlog(){
 for _i do
  [ -s "$_i" ] &&
   [ -n "`find "$_i" -prune -type f -size +"$MIN_BLOCKS"`" ] &&
   return
 done
}
#
rotatelog(){
 log=$1
 method=${2:-mv}
 i=$MAX_HIST
 while [ $i -gt 0 ]
 do
  j=`expr $i - 1`
  test -f $log.$j && mv $log.$j $log.$i
  i=$j
 done
 $method $log $log.0
 > $log
}
#
umask 22
LOGS="
/var/adm/syslog/syslog.log
/var/adm/syslog/mail.log
"
action=""
for log in $LOGS
do
 if testlog $log
 then
  rotatelog $log "mv"
  action=1
 fi
done
[ -n "$action" ] &&
 chmod 644 /etc/syslog.pid &&
 kill -HUP `cat /etc/syslog.pid`
#
LOGS="
/var/opt/omni/log/inet.log
/var/opt/omni/log/debug.log
"
action=""
for log in $LOGS
do
 if testlog $log
 then
  rotatelog $log "mv"
  action=1
 fi
done
#
umask 2
LOGS="
/var/adm/wtmps
/var/adm/wtmp
/var/adm/btmps
/var/adm/btmp
/var/adm/sulog
/var/adm/lp/lpd.log
"
# rotate all non-zero files or none
action=""
if testlog $LOGS
then
 for log in $LOGS
 do
  if [ -s $log ]
  then
   rotatelog $log "cp -p"
   action=1
  fi
 done
fi
#
# finally rotate the cron logs
umask 22
LOGS="
/var/adm/cron/log
"
action=""
cronstart=/sbin/init.d/cron
[ -f $cronstart ] && {
for log in $LOGS
do
 if testlog $log
 then
  rotatelog $log "mv"
  action=1
 fi
done
# restart cron a bit time-shifted
[ -n "$action" ] &&
 sleep 1 &&
 sh $cronstart stop &&
 sleep 1 &&
 sh $cronstart start
}
#

If you have understood it, you can add more things to the LOGS= strings.

Last edited by MadeInGermany; 05-10-2017 at 04:57 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Need to exclude .NFSxxx files in clear old files batch script

I am new to Shell Scripting and need some help. The following batch job has been failing for me due to the .nfsxxx files in use. I need to know how to modify the following script to exclude the .nfsxxx files so this batch job will not fail on me. I have done lots of googling and keep coming back... (2 Replies)
Discussion started by: kimberlyg2007
2 Replies

2. AIX

Help with clear printer queue script in AIX 5.3

Good day UNIX forum, could you help me with my clear printer queue script, i have problems with the consistency of this function, sometimes it works sometimes it doesn't. Thanks in advance } preRemovePrintQ(){ clear; echo; echo... (1 Reply)
Discussion started by: beware187
1 Replies

3. AIX

Mount Filesystem in AIX Unable to read /etc/filesystem

Dear all, We are facing prolem when we are going to mount AIX filesystem, the system returned the following error 0506-307The AFopen call failed : A file or directory in the path name does not exist. But when we ls filesystems in the /etc/ directory it show -rw-r--r-- 0 root ... (2 Replies)
Discussion started by: m_raheelahmed
2 Replies

4. UNIX for Dummies Questions & Answers

hwo to find shared filesystem and local filesystem in AIX

Hi, I wanted to find out that in my database server which filesystems are shared storage and which filesystems are local. Like when I use df -k, it shows "filesystem" and "mounted on" but I want to know which one is shared and which one is local. Please tell me the commands which I can run... (2 Replies)
Discussion started by: kamranjalal
2 Replies

5. Shell Programming and Scripting

Filesystem Usage Script

Hey guys I am learning Linux and I am working on script for a college class project to check usage of file system. I pulled this from a different site but have to tweak it a little to work but I still get errors. Here is what I got so far. ALERT=5 function main_prog() { while read output;... (1 Reply)
Discussion started by: jcsx6245
1 Replies

6. Shell Programming and Scripting

Monitoring Script - filesystem

Hi all, I got an error when running this script (from BigAdmin community) the error is test: argument expected my server version is SunOS XXX 5.8 Generic_117350-46 sun4u sparc SUNW,Sun-Fire-V890 any idea on it? #! /usr/bin/ksh ### ### This script can be run from cron to... (9 Replies)
Discussion started by: SmartAntz
9 Replies

7. AIX

Help with a filesystem monitoring script.

I'd like to create a cron script that checks filesystems. For example if it reaches 95% USED, I'd like it to send me an email. Can this be possible for up to say 4 filesystems using the df -k command? Any samples to get me started would be much appreciated. (7 Replies)
Discussion started by: NycUnxer
7 Replies

8. Shell Programming and Scripting

How to clear $1 when dot-running a script.

Here's my problem: the $1 parameter is getting permanently set when you dot-run a script - and I cannot unset it. Here's how to duplicate the problem: 1) Create a script called testme and put this simple command in the script: echo 1=$1 Save the script 2) Make the testme script... (12 Replies)
Discussion started by: HobieCoop
12 Replies

9. Linux

SED/AWK Script to clear log file using timestamp?

I have a log file on our system which fills up with lines that have been timestamped, as follows.... 03/03/2008 10:56:06:815] (ERROR) balance: continuing session to genapp02 : 18500 03/03/2008 10:56:06:820] (ERROR) balance: continuing session to genapp02 : 18500 03/03/2008 10:56:07:003]... (2 Replies)
Discussion started by: davesimm
2 Replies

10. Shell Programming and Scripting

Clear Case, Awk and script

Hello. I should have asked this awhile ago but here is my situation. My task is to generate LOC for different directories. I have a text file that has dates in this format (01-Aug-2006). My task is to read each line and compare it to a branch date. Depending on the date, it should generate a... (0 Replies)
Discussion started by: mastachef
0 Replies
Login or Register to Ask a Question