Login or Register to Ask a Question and Join Our Community


HP-UX

/var partition full need help

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Operating Systems HP-UX /var partition full need help
# 8  
Old 02-24-2012
Please post the current:
Code:
bdf
du -skx /var/* | sort -n | egrep -v ^0

For some reason your previous "du" does not seem to be complete.

Also please post the output from this search for large files:
Code:
find /var/ -xdev -type f -size +10000000c -exec ls -lad {} \;

Last edited by methyl; 02-24-2012 at 09:20 AM..
This User Gave Thanks to methyl For This Post:
Shirishlnx
# 9  
Old 02-24-2012
@vbe Thanks Sir !!

My stm is about 23MB and syslog is just 1 MB as below have already archived syslog logs ..thanks for giving info about stm .
Code:
<root@pb>/var # du -skx stm | awk '{print $1/1024 "\t\t"$2}'
23.7422         stm
<root@pb>/var # cd -
/var/stm
<root@pb>/var/stm # du -skx * |  awk '{print $1/1024 "\t\t"$2}'
0                    catalog
4.27344         config
9.17188         data
10.2969         logs
<root@pb>/var/stm #
<root@pb>/var/stm/logs/sys # bdf  /var
Filesystem          kbytes    used   avail %used Mounted on
/dev/vg00/lvol9    6144000 6133200   10800  100% /var

<root@pb>/var/adm # du -skx * |  awk '{print $1/1024 "\t\t"$2}' | sort -nr
1845.64         sw
1.02344         syslog
0.476562       wtmp
0.28125         cron

# 10  
Old 02-24-2012
What do you get for du's opinion of the total disc space used in /var?
Code:
du -skx /var

So far your posts only add up to about 2Gb.
# 11  
Old 02-24-2012
What I really ment was more : When things grow abnormally fast in /var, look first in stm !
the logs hardly grow till something make them go bezeurk...
Here you see after I passed on the box and checked throughly:
Code:
civ:/var/stm/logs/sys $ date
Fri Feb 24 18:47:36 MET 2012
civ:/var/stm/logs/sys $ ps -ef|grep  iagm|grep -v grep
    root  9732     1  0 11:55:07 ?         0:07 /usr/sbin/stm/uut/bin/sys/diagmond
civ:/var/stm/logs/sys $ ll
total 178
-rw-r--r--   1 root       root         64208 Feb 24 11:56 activity_log
-rw-rw-r--   1 root       sys            878 May  5  2010 config.stm
-rw-r--r--   1 root       root          4648 Feb 24 11:55 diaglogd_activity_log
-rw-r--r--   1 root       root          5608 Feb 24 11:55 memlogd_activity_log
-rw-r--r--   1 root       sys           5872 Feb 24 11:55 scan_hw_log

Dead calm since...
Then there is /var/tombstones, with all sort of HW dumps when things go wrong...or systrem crashes, beware the system will increment each time so once your system is settled ( no bugs - HW issues) cleanup all of them to start as "new"
This User Gave Thanks to vbe For This Post:
Shirishlnx
# 12  
Old 02-24-2012
@Methyl,
Was archived some sanmgr log files and some of syslog.log and mail.log and also all coda and pm logs .
Have restarted the system some 3 day back successfully .

Here's the o/p you asked above .
Code:
# bdf
Filesystem          kbytes    used   avail %used Mounted on
/dev/vg00/lvol3    1540096  269472 1260704   18% /
/dev/vg00/lvol1     497584   60880  386944   14% /stand
/dev/vg00/lvol9    6144000 6133600   10400  100% /var
/dev/vgignite/lvdata
                   46080000 42112000 3939816   91% /var/opt/ignite/recovery/archives
/dev/vg00/lvol6    6144000 2017720 4094352   33% /usr
/dev/vg00/lvol5    1024000  533375  460016   54% /u01_local
/dev/vg00/lvol4    1228800  560808  662936   46% /tmp
/dev/vgignite/software
                   5120000 3466942 1565621   69% /software
/dev/vg00/lvol8    7905280 6064768 1826440   77% /opt
/dev/vg00/lvol7    1024000  530200  490008   52% /home
/dev/vg00/lvol10   10240000 8616296 1576150   85% /depot

<root@pb>/var/opt/ignite # du -skx /var
6121776 /var

<root@pb>/var/stm/logs/sys #
<root@pb>/var # du -skx /var/* | sort -n | egrep -v ^0
8 /var/aa
8 /var/aaa
8 /var/ovsuf
8 /var/ovsuf.orig
16      /var/statmon
24      /var/run
32      /var/config.txt
192     /var/dt
392     /var/preserve
408     /var/asx
416     /var/yp
472     /var/spool
648     /var/sam
760     /var/tombstones
2440    /var/tmp
10528   /var/ios
24312   /var/stm
74776   /var/vx
1892024 /var/adm
4113808 /var/opt
<root@pb>/var #

below cmd o/p is too big have SNIP FOR LAST 15 DAYS ...
/var/ -xdev -type f -size +10000000c -exec ls -lad {} \; 

got fèw files which got suddenly increase in last 15 days .. are as below
<root@pb>/var/opt/ignite # find /var/ -xdev -type f -mtime -15 -size +10000000c -exec ls -lad {} \; | sort -nr
-rw-r--r--   1 root       sys        25427968 Feb 24 03:41 /var/opt/omni/db40/datafiles/cdb/fn1.ext
-rw-r--r--   1 root       sys        22544384 Feb 18 19:11 /var/opt/omni/db40/datafiles/cdb/fn3.ext
-rw-r--r--   1 root       sys        207421440 Feb 24 03:41 /var/opt/omni/db40/datafiles/cdb/fnames.dat
-rw-r--r--   1 root       sys        16809984 Feb 18 18:43 /var/opt/omni/db40/datafiles/cdb/fn4.ext
-rw-r--r--   1 root       sys        15368192 Feb 24 03:41 /var/opt/omni/db40/datafiles/cdb/dirs.dat
-rw-r--r--   1 root       root       10000158 Feb 24 16:40 /var/opt/sanmgr/commandview/server/logs/OldServerTrace.txt
-rw-r--r--   1 bin        sys        10004881 Feb 22 01:00 /var/opt/ignite/clients/0x00306E2C31A7/recovery/2012-02-22,01:00/flist
-rw-r--r--   1 bin        sys        10004763 Feb 15 01:00 /var/opt/ignite/clients/0x00306E2C31A7/recovery/2012-02-15,01:00/flist
-rw-------   1 root       root       34117764 Feb 18 19:26 /var/opt/omni/db40/dcbf/ca3d090e_4b84d566_4aae_0001_4F083C18.dat
ar

As I see some files /var/opt/omni/db40/datafiles/cdb/fnames.dat is increased suddenly to about 40+MB in last 10 days ..

Was looking for instead of doing something with application files if can move any non critical OS dir to some other partitions and create symlink in /var

--Shirish
Last edited by Shirishlnx; 02-24-2012 at 02:24 PM..
# 13  
Old 02-24-2012
You can try to look in /var/opt to see if you can move some non-system stuff elsewhere and use simlinks, better still : I did this on one box...
Check (especially oracle...) what is /var/tmp if symbolic link forget about it if not, move its content to /tmp and create a symlink /var/tmp-->/tmp
Before check that no one has open files ( well if you are moving its less important...) and more important no one new is going to use it the time of the modification...

If you have oracle installed be sure you have enough space in /tmp (make it 1.5 GB to be safe and keep it 1GB free when using orainstaller...)
# 14  
Old 02-25-2012
Well we've found the missing 4 Gigabytes in /var now your post includes /var/opt !

Looks like you are running a gigantic Omniback Cell Manager on a server with inadequate disc space.
Consider planning to move /var/opt/omni to another substantially larger filesystem and get it out of /var - or even moving Omniback to a brand new dedicated backup server . You don't seem to have any suitable mounted spare disc space at the moment.
The file /var/opt/omni/db40/datafiles/cdb/fnames.dat is the master directory of filenames for all your non-expired backups. Your backup policy needs review because this server has inadequate disc space to store the Omniback directory files.

Imho. This server is grossly undersized and needs more disc drives fitted.


Ps. I suspect that the reason your Ignite backups are so large is because you have so much in vg00 .



Can you drill down to find the really big directories in /var/opt just in case there is another one as well as /var/opt/omni?
Code:
du -skx /var/opt/* | sort -n | egrep -v ^0

Last edited by methyl; 02-25-2012 at 01:22 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

/var/audit full

Hi, I have Solaris-10 (having multiple non global zones running on it). Its /var is getting full to 100% and I can see, there are files getting added to /var/audit. There are large in number, so even if I clearing them, it is filling /var. In past 24 hours, there are 53000 files are added. I am... (1 Reply)
Discussion started by: solaris_1977
1 Replies

2. UNIX for Dummies Questions & Answers

How can partition out /var with these two separate 10 gigabyte disks?

In my company ,there is a mail server that services approximately 3,000 users. 2,000 users access their email via a POP-3 service, while the remaining 1,000 users access their email via a Unix mail reader. Recently users have complained about speed of disk access, so a new 10 gigabyte disk has... (1 Reply)
Discussion started by: lemon_06
1 Replies

3. Solaris

Install with /var in separate partition - Zfs / 10

This is my first time working with ZFS on Solaris 10. I am trying to set up /var in a separate partition from /. During the installation, I came across the ZFS settings where I selected disks 0 and 1 to be mirrored with ZFS. Next was the option to have /var and / on separate datasets. Is... (3 Replies)
Discussion started by: 6L71
3 Replies

4. AIX

/var/spool/squeue gets full frequently

hi, im new in aix administration.. months ago, I received mails, everytime a cron was executed. but now, I don't receive these mails.. and the /var/spool/squeue, gets full frequently. i'd like to know more information about this, what can i do?? sendmail is up, because, I executed ps -ef |grep... (5 Replies)
Discussion started by: fdeivis
5 Replies

5. AIX

/var filesystem is full

Hi, Is there a way to clear the temp files from /var/tmp? Is root access required to delete the files? Thanks, Narayan (2 Replies)
Discussion started by: narayanv
2 Replies

6. BSD

Moving /var partition to USB stick

I am currently running DesktopBSD as a live-CD and need to have a large /var partition because it is currently too small. I have a USB stick which is BSD formatted, and would like to have the /var partition moved over to it. How can this be done? Could I for instance use a symlink? (1 Reply)
Discussion started by: figaro
1 Replies

7. Filesystems, Disks and Memory

partition out /var

Hi If You were the systems administrator of a mail server that services approximately 3,000 users. 2,000 users access their email via a POP-3 service, while the remaining 1,000 users access their email via a Unix mail reader. Recently users have complained about speed of disk access, so a new 10... (1 Reply)
Discussion started by: semaphore
1 Replies

8. AIX

/var 100% full

What to do if /var filesystem in Aix is completely full ? (2 Replies)
Discussion started by: kkhan
2 Replies

9. UNIX for Dummies Questions & Answers

Full Partition?

Hi Everyone, I think I've filled up one of the partitions on my drive. I suspect that one of the applications I've been running has been spitting out junk files to this partition - most of which can be deleted. The problem is that I have no idea how to go look at what's on that partition and... (2 Replies)
Discussion started by: Choppy
2 Replies

10. HP-UX

i-node full on /var

Can anyone tell me how would I troubleshoot when /var becomes full with inodes? This is on HP11.11 system. Where used is 92%, ifree is 1891 iuse is 88%. Thanks. (3 Replies)
Discussion started by: catwomen
3 Replies
Login or Register to Ask a Question