Zpool showing 100% full


 
Thread Tools Search this Thread
Operating Systems Solaris Zpool showing 100% full
# 1  
Old 03-25-2014
Zpool showing 100% full

Hi,
This is Solaris-10 on Sparc. Due to some reason, one zpool size is showing 100% full, while nothing is there in that. dstr03-zone02 is a non global zone running on physical machine - dstr03
Code:
root@dstr03:/# df -h | grep -i zone02
zone02_app_pool        60G    31K   3.8G     1%    /zone02_app_pool
zone02_root_pool      8.6G    31K     0K   100%    /zone02_root_pool
zone02_app_pool/cad_apps    18G    14G   3.8G    79%    /zone/dstr03-zone02/cad/apps
zone02_app_pool/cad_envs    36G    21G    15G    58%    /zone/dstr03-zone02/cad/envs
zone02_app_pool/cad_users   2.0G   194M   1.8G    10%    /zone/dstr03-zone02/cad/users
zone02_root_pool/root   8.5G   1.4G   7.2G    16%    /zone/dstr03-zone02/root
root@dstr03:/# ls -ltr /zone02_root_pool
total 0
root@dstr03:/# du -sh /zone02_root_pool
   1K   /zone02_root_pool
root@dstr03:/# zfs get quota zone02_root_pool
NAME               PROPERTY  VALUE  SOURCE
zone02_root_pool  quota     none   default
root@dstr03:/# zfs get reservation zone02_root_pool
NAME               PROPERTY     VALUE   SOURCE
zone02_root_pool  reservation  none    default
root@dstr03:/#
 root@dstr03:/# zfs list -o space | grep -i zone02
zone02_app_pool                    3.85G  56.0G         0     31K              0      56.0G
zone02_app_pool/cad_apps           3.84G  14.2G         0   14.2G              0          0
zone02_app_pool/cad_envs           15.2G  20.8G         0   20.8G              0          0
zone02_app_pool/cad_users          1.81G   194M         0    194M              0          0
zone02_root_pool                       0  8.55G         0     31K              0      8.55G
zone02_root_pool/root              7.19G  1.36G         0   1.36G              0          0

How can I fix this ?
# 2  
Old 03-25-2014
Umounting and mounting again?
# 3  
Old 03-25-2014
I did not tried that.
Can I unmount /zone02_root_pool without harming anything ? I checked with fuser and it is not being used by any process currently.
# 4  
Old 03-25-2014
Why not?

Then if it solves, we will try to explain what was the possible cause...
# 5  
Old 03-25-2014
I tried, but no luck
Code:
root@dstr03:/# umount /zone02_root_pool
root@dstr03:/# zfs mount -a
root@dstr03:/# df -h | grep -i zone02 | grep root
zone02_root_pool/root   8.5G   1.4G   7.2G    16%    /zone/dstr03-zone02/root
zone02_root_pool      8.6G    31K     0K   100%    /zone02_root_pool

All other root pool are showing good on server (for other non global zones), which shows 1% capacity, while "available" column varies in "df -h"
# 6  
Old 04-13-2014
Compare a df -k with a du -dsk on the filesystem /zone02_root_pool
If the values are radically different, then you have a dangling filehandle (ie a process has an open handle on there but there's no directory entries pointing at it).

You can find the process in question via lsof (easy) or /usr/proc/pfiles (loop over all running processes) and look for open handles with no associated filename that are on the zpool in question. This will find you the process that's holding it as well as the filehandle for it.

If you can bounce the process, problem solved. If not, you can at least truncate the file by catting /dev/null over the top of /proc/<pid>/fd/<fd>
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. AIX

100% Inode full with only 67% FS full.

AIX Version 6.1 and 7.1. I understand that when the OS initially creates the FS and inodes, its pretty strict, but not always tuned to a 1:1 ratio. I see the same thing when adding a whole disk LV to a separate device. It seems that when we expand a filesystem the inodes don't get tuned... (5 Replies)
Discussion started by: mrmurdock
5 Replies

2. UNIX for Advanced & Expert Users

Apache - atop showing 100% memory

hello, I did some investigation before posting. i noticed that during the time when the httpd consumed 100% memory, only few swap was used. i got a link on StackOverflow that says its normal as unused memory is wasted memory on Linux. please let me have your views on this. ps: I... (2 Replies)
Discussion started by: coolatt
2 Replies

3. AIX

Paging space is 100% full

Paging space is 100% full? what step can i take (3 Replies)
Discussion started by: ramraj731
3 Replies

4. Shell Programming and Scripting

ps command showing full code of running script

Hi, I have a script running while rsync command is fired to push some files. The output of rsync cmd has been redirected to the script which is used to generate log files containing progress info with formatting. when I enter ps -ef | grep rsync it shows the full scripting code on the cmd line... (2 Replies)
Discussion started by: rajeevra
2 Replies

5. Red Hat

Disk usage showing 100% after deleting files also | Red Hat Linux 3.2.2-5

My Redhat Linux system is always showing 100& disk usage. I have removed almost all the files, but no use and I am always getting 100% disk usage.!! Filesystem 1K-blocks Used Available Use% Mounted on /dev/hda2 36337384 36066352 0 100% / I can... (7 Replies)
Discussion started by: sanoop
7 Replies

6. Linux

Disk full 100%

one of my servers / was full by 100% i cleard some space, now though i have enough space on / partition still df is showing disk usage as 100% am not able to create any single txt file ? why so ? (3 Replies)
Discussion started by: bryanabhay
3 Replies

7. AIX

/var 100% full

What to do if /var filesystem in Aix is completely full ? (2 Replies)
Discussion started by: kkhan
2 Replies

8. Solaris

when 100% full, it says some available

Just a quick question ....as per my df -k below, I have a file system marked at 100% full, why does it say there is 44,240 kb available ?? Filesystem kbytes used avail capacity Mounted on /dev/dsk/c0t0d0s0 2055463 1753694 240106 88% / /proc 0 ... (1 Reply)
Discussion started by: hcclnoodles
1 Replies

9. Solaris

/ directory is 100% full

Dear experts My / directory shows 100% full. What should I do??? What is normal size and how can I prevent it. I am using Solaris 8 on an Ultra 60. Thanks for your advises. Reza (6 Replies)
Discussion started by: Reza Nazarian
6 Replies
Login or Register to Ask a Question