Login or Register to Ask a Question and Join Our Community


Solaris

Need help to understand zfs rpool space allocation

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Operating Systems Solaris Need help to understand zfs rpool space allocation
# 1  
Old 03-22-2016
Error Need help to understand zfs rpool space allocation
Hi,

I am unable to understand that, in one of my servers while

Code:
df -kh

Filesystem                     Size   Used  Available Capacity  Mounted on
rpool/ROOT/solaris-2     98G	11G	29G      29%              /

Even the Root FS filled on 40gb and system becomes unstable.

it is showing 40gb usable and whole size is 98gb.

Code:
root@xxx # zpool iostat -v rpool
   capacity	operations	bandwidth
pool	alloc   free   read  write   read  write
----------  -----  -----  -----  -----  -----  -----
rpool	   67.7G  31.8G	  0	23  5.59K   414K
  c2d0	  67.7G  31.8G	  0	23  5.59K   414K

root@xxx # zfs get volsize rpool/dump
NAME        PROPERTY  VALUE  SOURCE
rpool/dump  volsize   15G    local
root@xxx # zfs get volsize rpool/swap
NAME        PROPERTY  VALUE  SOURCE
rpool/swap  volsize   32G    local
root@xxx # zfs list
NAME                         USED  AVAIL  REFER  MOUNTPOINT
ldom1pool                    500G  1.12T    32K  legacy
ldom1pool/opt               36.1G  1.12T  36.1G  /opt
ldom1pool/opt-abc          149G  1.12T   149G  /opt/abc
ldom1pool/opt-def        84.2G  1.12T  84.2G  /opt/def
ldom1pool/opt-ghi          31K  1.12T    31K  /opt/ghi
ldom1pool/swap               231G  1.12T   224G  -
ldom1pool/u02                 31K  1.12T    31K  /u02
ldom1pool/u03                 31K  1.12T    31K  /u03
ldom1pool/u04                 31K  1.12T    31K  /u04
rpool                       69.2G  28.7G  73.5K  /rpool
rpool/ROOT                  14.5G  28.7G    31K  legacy
rpool/ROOT/solaris-2        14.5G  28.7G  11.5G  /
rpool/ROOT/solaris-2/var    2.07G  28.7G  2.00G  /var
rpool/VARSHARE              1.39G  28.7G  1.39G  /var/share
rpool/dump                  15.5G  29.2G  15.0G  -
rpool/export                4.79G  28.7G    32K  /export
rpool/export/home           4.79G  28.7G  9.75M  /export/home
rpool/export/home/u#      143M  28.7G   143M  /export/home/u1
rpool/export/home/u#    32.5M  28.7G  32.5M  /export/home/u#
rpool/export/home/u#     35K  28.7G    35K  /export/home/u#
rpool/export/home/u#  4.61G  28.7G  4.61G  /export/home/u#
rpool/export/home/u#    35K  28.7G    35K  /export/home/u#
rpool/export/home/u#    38.5K  28.7G  38.5K  /export/home/u#
rpool/export/home/u#     35K  28.7G    35K  /export/home/u#
rpool/swap                  33.0G  29.7G  32.0G  -

Please help me to understand where the rest space gone.
Last edited by Don Cragun; 03-22-2016 at 03:49 AM.. Reason: Add CODE and ICODE tags.
# 2  
Old 03-22-2016
Take a look of the output of following commands :
Code:
zfs get -r reservation,refreservation,quota,refquota rpool
zfs list -t snapshot -r rpool
beadm list

Perhaps that will offer a clearer picture of status of your rpool zpool regarding space, reservation, quotas and such.

On the first glance, you have 32 GB of swap space defined inside rpool, do you require that much for some reason ?
You might want to define a new device or even a swap file on different disk/pool and free the rpool of mentioned 32GB.

Regards
Peasant.
This User Gave Thanks to Peasant For This Post:
anuragr
# 3  
Old 03-22-2016
Just have a look to the column labeled "REFER" in "zfs list" output. It shows for each dataset the actual size occupied by that dataset.

Out of a 100 GB pool, 32 GB is taken by the swap area, 15 GB by the dump area, 11.5 by the root file system, 4.61 Gb by a user's file system, 2 GB by /var, 1.39 GB by /var/share. All remaining datasets are much smaller. The sum of all REFER values is 70 GB which match the 29 GB available you got with "df".

I would recommend being careful with reducing the swap size unless you really know how much swap your system might need in the future. Relocating the swap elsewhere, as already suggested by Peasant, would on the other hand be a good idea and the simplest way to recover 32 GB of disk space in your root pool. You might also relocate your 15 GB dump area elsewhere but there are more constraints about the receiving pool.
This User Gave Thanks to jlliagre For This Post:
anuragr
# 4  
Old 03-23-2016
Hi,

Please find the o/p of said commands,

Code:
root@xxx # zfs get -r reservation,refreservation,quota,refquota rpool
NAME                              PROPERTY        VALUE  SOURCE
rpool                             reservation     none   default
rpool                             refreservation  none   default
rpool                             quota           none   default
rpool                             refquota        none   default
rpool/ROOT                        reservation     none   default
rpool/ROOT                        refreservation  none   default
rpool/ROOT                        quota           none   default
rpool/ROOT                        refquota        none   default
rpool/ROOT/solaris-2              reservation     none   default
rpool/ROOT/solaris-2              refreservation  none   default
rpool/ROOT/solaris-2              quota           none   default
rpool/ROOT/solaris-2              refquota        none   default
rpool/ROOT/solaris-2@install      reservation     -      -
rpool/ROOT/solaris-2@install      refreservation  -      -
rpool/ROOT/solaris-2@install      quota           -      -
rpool/ROOT/solaris-2@install      refquota        -      -
rpool/ROOT/solaris-2/var          reservation     none   default
rpool/ROOT/solaris-2/var          refreservation  none   default
rpool/ROOT/solaris-2/var          quota           none   default
rpool/ROOT/solaris-2/var          refquota        none   default
rpool/ROOT/solaris-2/var@install  reservation     -      -
rpool/ROOT/solaris-2/var@install  refreservation  -      -
rpool/ROOT/solaris-2/var@install  quota           -      -
rpool/ROOT/solaris-2/var@install  refquota        -      -
rpool/VARSHARE                    reservation     none   default
rpool/VARSHARE                    refreservation  none   default
rpool/VARSHARE                    quota           none   default
rpool/VARSHARE                    refquota        none   default
rpool/dump                        reservation     none   default
rpool/dump                        refreservation  15.5G  local
rpool/dump                        quota           -      -
rpool/dump                        refquota        -      -
rpool/export                      reservation     none   default
rpool/export                      refreservation  none   default
rpool/export                      quota           none   default
rpool/export                      refquota        none   default
rpool/export/home                 reservation     none   default
rpool/export/home                 refreservation  none   default
rpool/export/home                 quota           none   default
rpool/export/home                 refquota        none   default
rpool/export/home/u#           reservation     none   default
rpool/export/home/u#           refreservation  none   default
rpool/export/home/u#           quota           none   default
rpool/export/home/u#           refquota        none   default
rpool/export/home/u#          reservation     none   default
rpool/export/home/u#          refreservation  none   default
rpool/export/home/u#          quota           none   default
rpool/export/home/u#          refquota        none   default
rpool/export/home/u#         reservation     none   default
rpool/export/home/u#         refreservation  none   default
rpool/export/home/u#         quota           none   default
rpool/export/home/u#         refquota        none   default
rpool/export/home/u#        reservation     none   default
rpool/export/home/u#        refreservation  none   default
rpool/export/home/u#        quota           none   default
rpool/export/home/u#        refquota        none   default
rpool/export/home/u#        reservation     none   default
rpool/export/home/u#        refreservation  none   default
rpool/export/home/u#        quota           none   default
rpool/export/home/u#        refquota        none   default
rpool/export/home/u#          reservation     none   default
rpool/export/home/u#          refreservation  none   default
rpool/export/home/u#          quota           none   default
rpool/export/home/u#          refquota        none   default
rpool/export/home/u#         reservation     none   default
rpool/export/home/u#         refreservation  none   default
rpool/export/home/u#         quota           none   default
rpool/export/home/u#         refquota        none   default
rpool/swap                        reservation     none   default
rpool/swap                        refreservation  33.0G  local
rpool/swap                        quota           -      -
rpool/swap                        refquota        -      -
You have new mail in /var/mail/root
root@xxx # zfs list -t snapshot -r rpool
NAME                               USED  AVAIL  REFER  MOUNTPOINT
rpool/ROOT/solaris-2@install      1.01G      -  2.03G  -
rpool/ROOT/solaris-2/var@install  70.8M      -  96.8M  -
root@xxx # beadm list
BE        Active Mountpoint Space  Policy Created
--        ------ ---------- -----  ------ -------
solaris-2 NR     /          17.51G static 2015-02-26 22:47

---------- Post updated 03-23-16 at 12:45 AM ---------- Previous update was 03-22-16 at 11:40 PM ----------

Hi,

I am completely new to zfs, can you plz suggest the way by which i can first remove and then recreate swap and dump to other place which can be referred by system.

I know i am asking for too much but plz help, if it would be solaris 10 then i can do all but here i need help or any reference for it.

**This system is very very critical
Last edited by DukeNuke2; 03-23-2016 at 06:59 AM..
# 5  
Old 03-23-2016
Quote:
Originally Posted by anuragr
I am completely new to zfs, can you plz suggest the way by which i can first remove and then recreate swap and dump to other place which can be referred by system.
Here are some useful starting points:

https://docs.oracle.com/cd/E23824_01.../device-7.html

https://docs.oracle.com/cd/E23824_01...448/ggrln.html

https://docs.oracle.com/cd/E26502_01...html#scrolltoc

https://docs.oracle.com/cd/E26502_01...hdumps-31.html

https://docs.oracle.com/cd/E53394_01...umpadm-1m.html

Quote:
if it would be solaris 10 then i can do all but here i need help or any reference for it
The method would have been essentially the same with Solaris 10 if installed with root ZFS.

Quote:
**This system is very very critical
Then, build a test system where you experience and familiarize with the technology before attempting any change on that system. Note that a "very very critical system" should have an alternate boot environment ready to take over should you need to rollback for some reason. This is doesn't look to be the case with yours.
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

Solaris 10 & 11 ZFS Space Monitoring

Hi Folks! Its been a while since I worked with ZFS but basically, I need to monitor free space for Solaris 10 & 11 systems (with & without zones) I am hoping that any space commands only need to be run from the global zone (to simplify matters) However, I'm not not sure if there are exceptions... (2 Replies)
Discussion started by: GazinLincoln
2 Replies

2. Solaris

Trying to create ZFS slice on rpool

I have a 240GB disk as rpool. I have installed Solaris 11.3 to a partition which is 110GB. Now I have another 130GB which is unallocated. I want to use that additional space as a temporary folder to be shared between Solaris and Linux. The additional space had no /dev/dsk/c2t4... entry so I used... (8 Replies)
Discussion started by: kebabbert
8 Replies

3. Solaris

Zfs out of disk space

hi, have no a lot of experience with zfs so perhaps the question is quite simple but i didn't find any reasonable info how to resolve it. thus, fresh solaris installation 14GB in 86 files copied after that got msg No space left on device (28) in spite of according to stat there is... (4 Replies)
Discussion started by: bindto
4 Replies

4. Solaris

ZFS: /system/zones "respawning" on rpool

Hi, I have this fresh installation of Solaris 11.3 sparc. I have two zfs pools both using two disks in mirroring mode, both are online. I want to move /system/zones, currently rpool/VARSHARE/zones, from rpool to the other zfs pool so my zones don't consume space on the disks allocated to... (1 Reply)
Discussion started by: X96
1 Replies

5. Solaris

Zfs rpool size

Hi everyone, I am doing housekeeping of my Solaris 11 for zfs snapshot to reduce the snapshot size. I have already cleared the / file system, however the rpool size still not reduced. Filesystem Size Used Available Capacity Mounted on rpool/ROOT/solaris-2 98G 6.9G ... (2 Replies)
Discussion started by: freshmeat
2 Replies

6. Red Hat

Disk Space Allocation

Hi, I have installed RHEL6 on a HP Dl360 with 2 x 300G disk drives. The logical volume (SMART ARRY) uses RAID 0+1. All file systems occupy a max of 50G in disk space leaving 250G free disk space. A possible 100G will get used for the application later. My question is, will creating a... (1 Reply)
Discussion started by: Duffs22
1 Replies

7. Solaris

Splitting rpool mirror disk in ZFS

Hi, I have Solaris-10 (release-7) box without any non global zone. I have a very critical change after couple of days from application side. For safer side, we want to keep few level of backups just in case of faliure. This server is having three pool root@prod_ddoa01:/# zpool list NAME SIZE... (2 Replies)
Discussion started by: solaris_1977
2 Replies

8. Solaris

ZFS rpool physical disk move

I'd like to finish setting up this system and then move the secondary or primary disk to another system that is the exact same hardware. I've done things like this in the past with ufs and disk suite mirroring just fine. But I have yet to do it with a zfs root pool mirror. Are there any... (1 Reply)
Discussion started by: Metasin
1 Replies

9. Solaris

Unable to understand disk layout and where are the free space

Hi I am unable to understand the disk layout of one of my disk attached to v240. This is newly installed system from jumpstart. I am unable to see the free space on backup slice 2 and there are 0 to 8 slices listed when I run format and print the disk info, also there is no reference of... (9 Replies)
Discussion started by: kumarmani
9 Replies
Login or Register to Ask a Question