Directory size larger than file system size?


 
Thread Tools Search this Thread
Operating Systems Solaris Directory size larger than file system size?
# 1  
Old 12-07-2009
Power Directory size larger than file system size?

Hi,

We currently have an Oracle database running and it is creating lots of processes in the /proc directory that are 1000M in size. The size of the /proc directory is now reading 26T. How can this be if the root file system is only 13GB?

I have seen this before we an Oracle temp file was 64GB in size on a file system that was 20GB in size, and the file system reported 7GB free at the time?

Can someone please shed some light on this.

Thanks,

Sparcman
# 2  
Old 12-07-2009
# 3  
Old 12-07-2009
Thanks for your reply DukeNuke2. If the proc file system is dynamically generated, will it still effect the size of the / file system? My / file system now reports 100% full. Do I need to reboot in order to clear down the /proc file system?

Also this doesn't explain why the file system with the Oracle Temp file read 64GB and the 20GB file system reported 7GB free? Any ideas?


Thanks,

Ger.
# 4  
Old 12-07-2009
Quote:
Originally Posted by sparcman
If the proc file system is dynamically generated, will it still effect the size of the / file system?
The /proc filesystem size is not related whatsoever with the / file system size.
Quote:
My / file system now reports 100% full.
Then focus of files being on that filesystem, not other ones.
Quote:
Do I need to reboot in order to clear down the /proc file system?
That is unlikely to have any effect on / being full.
# 5  
Old 12-07-2009
Quote:
Originally Posted by sparcman
Thanks for your reply DukeNuke2. If the proc file system is dynamically generated, will it still effect the size of the / file system? My / file system now reports 100% full. Do I need to reboot in order to clear down the /proc file system?
No. If you check the output of mount, you'll see that /proc is treated as a separate mount point, and as such does not add to the usage of the root filesystem.

Also, the files in /proc only represent current processes, so the big files should vanish as soon as the associated process ends.
Quote:
Originally Posted by sparcman
Also this doesn't explain why the file system with the Oracle Temp file read 64GB and the 20GB file system reported 7GB free? Any ideas?
Could be that that was a sparse file.
Example that creates a 100M file on a 10M filesystem(uses Linux Loopback device)
Code:
# pwd
/tmp/sparse_test
# dd if=/dev/zero of=example.img bs=1024k count=10
10+0 records in
10+0 records out
10485760 bytes (10 MB) copied, 0.0421919 s, 249 MB/s
# mkfs -t ext2 example.img
[...]
# mkdir example
# mount example.img example -oloop
# mount
[...]
/tmp/sparse_test/example.img on /tmp/sparse_test/example type ext2 (rw,loop=/dev/loop0)
# df -h
Filesystem            Size  Used Avail Use% Mounted on
[...]
/tmp/sparse_test/example.img
                      9.7M   92K  9.1M   1% /tmp/sparse_test/example
# cd example/
# dd if=/dev/zero of=sparse_file bs=1 count=0 seek=100M
0+0 records in
0+0 records out
0 bytes (0 B) copied, 1.7319e-05 s, 0.0 kB/s
# ll -h
total 12K
drwx------ 2 root root  12K Dec  7 14:09 lost+found
-rw-r--r-- 1 root root 100M Dec  7 14:10 sparse_file
# df -h
Filesystem            Size  Used Avail Use% Mounted on
[...]
/tmp/sparse_test/example.img
                      9.7M   92K  9.1M   1% /tmp/sparse_test/example

# 6  
Old 12-08-2009
Here is the equivalent example (a 100 MB sparse file on a <10 MB filesystem) but using Solaris and ZFS instead of Linux loopback fs.
Code:
# zfs create -ps -V 10m rpool/volumes/vol1
# mkdir /tmp/sparse_test
# newfs /dev/zvol/dsk/rpool/volumes/vol1
newfs: construct a new file system /dev/zvol/rdsk/rpool/volumes/vol1: (y/n)? y
Warning: 4130 sector(s) in last cylinder unallocated
/dev/zvol/rdsk/rpool/volumes/vol1:    20446 sectors in 4 cylinders of 48 tracks, 128 sectors
    10.0MB in 1 cyl groups (14 c/g, 42.00MB/g, 20160 i/g)
super-block backups (for fsck -F ufs -o b=#) at:
 32,
# mount /dev/zvol/dsk/rpool/volumes/vol1 /tmp/sparse_test
# mount -p | grep vol1
/dev/zvol/dsk/rpool/volumes/vol1 - /tmp/sparse_test ufs - no rw,intr,largefiles,logging,xattr,onerror=panic
# df -h /tmp/sparse_test
Filesystem             size   used  avail capacity  Mounted on
/dev/zvol/dsk/rpool/volumes/vol1
                       7.5M   1.0M   5.7M    16%    /tmp/sparse_test
# cd /tmp/sparse_test
# dd if=/dev/zero of=sparse_file bs=1 count=1 seek=104857599
1+0 records in
1+0 records out
# ls -lh
total 64
drwx------   2 root     root        8.0K Dec  8 13:05 lost+found
-rw-r--r--   1 root     root        100M Dec  8 13:05 sparse_file
+ df -h /tmp/sparse_test
Filesystem             size   used  avail capacity  Mounted on
/dev/zvol/dsk/rpool/volumes/vol1
                       7.5M   1.0M   5.7M    16%    /tmp/sparse_test
# zfs list 
NAME                                     USED  AVAIL  REFER  MOUNTPOINT
...
rpool/volumes                           2,60M  1,31G    19K  /rpool/volumes
rpool/volumes/vol1                      2,58M  1,31G  2,58M  -
# umount -f /tmp/sparse_test
# zfs destroy rpool/volumes/vol1

Note also that Linux loopback filesystem equivalent is Solaris Loopback file driver (lofi) which would also be usable instead of a ZFS volume as I did.
# 7  
Old 12-10-2009
Thanks for your help guys. It's working fine now.
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Help with Expect script for pulling log files size larger than 500Mb;

I am new at developing EXPECT scripts. I'm trying to create a script that will automatically connect to a several UNIX (sun solaris and HPUX) database server via FTP and pull the sizes of the listener/alert log files from specified server directory on the remote machines. 1. I want the script... (7 Replies)
Discussion started by: mikebantor
7 Replies

2. Programming

Size of a directory or a file

Hello, Here is my code: :~$ truncate -s 16M MyTestFile.txt :~$ du -h MyTestFile.txt 4,0K MyTestFile.txt Q1: Please why du -h does not work in this case ? Q2: Other than "du -h", how can i get the size of a directory (using linux command) Thanks a lot. Best Regards. (2 Replies)
Discussion started by: chercheur111
2 Replies

3. UNIX for Dummies Questions & Answers

Ls directory size reporting byte size instead of file count

I have been searching both on Unix.com and Google and have not been able to find the answer to my question. I think it is partly because I can't come up with the right search terms. Recently, my virtual server switched storage devices and I think the problem may be related to that change.... (2 Replies)
Discussion started by: jmgibby
2 Replies

4. Shell Programming and Scripting

How to delete some of the files in the directory, if the directory size limits the specified size

To find the whole size of a particular directory i use "du -sk /dirname".. but after finding the direcory's size how do i make conditions like if the size of the dir is more than 1 GB i hav to delete some of the files inside the dir (0 Replies)
Discussion started by: shaal89
0 Replies

5. Shell Programming and Scripting

Script to read file size and send email only if size > 0.

Hi Experts, I have a script like $ORACLE_HOME/bin/sqlplus username/password # << ENDSQL set pagesize 0 trim on feedback off verify off echo off newp none timing off set serveroutput on set heading off spool Schemaerrtmp.txt select ' TIMESTAMP COMPUTER NAME ... (5 Replies)
Discussion started by: welldone
5 Replies

6. Shell Programming and Scripting

The scripts not able to make the file to size 0, every times it go back to its original size

#!/bin/sh ########################################################################################################## #This script is being used for AOK application for cleaning up the .out files and zip it under logs directory. # IBM # Created #For pdocap201/pdoca202 .out files for AOK #1.... (0 Replies)
Discussion started by: mridul10_crj
0 Replies

7. Shell Programming and Scripting

Size of file and directory

Hello. I do have a problem. The statement sounds like this: Given a directory, find all subdirectories (regardless of depth) which contain a file that has more than a half of the size of the respective subdirectory. I've tried to solve this in many ways, but all I came up with is half... (1 Reply)
Discussion started by: WorkOfArt
1 Replies

8. Programming

how to get the file system size

I have the next code, and the output is incosistent, what is the problem: free blocks: 1201595 block size: 4096 total size(free blocks * block size): 626765824 1201595 * 4096 not is 626765824, what's the problem??? #include <sys/statvfs.h> #include <stdio.h> int main(){ ... (1 Reply)
Discussion started by: lucaxvu
1 Replies

9. AIX

file system size

Dear ALL Today I faced one problem in the file system, during invoking the command #df -k , I saw /usr reached to 95% Used, could any one give advice ? thanks & regarded (7 Replies)
Discussion started by: magasem
7 Replies

10. Solaris

command to find out total size of a specific file size (spread over the server)

hi all, in my server there are some specific application files which are spread through out the server... these are spread in folders..sub-folders..chid folders... please help me, how can i find the total size of these specific files in the server... (3 Replies)
Discussion started by: abhinov
3 Replies
Login or Register to Ask a Question