finding largest directories in a filesystem - Shell Programming and Scripting

GKnight · #1 04-29-2008

I'm trying to come up with a way of finding largest directories in a filesystem (let's say filesystems is running ot of space and I need to find what is consuming all the space). If a directory is a single filesystem, then it's easy, I just run "du -sk *| sort -nr". But the problem is, if some subdirectories are on separate filesystems, then it will show those as well. It's especially hard to get filesystem usage on / since I have many filesystems on some boxes. I tried "du -skx *" but it still shows directories in child filesystems. Then I tried to do it with find command:

Code:

find . -xdev -type d -exec du -sk {} \; | sort -nr | head -10

Despite -xdev switch, I still get the child filesystems in the output. Is there another way of accomplishing this? I'm a bit stumped at the moment. Any advice will be appreciated!

danmero · #2 04-29-2008

man du (-x)

shamrock · #3 04-29-2008

Replace "*" with the name of the largest filesystem.

Code:

du -kx /fs

Mr.Aketi · #4 04-29-2008

Hi,

You can check the largest files under directories and subdirectories by using the following command.

ls -lR | sort +4 -5nr | head -10

R -- will check the files under subdirectories

Thanks,
Aketi

GKnight · #5 04-30-2008

Quote:

Originally Posted by shamrock

Replace "*" with the name of the largest filesystem.

Code:

du -kx /fs

Thanks, this works! Gives me a bit too much info though (I only really want to see parent directories, not subdirectories):

Code:

:/]# du -kx / |sort -nr|head -10
5312843 /
4527973 /usr
1951796 /usr/lib
1735880 /usr/share
952800  /usr/lib/ooo-1.1
743964  /usr/lib/ooo-1.1/program
613476  /usr/lib/ooo-1.1/program/resource
381064  /usr/share/doc
310004  /opt
284383  /var

I threw together a little script, maybe there's a better way to do it but seems like it works:

Code:

:/]# for DIR in `ls -1`; do mount | grep /"$DIR" | grep -v /"$DIR"/ > /dev/null || du -skx $DIR; done |sort -nr|head
4527973 usr
310004  opt
284383  var
85468   lib
62344   etc
19056   RedHat
15580   sbin
1668    tmp
468     media
200     dev

era · #6 04-30-2008

The ls in backticks is not really Useful. I guess you can also cut out the second grep by anchoring the end of the search string.

Code:

for DIR in *; do
   mount | grep /"$DIR$" > /dev/null || du -skx "$DIR";
done |sort -nr|head

GKnight · #7 04-30-2008

Quote:

Originally Posted by era

The ls in backticks is not really Useful. I guess you can also cut out the second grep by anchoring the end of the search string.

Code:

for DIR in *; do
   mount | grep /"$DIR$" > /dev/null || du -skx "$DIR";
done |sort -nr|head

Thanks... I was originally using "find" and when I realized it wasn't doing me any good I switched to "ls". I forgot I can just use a wild card

The grep situation is a bit tricky. I'm really looking for a string in the "mount" output that does "not" have / at the end. For example, if I'm at / and have a filesystem mounted at /ks-images/rhel4, I still want to include /ks-images in my output. So came up with a stupid trick of first looking for "/ks-images" and then looking for anything that doesn't match "/ks-images/". "$" doesn't help, in fact the mount point is not even at the end of the line. I'm sure there's a better way, I could use help with this...

More UNIX and Linux Forum Topics You Might Find Helpful
Thread	Thread Starter	Forum	Replies	Last Post
largest field , awk , help	jkl_jkl	Shell Programming and Scripting	6	3 Days Ago 03:21 PM
Expression for Finding Multiple Directories..??	meskue	Shell Programming and Scripting	3	07-10-2006 12:04 PM
Finding executable files in all directories	CSGUY	UNIX for Dummies Questions & Answers	4	04-19-2005 03:34 PM
Finding largest file in current directory?	AusTex	High Level Programming	1	03-13-2005 10:03 AM
finding directories in UNIX	yodaddy	UNIX for Dummies Questions & Answers	1	11-08-2001 10:26 AM

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Linear Mode Switch to Hybrid Mode Switch to Threaded Mode