Visit The New, Modern Unix Linux Community


Command to calculate space for all subdirs under a dir

 
Thread Tools Search this Thread
Homework and Emergencies Emergency UNIX and Linux Support Command to calculate space for all subdirs under a dir
# 1  
Command to calculate space for all subdirs under a dir

du -hs command calculates the space for all the subdirs under a dir ...but it is very slow if the dir is huge....is there any quick way ...I am using Sun OS.

Thanks,
Ajay
# 2  
I believe du is the fastest one.
# 3  
is there any other way ...can be write a script ...
Quote:
Originally Posted by radoulov
I believe du is the fastest one.
# 4  
You can, but it will be slower ...
# 5  
Not sure about the performance .. Test it ..
Code:
find $DIR -exec ls -ltr {} \; 2>/dev/null | nawk '{sum+=$5}END {print sum}'

# 6  
Jayjan jay!! Don't use find with exec unless you have to do stuff inside the exec!

Replace with :
Code:
find $DIR -printf "%k\n" | awk '{sum+=$1}END{print sum}'

---------- Post updated at 07:16 PM ---------- Previous update was at 06:59 PM ----------

@ajaypatil_am

Here's what you can do: find all the dirs in depth-first order, then feed each dir into du.
Code:
find $DIR -type d -print | 
  awk 'BEGIN{OFS="\t"}{ print $0,split($0,x,"/"); }'  |
  sort  -k 2nr,2 -k 1,1  | 
  cut -f1 |
  xargs -L 1  -t du -sh 2>&1 |
  $PAGER

Here's what we're doing: The find gets all the directories (your target dir is $DIR) and prints them out one line at a time. The awk command then prints out each directory name followed by its depth -- determined by the number of times split found the / character in the input line. We separate the fields by tabs to prevent long and unusual dir names from getting clobbered by the next steps. Next, sort orders the list by directory depth. Now that the list is ordered, we dont need the depth information anymore, so the cut command strips it (you can also do this with awk or sed). Finally, the resulting list is fed into xargs, which prints out and executes the command "du -sh" on each directory, one directory at a time.

The output is then sent through your $PAGER, which ought to be defined. If not, use "less" or "more" whichever works for you.

This way, you can find a particularly large directory without waiting forever for the job to finish.

Last edited by otheus; 12-20-2011 at 02:27 PM.. Reason: solaris compat edits
# 7  
Quote:
Originally Posted by ajaypatil_am
du -hs command calculates the space for all the subdirs under a dir ...but it is very slow if the dir is huge....is there any quick way ...I am using Sun OS.
No matter how you cut it, getting the total space for something means scanning inodes for each and every individual file inside. No matter how you do it, the same amount of disk thrashing will happen.

Breaking the job into smaller parts is a neat idea, otheus.

Another thing you could do is look for large directories. Directories have a file size too. Finding a large directory won't tell you how much space the contents use, or precisely how many files are inside, but will warn you about directories directly containing very large amounts of entries.
This User Gave Thanks to Corona688 For This Post:

Previous Thread | Next Thread
Thread Tools Search this Thread
Search this Thread:
Advanced Search

Test Your Knowledge in Computers #834
Difficulty: Medium
JSON supports comments.
True or False?

10 More Discussions You Might Find Interesting

1. Solaris

Running a script in a sub dir with space in it

Hi I am trying to run a script in a sub-directory, that has one space on it: such as: /internaldisk1/Task Logs1, but my entry in cron is not working: 0,5,10,15,20,25,30,35,40,45,50,55 * * * * /internaldisk1/Task\ logs1/./remov_reject.sh > /var/tmp/interd_`date '+%Y%M%d'`.log 2>&1 Please can... (4 Replies)
Discussion started by: fretagi
4 Replies

2. UNIX for Dummies Questions & Answers

Cannot cd to dir with space

I have a script that I am trying to use. I need it to run from a certain directory. I have tried the following: SCRIPT_DIR=$PWD MYDIR="/filemount/files/Move Files" cd "$MYDIR" $SCRIPT_DIR/movefiles.bash I have tried to run it. but I always get "no such file or directory" from the script... (5 Replies)
Discussion started by: newbie2010
5 Replies

3. UNIX for Dummies Questions & Answers

List files older that 7 days in a dir, excluding all subdirs

Hi, I would like to list all files, older than 7 days, in a directory, but exclude all subdirectories in the find command. If I use find . -type f -mtime +7 all files in the subdirs are also included. How can I exclude them? Regards, JW (6 Replies)
Discussion started by: jwbijl
6 Replies

4. Shell Programming and Scripting

Copy files and subdirs from dir to a new dir

Hello Comunity I am trying to make a bash shell script that it copies files and subdirs(with files) to a new dir. I would like the dest_dir to contain only subdirectories with files not other subdirs inside. it called : cpflatdir src_dir dest_dir Pleaze help me! Thank you in... (2 Replies)
Discussion started by: BTKBaaMMM
2 Replies

5. Shell Programming and Scripting

create dir in main &subdirs,perform action

Hi, I have one dir which has N subdirs.For ex: /home/user/Project_Src /home/user/Project_Src/Dir_A /home/user/Project_Src/Dir_A/subdir/sub_dir2 /home/user/Project_Src/Dir_A/subdir/sub_dir3 /home/user/Project_Src/Dir_B /home/user/Project_Src/Dir_B/Build i want to create a folder with... (2 Replies)
Discussion started by: dragon.1431
2 Replies

6. Shell Programming and Scripting

Calculate total space, total used space and total free space in filesystem names matching keyword

Good afternoon! Im new at scripting and Im trying to write a script to calculate total space, total used space and total free space in filesystem names matching a keyword (in this one we will use keyword virginia). Please dont be mean or harsh, like I said Im new and trying my best. Scripting... (4 Replies)
Discussion started by: bigben1220
4 Replies

7. Shell Programming and Scripting

substrings from all files incl subdirs into csv with dir names

Greetings! I have multiple files, one per subdirectory, all with the same file name. All subdirectories are one level deep from the main directory. The data in the files is tab delimited between fields and record delimited with a newline. The subdirectory names have the date in the... (5 Replies)
Discussion started by: vtischuk@yahoo.
5 Replies

8. Shell Programming and Scripting

sftp how to deal with space in path to dir?

OK I am trying to use something similar to this: #!/bin/sh echo "OK, starting now..." sftp -b /dev/fd/0 user@remotehost <<EOF cd pub ascii put filename.txt bye EOF only difference is the dir I need to cd to has a space in it like this /Import/Server/Prospect File ,... (3 Replies)
Discussion started by: NewSolarisAdmin
3 Replies

9. AIX

find command - no subdirs

I am looking to delete files that are of a certain age with something like the following... find /directory -type f -mtime +14 | xargs rm ....however, I would like to only execute this on the current directory and not subdirectories. Any ideas? (4 Replies)
Discussion started by: andrewsc
4 Replies

10. Shell Programming and Scripting

calculate the space

Hi everyone, I need to write a script to calculate the space for sub-folders under /home: Here is the scanrio: cd /home drwxr-xr-x 57 root root 8192 Jan 22 16:13 home_1 drwxrwxrwx 69 root root 8192 Jan 29 10:36 home_2 drwxr-xr-x 97 root root 8192 Nov... (8 Replies)
Discussion started by: za_7565
8 Replies

Featured Tech Videos