Sponsored Content
Top Forums Shell Programming and Scripting Fastest way calculating directory Post 302868527 by jim mcnamara on Monday 28th of October 2013 06:53:05 AM
Old 10-28-2013
Define "not working". Your directory structure is beyond awful, performance wise, so you will never get an answer to du in a reasonable time using standard UNIX tools. du reads directories as we explained earlier.

You would have to develop a fairly complex daemon to constantly monitor each of the huge directories and then store the output on a file system separate from the big directories. Or simply wait a very long time to get an answer using UNIX tools.

If you do something about where the directory data lives, as bakunin suggested, things would get better. Not perfect.

What OS are you on? Maybe you can tune ufs or whatever filesystem you have.
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

fastest copy command

wich is the fastest command in HP-UX to copy an entire disk to dat tapes, or even disk to disk? thanks (0 Replies)
Discussion started by: vascobrito
0 Replies

2. Shell Programming and Scripting

Scripts for calculating size and remaining space of a directory automatically.

I would like to create a script for calculating size and remaining space of a directory automatically every 24 hours, then send an email to report to the admin. * POSIX and PERL are preferred. Can anyone help, please? (1 Reply)
Discussion started by: leonall
1 Replies

3. Shell Programming and Scripting

how to delete/remove directory in fastest way

hello i need help to remove directory . The directory is not empty ., it contains several sub directories and files inside that.. total number of files in one directory is 12,24,446 . rm -rf doesnt work . it is prompting for every file .. i want to delete without prompting and... (6 Replies)
Discussion started by: getdpg
6 Replies

4. UNIX for Advanced & Expert Users

Fastest way for searching the file

I want to search a file in fastest manner. Presently I am using 'find' command. But it is taking around 15min for searching. Is there any other method through which I can do it fast? (3 Replies)
Discussion started by: vaibhavbhat
3 Replies

5. AIX

Fastest way to count big amount of files in sub directory

Hi, what happened is we want to count all the files in a directory and inside this directory got many folders and so take long time to count it. Already run for about few minutes but still not done. The command we use to count is find . -type f | wc -l Just wondering if there is any other... (9 Replies)
Discussion started by: ngaisteve1
9 Replies

6. Solaris

The FASTEST copy method?

Hi Experts, I've been asked if there is a fast way to duplicate a file(10GB) and zip it at the same time. The zipped file would be FTP'd.....management is asking this. Maybe there is a better method all together? any ideas? CP will not cut it. Thanks in advance Harley (1 Reply)
Discussion started by: Harleyrci
1 Replies

7. Shell Programming and Scripting

calculating column summation in a directory of flat files

Hello Guru s I need your kind help to solve my below issue I have a directory of flat files and have to calculate sum of some columns from the flat file . Say for flat file 302 I need the column summation of 2 and 3 rd column For flat file 303 I need the column summation of 5 and... (2 Replies)
Discussion started by: Pratik4891
2 Replies

8. Shell Programming and Scripting

Calculating the epoch time from standard time using awk and calculating the duration

Hi All, I have the following time stamp data in 2 columns Date TimeStamp(also with milliseconds) 05/23/2012 08:30:11.250 05/23/2012 08:30:15.500 05/23/2012 08:31.15.500 . . etc From this data I need the following output. 0.00( row1-row1 in seconds) 04.25( row2-row1 in... (5 Replies)
Discussion started by: ks_reddy
5 Replies

9. Shell Programming and Scripting

How to Calculating space used in GB for any particular directory in UNIX?

How to Calculating space used in GB for any particular directory in unix Currently I am using : df -h which gives me space for each mout point ldndyn1:/vol/v01/dyn/sbcexp/dyn 1.1T 999G 29G 98% /sbcimp/dyn but I need for some internal particular directory... (3 Replies)
Discussion started by: RahulJoshi
3 Replies

10. Shell Programming and Scripting

Check fastest server and using it

hello we have upload some data in 15 servers in usa asia ... i consider to add new feature , script can detect download speed between localhost and destination and use fastest server, i have cut this part from a script which have this feature, download a xx MB file from all its source and... (0 Replies)
Discussion started by: nimafire
0 Replies
filebench(1)							   User Commands						      filebench(1)

NAME
filebench - framework of workloads to measure and compare filesystem performance SYNOPSIS
/usr/benchmarks/filebench/bin/filebench profile /usr/benchmarks/filebench/bin/filebench -c stats_dir... DESCRIPTION
filebench runs workloads to measure and compare filesystem performance. Full documentation can be found at the performance community at: http://www.opensolaris.org OPTIONS
The following options are supported: -c stats_dir... Generates a HTML file (index.html) that is a comparison of the specified directories. stats_dir specifies the directory or directories in which the results are stored. OPERANDS
The following operands are supported: profile Specifies the name of the configuration file ending in .prof. The configuration file specifies: o what workloads to run, o what parameters to run, o the directory path on which to operate, and o the directory path in which to store the results. EXIT STATUS
The following exit values are returned: 0 Successful completion. 1 An error occurred. 2 Invalid command line options were specified. EXAMPLES
Example 1 Running the Multi-stream Sequential Read Workload The following example runs the workloads described in the configuration file named sqread.prof: # filebench sqread Example 2 Comparing Multiple Runs The following example compares the results of two previous runs. This example assumes that the results from the two previous filebench runs were located in the directories: /stats/wombat-zfs-noel- Jun_27_2007-15h_45m_33s and /stats/wombat-ufs-noel-Jun_27_2007-15h_52m_11s. This example generates a HTML file named index.html in your current working directory. # filebench -c /stats/wombat-zfs-noel-Jun_27_2007-15h_45m_33s /stats/wombat-ufs-noel-Jun_27_2007-15h_52m_11s ATTRIBUTES
See attributes(5) for descriptions of the following attributes: +-----------------------------+-----------------------------+ | ATTRIBUTE TYPE | ATTRIBUTE VALUE | +-----------------------------+-----------------------------+ |Availability |SUNWfilebench | +-----------------------------+-----------------------------+ |Interface Stability |Uncommitted | +-----------------------------+-----------------------------+ SEE ALSO
attributes(5) SunOS 5.11 9 Oct 2007 filebench(1)
All times are GMT -4. The time now is 11:59 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy