03-10-2004
Unix File System performance with large directories
Hi,
how does the Unix File System perform with large directories (containing ~30.000 files)?
What kind of structure is used for the organization of a directory's content, linear lists, (binary) trees?
I hope the description 'Unix File System' is exact enough, I don't know more about the file system in use there...
Regards, Dirk
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
how can i see the list of directories, mounted on a filesystem?
example, to show the list of directories mounted on / for aix (8 Replies)
Discussion started by: yls177
8 Replies
2. AIX
Hi
I have a filesystem cache which is around 20G in size and I'm a bit perplexed as to what is in it.
I'm running Sybase on the machine with the db on raw volumes and a tempdb on a ramdisk.
My understanding is that raw volumes are not cached and I assumed that the ramdisk is not either. Am... (1 Reply)
Discussion started by: mgibbons
1 Replies
3. UNIX for Advanced & Expert Users
Dear all,
On my UNIX server there is an apache web log file. The rate of logging of data in this file is very high. I want to extract user logging log from this file in run time. As soon as the user logging log logged in this file I want to redirect this user log into another file.
I want to... (4 Replies)
Discussion started by: zing_foru
4 Replies
4. Shell Programming and Scripting
Hello Gurus,
We are facing some performance issue in UNIX. If someone had faced such kind of issue in past please provide your suggestions on this .
Problem Definition:
/Few of load processes of our Finance Application are facing issue in UNIX when they uses a shell script having below... (19 Replies)
Discussion started by: KRAMA
19 Replies
5. Programming
how is it possible for a directory to be empty and still have a size greater than 0 in bytes...
i made a shell script that shows info about all files/directories and this is what came up
the last one is the size, here its showing 1024
in the for loop i did something like
for h in * .*; do
... (4 Replies)
Discussion started by: omega666
4 Replies
6. Red Hat
Hi,
I've some directory that I used as working directory for a program. At the end of the procedure, the content is deleted. This directory, when I do a ls -l, appears to still take up some space. After a little research, I've seen on a another board of this forum that it's not really taking... (5 Replies)
Discussion started by: bdx
5 Replies
7. Red Hat
My code
Hi All,
I am having redhat linux 5.3 (Tikanga) with GFS file system and its very very slow for executing ls -ls command also.Please see the below for 2minits 12 second takes.
Please help me to fix the issue.
$ sudo time ls -la BadFiles |wc -l
0.01user 0.26system... (3 Replies)
Discussion started by: susindram
3 Replies
8. Shell Programming and Scripting
I have around 300 files(*.rdf,*.fmb,*.pll,*.ctl,*.sh,*.sql,*.prog) which are of large size.
Around 8000 keywords(which will be in the file $keywordfile) needed to be searched inside those files.
If a keyword is found in a file..I have to insert the filename,extension,catagoery,keyword,occurrence... (8 Replies)
Discussion started by: millan
8 Replies
9. HP-UX
Hi Folks,
Could anyone please assist me with the what could be the scenarios to test the file system mount/umount performance check in HPUX.
Thanks in advance,
Vaishey (5 Replies)
Discussion started by: Vaishey
5 Replies
10. Shell Programming and Scripting
Hello,
For several of our scripts we are using awk to search patterns in files with data from other files. This works almost perfectly except that it takes ages to run on larger files. I am wondering if there is a way to speed up this process or have something else that is quicker with the... (15 Replies)
Discussion started by: SDohmen
15 Replies
LEARN ABOUT REDHAT
file::spec::win32
File::Spec::Win32(3pm) Perl Programmers Reference Guide File::Spec::Win32(3pm)
NAME
File::Spec::Win32 - methods for Win32 file specs
SYNOPSIS
require File::Spec::Win32; # Done internally by File::Spec if needed
DESCRIPTION
See File::Spec::Unix for a documentation of the methods provided there. This package overrides the implementation of these methods, not the
semantics.
devnull
Returns a string representation of the null device.
tmpdir
Returns a string representation of the first existing directory from the following list:
$ENV{TMPDIR}
$ENV{TEMP}
$ENV{TMP}
SYS:/temp
C:/temp
/tmp
/
The SYS:/temp is preferred in Novell NetWare.
Since Perl 5.8.0, if running under taint mode, and if the environment variables are tainted, they are not used.
catfile
Concatenate one or more directory names and a filename to form a complete path ending with a filename
canonpath
No physical check on the filesystem, but a logical cleanup of a path. On UNIX eliminated successive slashes and successive "/.". On
Win32 makes
dir1dir2dir3....dir4 -> dirdir4 and even
dir1dir2dir3...dir4 -> dirdir4
splitpath
($volume,$directories,$file) = File::Spec->splitpath( $path );
($volume,$directories,$file) = File::Spec->splitpath( $path, $no_file );
Splits a path in to volume, directory, and filename portions. Assumes that the last file is a path unless the path ends in '\', '\.',
'\..' or $no_file is true. On Win32 this means that $no_file true makes this return ( $volume, $path, undef ).
Separators accepted are and /.
Volumes can be drive letters or UNC sharenames (\servershare).
The results can be passed to "catpath" to get back a path equivalent to (usually identical to) the original path.
splitdir
The opposite of catdir().
@dirs = File::Spec->splitdir( $directories );
$directories must be only the directory portion of the path on systems that have the concept of a volume or that have path syntax that
differentiates files from directories.
Unlike just splitting the directories on the separator, leading empty and trailing directory entries can be returned, because these are
significant on some OSs. So,
File::Spec->splitdir( "/a/b/c" );
Yields:
( '', 'a', 'b', '', 'c', '' )
catpath
Takes volume, directory and file portions and returns an entire path. Under Unix, $volume is ignored, and this is just like catfile().
On other OSs, the $volume become significant.
Note For File::Spec::Win32 Maintainers
Novell NetWare inherits its File::Spec behaviour from File::Spec::Win32.
SEE ALSO
File::Spec
perl v5.8.0 2002-06-01 File::Spec::Win32(3pm)