07-12-2013
Also consider that
IF:
directory has large numbers of entries - >40K (varies with filesystem type)
Cure: make a directory tree, with each subdirectory having way smaller numbers of files.
Overly full disks can result in fragmented files which trashes update (cp overlay) performance of larger files.
So: You can experience lots of delay finding and overwriting files.
Another cause is poor inode caching. This is OS specific, I cannot comment specifically. But when you try to find a file in a directory, the kernel checks the inode cache first. If it finds the file in the cache it can open the file right away without having to scan thru a huge directory. inode caching also impacts the efficiency of PATH searching.
9 More Discussions You Might Find Interesting
1. Post Here to Contact Site Administrators and Moderators
Is the performance now very, very slow (pages take a very long time to load)? Or is it just me?
Neo (6 Replies)
Discussion started by: Neo
6 Replies
2. Shell Programming and Scripting
We have an egrep search in a while loop.
egrep -w "$key" ${PICKUP_DIR}/new_update >> ${PICKUP_DIR}/update_record_new
${PICKUP_DIR}/new_update is 210 MB file
In each iteration, the egrep on an average takes around 50-60 seconds to search. Ther'es nothing significant in the loop other... (7 Replies)
Discussion started by: hidnana
7 Replies
3. Filesystems, Disks and Memory
Hi all
We have got issues with copying a 2.6 GB file from one folder to another folder.
Well, this is not the first issue we are having on the box currently, i will try to explain everything we have done from the past 2 days.
We got a message 2 days back saying that our Production is 98%... (3 Replies)
Discussion started by: b_sri
3 Replies
4. UNIX for Dummies Questions & Answers
hi guys
We are seeing weird issues on my Linux Suse 10, it has lotus 8.5
and 1 filesystem for OS and another for Lotus Database.
the issue is when the Lotus service starts wait on top is very high about 25% percent and in general CPU usage is very high
we found that when this happens if we... (0 Replies)
Discussion started by: kopper
0 Replies
5. Shell Programming and Scripting
Hi,
i need to use "scp" to copy a file without overwriting the same in destinations.
any suggestion?
thanks
Sivaji (3 Replies)
Discussion started by: sivarajb
3 Replies
6. Shell Programming and Scripting
Please, I need help tuning my script. It works but it's too slow.
The code reads an acivity log file with 50.000 - 100.000 lines and filters error messages from it. The data in the actlog file look similar to this:
02/08/2011 00:25:01,ANR2034E QUERY MOUNT: No match found using this criteria.... (5 Replies)
Discussion started by: Miila
5 Replies
7. Shell Programming and Scripting
I have several directories and all those directories have .dat files in them. I want to copy all those .dat files to one directory say "collected_directory"
The problem is I don't want to overwrite files. So, if two file names match, I don't want the old file to be overwritten with a new one.
... (1 Reply)
Discussion started by: shoaibjameel123
1 Replies
8. Infrastructure Monitoring
There is a big problem with the server (VPS based on OpenVZ, CentOS 5, 3GB RAM). The problem is the following. The first 15-20 minutes after starting the server is operating normally, the load average is less than or about 1.0, but then begins to increase sharply% wa, then hovers around 95-99%.... (2 Replies)
Discussion started by: draiphod
2 Replies
9. Solaris
I have identical M5000 machines that are needing to transfer very large amounts of data between them. These are fully loaded machines, and I've already checked IO, memory usage, etc... I get poor network performance even when the machines are idle or copying via loopback. The 10 GB NICs are... (7 Replies)
Discussion started by: christr
7 Replies
LEARN ABOUT PHP
xfs_ncheck
xfs_ncheck(8) System Manager's Manual xfs_ncheck(8)
NAME
xfs_ncheck - generate pathnames from i-numbers for XFS
SYNOPSIS
xfs_ncheck [ -i ino ] ... [ -f ] [ -s ] [ -l logdev ] device
DESCRIPTION
xfs_ncheck with no -i arguments generates an inode number and pathname list of all files on the given filesystem. Names of directory files
are followed by /.. The output is not sorted in any particular order. The filesystem to be examined is specified by the device argument,
which should be the disk or volume device for the filesystem. Filesystems stored in files can also be checked, using the -f flag.
OPTIONS
-f Specifies that the filesystem image to be processed is stored in a regular file at device (see the mkfs.xfs -d file option). This
might happen if an image copy of a filesystem has been made into an ordinary file.
-l logdev
Specifies the device where the filesystem's external log resides. Only for those filesystems which use an external log. See the
mkfs.xfs -l option, and refer to xfs(5) for a detailed description of the XFS log.
-s Limits the report to special files and files with setuserid mode. This option may be used to detect violations of security pol-
icy.
-i ino Limits the report to only those files whose inode numbers follow. May be given multiple times to select multiple inode numbers.
If the filesystem is seriously corrupted, or very busy and looks like it is corrupt, a message of the form that would be generated by
xfs_check(8) may appear.
xfs_ncheck is only useful with XFS filesystems.
SEE ALSO
mkfs.xfs(8), xfs_check(8), xfs(5).
xfs_ncheck(8)