03-03-2009
Performance Hit With Many Files
Is it slower to open or create a file in a directory with 1 million files than a directory with 1000 files? How much slower? Where can I find information about this?
I'm mainly concerned about JFS on AIX, but also NTFS on Windows Server. Is there a difference?
I'm trying to determine a good way to store a large number of files (2 million and growing about 200 K per year). Currently, I have them in six different directories, so it's about 300 K files per directory.
Thanks!
9 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
I reinstalled my Linux box with RedHat 7.2 and used the ext3 journaling file system. This thing is a pig now. There isn't much running on the box, and performance is sad. (1 Reply)
Discussion started by: 98_1LE
1 Replies
2. Shell Programming and Scripting
Hi all, I have a php file that grabs xml, parses it and updates my db accordingly. I want to automate the execution of this process, rather than having to hit the url manually.
I have been looking into using cron to execute a script to do this, however i'm not exactly sure what command i would... (1 Reply)
Discussion started by: restivz77
1 Replies
3. Programming
hi,
in my application, i have set up to capture SIGINT and execute a handler.the problem is whenever i hit C-c, multiple SIGINT are sent to the application.I have blocked the SIGINT right after catching the first one but it is unsuccessful.Here is what i do :
jmp_buf main_loop;
int... (1 Reply)
Discussion started by: Sedighzadeh
1 Replies
4. Shell Programming and Scripting
I have a unix shell script (ex.sh) written.
How to find out how many users (incl. myself) have run this .sh ?
I can insert code snipet at top of script if need be.
- Ravi (2 Replies)
Discussion started by: ravi368
2 Replies
5. Shell Programming and Scripting
Hi.. I need to get the following output from the input file like this
INPUT
GRM1 GRM1 0
GRM1 ABC1 1
GRM1 FEQ1 2
GRM1 SED1 3
ABC2 GRM1 0
ABC2 ABC2 1
ABC2 FEQ1 2
ABC2 BED1 3
SED1 SED1 0
SED1 SED1 1
SED1 SED1 2
SED1 ABC1 3
OUTPUT: (7 Replies)
Discussion started by: empyrean
7 Replies
6. SuSE
Hello,
I'm having trouble looking for info for SUSIE on this CVE-2012-4681.
This is basically the newest Java hit. It is mostly a web browser issue but I would like to see if the versions on our servers are vulnerable. I already found the pages/info for Solaris and RHEL.
Any help would be... (4 Replies)
Discussion started by: bitlord
4 Replies
7. Cybersecurity
Hello,
I'm having an issue with VNC. Security at work says that they scanned my servers (Solaris, RHEL, SLES) and found that you don't need a password to access a VNC session. I have tested this and you can't login to the VNC session without a password. Can someone tell what the Retina scanner... (1 Reply)
Discussion started by: bitlord
1 Replies
8. Shell Programming and Scripting
Hello,
I am looking to hit a URL using curl and click on submit button so that I can get the results. The below is the code
<input name="tos_accepted" id="tos_accepted" class="button" type="submit" value="Yes, I Agree"/>
<input name="tos_discarded" id="tos_discarded"... (1 Reply)
Discussion started by: Kochappa
1 Replies
9. Shell Programming and Scripting
Hi Gurus,
I need to merge two files.
file1 (small file, only one line)
this is first linefile2 (large file)
abc
def
ghi
... I use below command to merge the file, since the file2 is really large file, the command read whole file2, the performance is not good.
cat file1 > file3... (7 Replies)
Discussion started by: green_k
7 Replies
LEARN ABOUT DEBIAN
ntfsprogs
NTFSPROGS(8) System Manager's Manual NTFSPROGS(8)
NAME
ntfsprogs - tools for doing neat things with NTFS
OVERVIEW
ntfsprogs is a suite of NTFS utilities based around a shared library. The tools are available for free and come with full source code.
TOOLS
mkntfs(8) - Create an NTFS filesystem.
ntfscat(8) - Dump a file's content to the standard output.
ntfsclone(8) - Efficiently clone, backup, restore or rescue NTFS.
ntfscluster(8) - Locate the files which use the given sectors or clusters.
ntfscmp(8) - Compare two NTFS filesystems and tell the differences.
ntfscp(8) - Copy a file to an NTFS volume.
ntfsfix(8) - Check and fix some common errors, clear the LogFile and make Windows perform a thorough check next time it boots.
ntfsinfo(8) - Show information about NTFS or one of the files or directories within it.
ntfslabel(8) - Show, or set, an NTFS filesystem's volume label.
ntfsls(8) - List information about files in a directory residing on an NTFS.
ntfsresize(8) - Resize NTFS without losing data.
ntfsundelete(8) - Recover deleted files from NTFS.
AUTHORS
The tools were written by Anton Altaparmakov, Carmelo Kintana, Cristian Klein, Erik Sornes, Giang Nguyen, Holger Ohmacht, Lode Leroy,
Matthew J. Fanto, Per Olofsson, Richard Russon, Szabolcs Szakacsits, Yura Pakhuchiy and Yuval Fledel.
AVAILABILITY
The ntfsprogs are part of the ntfs-3g package which can be downloaded from:
http://www.tuxera.com/community/
SEE ALSO
ntfs-3g(8)
ntfs-3g 2012.1.15AR.5 September 2007 NTFSPROGS(8)