01-15-2014
The issue, as stated before, is the number of files not their sizes.
You said directories have about 2.3G of data and files are kilobytes in size so I'm guessing each directory my have 100,000 or more files.
Unix filesystems are not designed to have such large numbers of files in a single directory and performance is suffering.
Last edited by Chubler_XL; 01-15-2014 at 04:41 PM..
Reason: Spelling
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Hi,
I'm a novice and I'd like to make a directory structure with a hundred or so folders. I've tried mkdir /foo/foo1/etc...
mkdir /foo/foo2/etc
mkdir /foo/foo3/etc
mkdir /foo/foo4/etc
...but it appends '@' to each folder name and then fails on the subdirectories. Is it better to use a... (2 Replies)
Discussion started by: kamur
2 Replies
2. HP-UX
Hello,
I have a very big directory with lots of small files. Just doing a single "ls" takes eternity, so I even can't know how many files the directory has.
I need to get the newest files in the last 15 minutes, but I can't get an eficient way of doing it. I've tried find, perl, shell script,... (4 Replies)
Discussion started by: psimoes79
4 Replies
3. Shell Programming and Scripting
Hi all,
Could you please tellme the commadn which sorts the list of directories in a parent dir by their size.
Thanks. (2 Replies)
Discussion started by: firestar
2 Replies
4. UNIX for Dummies Questions & Answers
Hello,
Can somebody please explain why I have EMPTY directories on HP-UX with BIG SIZE ?
Thank you !
Double post, continued here (0 Replies)
Discussion started by: drbiloukos
0 Replies
5. HP-UX
Hello,
Can you please explain why I have various empty directories with large size ?
OS is B.11.11 (3 Replies)
Discussion started by: drbiloukos
3 Replies
6. Shell Programming and Scripting
I have been using this simple grep command to extract fields from a file that ALPHANUMERIC field has been set to 16
grep -w 'ALPHANUMERIC *16' filename
------------------------- sample data file
SAMP_RICS "SAMPLE RICS" 5694 NULL ALPHANUMERIC 60 RMTES_STRING ... (11 Replies)
Discussion started by: mnassiri
11 Replies
7. Shell Programming and Scripting
Hi all,
I have a big file (about 6 millions rows) and I have to delete same occurrences, stored in a small file (about 9000 rews). I have tried this:
while read line
do
grep -v $line big_file > ok_file.tmp
mv ok_file.tmp big_file
done < small_file
It works, but is very slow.
How... (2 Replies)
Discussion started by: Tibbeche
2 Replies
8. UNIX for Advanced & Expert Users
Hi,
I need a unix command to delete first n (say 100) lines from a log file. I need to delete some lines from the file without using any temporary file. I found sed -i is an useful command for this but its not supported in my environment( AIX 6.1 ). File size is approx 100MB.
Thanks in... (18 Replies)
Discussion started by: unohu
18 Replies
9. UNIX for Dummies Questions & Answers
Hi,
To load a big file in a table,I have a make sure that all rows in the file has same number of the columns .
So in my file if I am getting any rows which have columns not equal to 6 , I need to delete it . Delimiter is space and columns are optionally enclosed by "".
This can be ... (1 Reply)
Discussion started by: hemantraijain
1 Replies
10. Solaris
I have Solaris-10 with kernel patch 142900-03, Update 7 Sparc server.
root@ddlomps40:/# uname -a
SunOS ddlomps40 5.10 Generic_142900-03 sun4u sparc SUNW,SPARC-Enterprise
root@ddlomps40:/# cat /etc/release
Solaris 10 5/09 s10s_u7wos_08 SPARC
Copyright 2009 Sun... (5 Replies)
Discussion started by: solaris_1977
5 Replies
NWDIR(1) nwdir NWDIR(1)
NAME
nwdir - Lists files in directory
SYNOPSIS
nwdir [-h] [-v] [-l] [-t] [-d] [-e] [-f] [directory]
DESCRIPTION
nwdir lists files, directories and their attributes from the specified NetWare directory.
OPTIONS
-h
-h is used to print out a short help text.
-d
List directories like other files, rather than listing their contents.
-l
Show filename in all available namespaces.
-v
Verbose listing, display everything possible.
-e
Display OS/2 Extended Attributes.
-f
List connections using each file.
-t
Show all informations (rights, attributes, file inodes) also as hexadecimal numbers.
directory
You can specify the directory to list. Current working directory is used by default. You have to specify path in Linux format, not in
NetWare format.
EXAMPLES
nwdir -t -v /NetWare/server/sys
With this example, all files from directory /NetWare/server/sys are displayed.
AUTHORS
nwdir was written by Milan Vandrovec. See the Changes file of ncpfs for other contributors.
BUGS
Directory quotas are not displayed. User names are not taken from NDS, but only from bindery.
nwdir 4/2/1998 NWDIR(1)