03-29-2015
There are a few things we could do to speed up processing 690,000 files, but we need a few more details to come up with something that stands a chance of working correctly and reasonably quickly. (Nothing reading 690,000 files is going to be quick, but there may be a difference between slow and SSSSLLLLLOOOOWWWW.)
- Do any of the filenames you need to move contain any of the characters, <space>, <tab>, <newline>, <single-quote>, or <double-quote>? If so, which of these characters might appear in your filenames? If some of these characters do appear in your filenames, do they appear in all of your filenames? If not, how many of your filenames (that will be moved) will contain any of these characters?
- Are all of the files you need to evaluate:
- in a single directory?
- in a single directory hierarchy?
- in several single directories?
- in several directory hierarchies?
If they are in single directories, do any of those directories contain any subdirectories?
- Are all of the selected files going to a single directory? Or, if the files are coming from a directory hierarchy, is the hierarchy to be copied to the destination directory?
- What is the minimum size, maximum size, and approximate average size (in bytes) of the files you need to evaluate?
- Is it really true that all that needs to be checked is that there are three or more hyphens on the 3rd line of a file, or do we need to verify that the line starts with a [, ends with a ], and contains at least three hyphens surrounded by one of more lowercase letters?
- Out of the 690,000 files you need to process; how many do you expect will be moved?
This User Gave Thanks to Don Cragun For This Post:
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi Friends,
Can any of you explain me about the below line of code?
mn_code=`env|grep "..mn"|awk -F"=" '{print $2}'`
Im not able to understand, what exactly it is doing :confused:
Any help would be useful for me.
Lokesha (4 Replies)
Discussion started by: Lokesha
4 Replies
2. Shell Programming and Scripting
Hi,
I have line in input file as below:
3G_CENTRAL;INDONESIA_(M)_TELKOMSEL;SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL
My expected output for line in the file must be :
"1-Radon1-cMOC_deg"|"LDIndex"|"3G_CENTRAL|INDONESIA_(M)_TELKOMSEL"|LAST|"SPECIAL_WORLD_GRP_7_FA_2_TELKOMSEL"
Can someone... (7 Replies)
Discussion started by: shis100
7 Replies
3. UNIX for Dummies Questions & Answers
strange :)
can you tell why?:cool:
#!/bin/bash
echo " enter your age "
read age
if ; then
echo " you do not have to pay tax "
elif ]; then
echo " you are eligible for income tax "
else
echo " you dont have to pay tax "
fi (3 Replies)
Discussion started by: me.
3 Replies
4. UNIX for Dummies Questions & Answers
Hi ,
i have some files of specific pattern ...i need to look for files which are having size greater than zero and move those files to another directory..
Ex...
abc_0702,
abc_0709,
abc_782
abc_1234 ...etc
need to find out which is having the size >0 and move those to target directory..... (7 Replies)
Discussion started by: dssyadav
7 Replies
5. Shell Programming and Scripting
I have a bunch of random character lines like ABCEDFG. I want to find all lines with "A" and then change any "E" to "X" in the same line. ALL lines with "A" will have an "X" somewhere in it. I have tried sed awk and vi editor. I get close, not quite there. I know someone has already solved this... (10 Replies)
Discussion started by: nightwatchrenba
10 Replies
6. UNIX for Dummies Questions & Answers
How to use "mailx" command to do e-mail reading the input file containing email address, where column 1 has name and column 2 containing “To” e-mail address
and column 3 contains “cc” e-mail address to include with same email.
Sample input file, email.txt
Below is an sample code where... (2 Replies)
Discussion started by: asjaiswal
2 Replies
7. Shell Programming and Scripting
Okay, so I have a rather large text file and will have to process many more and this will save me hours of work.
I'm not very good at scripting, so bear with me please.
Working on Linux RHEL
I've been able to filter and edit and clean up using sed, but I have a problem with moving lines.
... (9 Replies)
Discussion started by: rex007can
9 Replies
8. Shell Programming and Scripting
Hi everybody,
I am new at Unix/Bourne shell scripting and with my youngest experiences, I will not become very old with it :o
My code:
#!/bin/sh
set -e
set -u
export IFS=
optl="Optl"
LOCSTORCLI="/opt/lsi/storcli/storcli"
($LOCSTORCLI /c0 /vall show | grep RAID | cut -d " "... (5 Replies)
Discussion started by: Subsonic66
5 Replies
9. Shell Programming and Scripting
Hello.
System : opensuse leap 42.3
I have a bash script that build a text file.
I would like the last command doing :
print_cmd -o page-left=43 -o page-right=22 -o page-top=28 -o page-bottom=43 -o font=LatinModernMono12:regular:9 some_file.txt
where :
print_cmd ::= some printing... (1 Reply)
Discussion started by: jcdole
1 Replies
10. AIX
Hi 2 all,
i have had AIX 7.2
:/# /usr/IBMAHS/bin/apachectl -v
Server version: Apache/2.4.12 (Unix)
Server built: May 25 2015 04:58:27
:/#:/# /usr/IBMAHS/bin/apachectl -M
Loaded Modules:
core_module (static)
so_module (static)
http_module (static)
mpm_worker_module (static)
... (3 Replies)
Discussion started by: penchev
3 Replies
du(1) General Commands Manual du(1)
NAME
du - summarize disk usage
SYNOPSIS
type] [name]...
DESCRIPTION
The command gives the number of 512-byte blocks allocated for all files and (recursively) directories within each directory and file speci-
fied by the name operands. The block count includes the indirect blocks of the file. A file with two or more links is counted only once.
If name is missing, the current working directory is used.
By default, generates an entry only for the name operands and each directory contained within those hierarchies.
By default, when a symbolic link is encountered on the command line or in the file hierarchy, will count the size of the symbolic link
rather than the file referenced by the link, and will not follow the link to another portion of the file hierarchy.
Options
The command recognizes the following options:
Print entries for each file encountered
in the directory hierarchies in addition to the normal output.
For each name operand that is a directory for which file system swap has been enabled, print the number of blocks the swap
system is currently using.
If a symbolic link is specified on the command line,
will count the size of the file or file hierarchy referenced by the link. Unlike the option, it will not follow sym-
bolic links encountered during the traversal of the directory hierarchy.
Gives the block count in 1024-byte blocks.
If a symbolic link is specified on the command line or
encountered during the traversal of a file hierarchy, will count the size of the file or file hierarchy referenced by
the link.
Print messages about directories that cannot be read,
files that cannot be accessed, and so on. is normally silent about such conditions.
Print only the grand total of disk usage
for each of the specified name operands.
Restrict reporting to file systems of the specified
type. (Example values for type are and so on.) Multiple options can be specified. Disk usage is normally reported
for the entire directory hierarchy below each of the given name operands.
Restrict reporting to only those files
that have the same device as the file specified by the name operand. Disk usage is normally reported for the entire
directory hierarchy below each of the given name operands.
According to the standards, specifying more than one of the mutually-exclusive options and will not be considered an error. The last
option specified will determine the behavior of the utility.
EXAMPLES
Display disk usage for the current working directory and all directories below it, generating error messages for unreadable directories:
Display disk usage for the entire file system except for any or mounted file systems:
Display disk usage for files on the root volume only. No usage statistics are collected for any other mounted file systems:
WARNINGS
Block counts are incorrect for files that contain holes.
SEE ALSO
df(1M), bdf(1M), quot(1M), standards(5).
STANDARDS CONFORMANCE
du(1)