03-02-2006
Argument list too long - Shell error
Trying to tar specific files from a directory causes problems when the number of files is too large.
ls ~/logs | wc -l
5928
In the logs directory - I have 5928 files
If I want to include all files with today's date - I run the following command
tar cf ~/archive/LoadLogs_20060302.tar ~/logs/LoadLog_20060302_*.log
However, I get the following error:
/usr/bin/tar: Argument list too long
Any suggestions on how to correct this would be appreciated.
Thanks,
Rick
Last edited by dad5119; 03-02-2006 at 04:31 PM..
10 More Discussions You Might Find Interesting
1. UNIX for Dummies Questions & Answers
Hi
I executed the code
for file in `ls pdb*.ent`
do
new_name=`echo $file | sed 's/^pdb//;s/.ent/.txt/'`
mv $file $new_name
done
Its giving error at ' ls pdb*.ent' argument list too long
i have around 150000 entries
please help
Thank you (6 Replies)
Discussion started by: empyrean
6 Replies
2. Shell Programming and Scripting
Hi,
I have a requirement where I need to TAR more than 50K files.
Even though I can do TAR successfully on few 100s of files, but whenever Im trying to TAR the entire 50K files, I am getting the error message :
Argument List Too Long.
Please suggest how can i avoid this error.
Im... (2 Replies)
Discussion started by: unx100
2 Replies
3. Shell Programming and Scripting
Hi everyone,
I have a problem with my shell script. As a quick overview I need to change a template file 6561 times and copy the file into a new catalogue. Thanks to your forum I have managed to write a script to do so:
#!/bin/sh
template=$1
for values in {45,165,285}\ {45,165,285}\... (6 Replies)
Discussion started by: mario8eren
6 Replies
4. Shell Programming and Scripting
I have a wrote a script which consits of the below line.. Below of this script I'm getting this error "ksh: /usr/bin/ls: arg list too long"
The line is
log_file_time=`ssh -i $HOME/.ssh/id_rsa -q $i ls -lrt /bp/karthik/test/data/log/$abc*|tail -1|awk '{print $8}'`
And $abc alias is as "p |... (1 Reply)
Discussion started by: 22karthikreddy
1 Replies
5. Shell Programming and Scripting
I have a huge set of files (with extension .common) in my directory around 2 million. When I run this script on my Linux with BASH, I get /bin/awk: Argument list too long
awk -F'\t' '
NR == FNR { a=NR }
NR != FNR {
sub(".common", "", FILENAME)
print a, FILENAME, $1
}
'... (1 Reply)
Discussion started by: shoaibjameel123
1 Replies
6. Shell Programming and Scripting
Dear Experts,
I have a list of 10K files in a directory. I am not able to execute any commands lile ls -lrt, awk, sed, mv, etc........
I wanna execute below command and get the output. How can I achieve it?? Pls help.
root# awk -F'|' '$1 == 1' file_20120710* | wc -l
/bin/awk: Argument list... (2 Replies)
Discussion started by: Naga06
2 Replies
7. Shell Programming and Scripting
Hi,
i am having some trouble with the below command, can some one suggest me the better way to do it.
grep -l 'ReturnCode=1' `find $Log -newer /tmp/Failed.tmp -print | xargs ls -ld | egrep SUB | egrep -ve 'MTP' -ve 'ABC' -ve 'DEF' -ve 'JKL' -ve 'XYZ' | awk '{print $9}'` > $Home1
Its... (2 Replies)
Discussion started by: Prateek007
2 Replies
8. Shell Programming and Scripting
Hi I am using find command --
find "directory1" -type f | xargs -i mv {} "directory2"
to avoid above argument list too long problem.
But, issue i am facing is directory1 is having subdirectories due to this i am facing directory traversal problem as i dont want to traverse subdirectories... (9 Replies)
Discussion started by: VSom007
9 Replies
9. Shell Programming and Scripting
Hi Team,
Here's the situation.
I have approximately 300000 to 500000 jpg files in /appl/abcd/work_dir
mv /appl/abcd/work_dir /appl/abcd/process_dir
The above move command will work if the jpg files count is close to 50000 (not sure). If the count is less this mv command holds good. But if... (14 Replies)
Discussion started by: kmanivan82
14 Replies
10. Shell Programming and Scripting
I have a script on RedHat which runs this:
ssh -q -t -i $HOME/.ssh/my_key server2 "find ~/toCopy/*data* | xargs sudo mv -f -t /home/files/"
I'm getting:
sudo: unable to execute /bin/mv: Argument list too long
but the reason I use xargs is to avoid this restriction.
It used to work... (8 Replies)
Discussion started by: say170
8 Replies
TAR(1) General Commands Manual TAR(1)
NAME
tar - archiver
SYNOPSIS
tar key [ file ... ]
DESCRIPTION
Tar saves and restores file trees. It is most often used to transport a tree of files from one system to another. The key is a string
that contains at most one function letter plus optional modifiers. Other arguments to the command are names of files or directories to be
dumped or restored. A directory name implies all the contained files and subdirectories (recursively).
The function is one of the following letters:
c Create a new archive with the given files as contents.
x Extract the named files from the archive. If a file is a directory, the directory is extracted recursively. Modes are restored if
possible. If no file argument is given, extract the entire archive. If the archive contains multiple entries for a file, the lat-
est one wins.
t List all occurrences of each file in the archive, or of all files if there are no file arguments.
r The named files are appended to the archive.
The modifiers are:
v (verbose) Print the name of each file treated preceded by the function letter. With t, give more details about the archive entries.
f Use the next argument as the name of the archive instead of the default standard input (for keys x and t) or standard output (for
keys c and r).
u Use the next (numeric) argument as the user id for files in the output archive. This is only useful when moving files to a non-Plan
9 system.
g Use the next (numeric) argument as the group id for files in the output archive.
EXAMPLES
Tar can be used to copy hierarchies thus:
{cd fromdir; tar c .} | {cd todir; tar x}
SOURCE
/sys/src/cmd/tar.c
SEE ALSO
ar(1), bundle(1), tapefs(1)
BUGS
There is no way to ask for any but the last occurrence of a file.
File path names are limited to 100 characters.
The tar format allows specification of links and symbolic links, concepts foreign to Plan 9: they are ignored.
TAR(1)