12-28-2009
TAR Files Argument list too long error
Hi,
I have a requirement where I need to TAR more than 50K files.
Even though I can do TAR successfully on few 100s of files, but whenever Im trying to TAR the entire 50K files, I am getting the error message :
Argument List Too Long.
Please suggest how can i avoid this error.
Im trying : tar -cvf *.xml Arch200912.tar
Thanks in advance.
10 More Discussions You Might Find Interesting
1. Shell Programming and Scripting
Trying to tar specific files from a directory causes problems when the number of files is too large.
ls ~/logs | wc -l
5928
In the logs directory - I have 5928 files
If I want to include all files with today's date - I run the following command
tar cf ~/archive/LoadLogs_20060302.tar... (8 Replies)
Discussion started by: dad5119
8 Replies
2. UNIX for Dummies Questions & Answers
Hi,
I am trying to perform this task:
tar -cvf tar.newfile ??????.bas
I got error "arg list too long". Is ther any way around? I have about 1500 file need to be tar together.
Thanks in advance (5 Replies)
Discussion started by: jds3
5 Replies
3. UNIX for Dummies Questions & Answers
Hi
I executed the code
for file in `ls pdb*.ent`
do
new_name=`echo $file | sed 's/^pdb//;s/.ent/.txt/'`
mv $file $new_name
done
Its giving error at ' ls pdb*.ent' argument list too long
i have around 150000 entries
please help
Thank you (6 Replies)
Discussion started by: empyrean
6 Replies
4. Shell Programming and Scripting
Hi everyone,
I have a problem with my shell script. As a quick overview I need to change a template file 6561 times and copy the file into a new catalogue. Thanks to your forum I have managed to write a script to do so:
#!/bin/sh
template=$1
for values in {45,165,285}\ {45,165,285}\... (6 Replies)
Discussion started by: mario8eren
6 Replies
5. Shell Programming and Scripting
I have a wrote a script which consits of the below line.. Below of this script I'm getting this error "ksh: /usr/bin/ls: arg list too long"
The line is
log_file_time=`ssh -i $HOME/.ssh/id_rsa -q $i ls -lrt /bp/karthik/test/data/log/$abc*|tail -1|awk '{print $8}'`
And $abc alias is as "p |... (1 Reply)
Discussion started by: 22karthikreddy
1 Replies
6. Shell Programming and Scripting
Dear Experts,
I have a list of 10K files in a directory. I am not able to execute any commands lile ls -lrt, awk, sed, mv, etc........
I wanna execute below command and get the output. How can I achieve it?? Pls help.
root# awk -F'|' '$1 == 1' file_20120710* | wc -l
/bin/awk: Argument list... (2 Replies)
Discussion started by: Naga06
2 Replies
7. Shell Programming and Scripting
Hi I am using find command --
find "directory1" -type f | xargs -i mv {} "directory2"
to avoid above argument list too long problem.
But, issue i am facing is directory1 is having subdirectories due to this i am facing directory traversal problem as i dont want to traverse subdirectories... (9 Replies)
Discussion started by: VSom007
9 Replies
8. Shell Programming and Scripting
Hi Team,
Here's the situation.
I have approximately 300000 to 500000 jpg files in /appl/abcd/work_dir
mv /appl/abcd/work_dir /appl/abcd/process_dir
The above move command will work if the jpg files count is close to 50000 (not sure). If the count is less this mv command holds good. But if... (14 Replies)
Discussion started by: kmanivan82
14 Replies
9. Shell Programming and Scripting
I have a script on RedHat which runs this:
ssh -q -t -i $HOME/.ssh/my_key server2 "find ~/toCopy/*data* | xargs sudo mv -f -t /home/files/"
I'm getting:
sudo: unable to execute /bin/mv: Argument list too long
but the reason I use xargs is to avoid this restriction.
It used to work... (8 Replies)
Discussion started by: say170
8 Replies
10. UNIX for Beginners Questions & Answers
hi all
i am trying to tar and then zip files present dir by using the below command
tar -cvf ${abc}/xyz_backup_date_`date +%d%m%y%H%M%S`.tar xyz*
when the files are in less number the above command executes perfectly but when there are large number of files i am getting "arg list too... (5 Replies)
Discussion started by: manoj
5 Replies
LEARN ABOUT CENTOS
th_get_size
th_get_pathname(3) C Library Calls th_get_pathname(3)
NAME
th_get_pathname, th_get_uid, th_get_gid, th_get_mode, th_get_crc, th_get_size, th_get_mtime, th_get_devmajor, th_get_devminor,
th_get_linkname - extract individual fields of a tar header
TH_ISREG, TH_ISLNK, TH_ISSYM, TH_ISCHR, TH_ISBLK, TH_ISDIR, TH_ISFIFO - determine what kind of file a tar header refers to
TH_ISLONGNAME, TH_ISLONGLINK - determine whether the GNU extensions are in use
SYNOPSIS
#include <libtar.h>
char *th_get_linkname(TAR *t);
char *th_get_pathname(TAR *t);
mode_t th_get_mode(TAR *t);
uid_t th_get_uid(TAR *t);
gid_t th_get_gid(TAR *t);
int th_get_crc(TAR *t);
off_t th_get_size(TAR *t);
time_t th_get_mtime(TAR *t);
major_t th_get_devmajor(TAR *t);
minor_t th_get_devminor(TAR *t);
int TH_ISREG(TAR *t);
int TH_ISLNK(TAR *t);
int TH_ISSYM(TAR *t);
int TH_ISCHR(TAR *t);
int TH_ISBLK(TAR *t);
int TH_ISDIR(TAR *t);
int TH_ISFIFO(TAR *t);
int TH_ISLONGNAME(TAR *t);
int TH_ISLONGLINK(TAR *t);
VERSION
This man page documents version 1.2 of libtar.
DESCRIPTION
The th_get_*() functions extract individual fields from the current tar header associated with the TAR handle t.
The TH_IS*() macros are used to evaluate what kind of file is pointed to by the current tar header associated with the TAR handle t.
The TH_ISLONGNAME() and TH_ISLONGLINK() macros evaluate whether or not the GNU extensions are used by the current tar header associated
with the TAR handle t. This is only relevant if the TAR_GNU option was used when tar_open() was called.
SEE ALSO
tar_open(3)
University of Illinois Jan 2001 th_get_pathname(3)