Arg list too long error while performing tar and zip operation Post: 303031456

Login or Register to Ask a Question and Join Our Community

Sponsored Content

Top Forums UNIX for Beginners Questions & Answers Arg list too long error while performing tar and zip operation Post 303031456 by Corona688 on Thursday 28th of February 2019 01:33:52 PM

Old

02-28-2019

Registered User

Quote:

Originally Posted by stomp

If your tar supports -T / --files-from:

Code:

ls xyz* | tar --files-from=- --create --file ${abc}/backup_file.tar

...or short...

Code:

ls xyz* | tar -cT - -f ${abc}/backup_file.tar

See: Linux Manpages Online - man.cx manual pages

Cramming too many arguments into ls doesn't stop them from being too many arguments. When this happens you have to give up shell globbing.

Code:

rm -f backup_file.tar
ls | grep "^xyz" | xargs tar -rcf backup_file.tar
gzip backup_file.tar

xargs will run tar several times, as many as needed, to append every file to the tarball. (This is why there's an rm -- so that if you run it twice, it will start over instead of making the existing tarball bigger.)

This is less efficient than -T or cpio, especially in that it can't compress the tarball until after it's finished. But if those aren't options, this is how you can do it.

Corona688

View Public Profile for Corona688

Visit Corona688's homepage!

Find all posts by Corona688

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

arg list too long

I do ls -l ABC*, I get arg list too long message. This will not happen if ABC* has small no of files I believe 4000 files is limit. Any way of avoiding this. I even tried like this for i in `ls -l ABC*` do echo $i done Same problem. Any solution would be great. I am on HP-UX...

2. UNIX for Advanced & Expert Users

arg list too long

Does anyone have a solution for arg list too long error. I have got this from the web but I fail to make any sense out of it Thanks enc

3. UNIX for Dummies Questions & Answers

ls -t arg list too long

echo dirname/filename* | xargs ls -t As a substitute doesn't give the results desired when I exceed the buffer size. I still want the files listed in chronological order, unfortunately xargs releases the names piecemeal...does anyone have any ideas? :(

4. UNIX for Dummies Questions & Answers

arg list too long when mv files?

hello all i need some help because i am a unix/linux dummy...i have the following: DIR1> has 121437 files in it with varying dates going back to early April, a sub dir DIR1/DIR2> has 55835 files in it I need to move all files (T*.*) out of DIR1 into DIR2 that are older than today? Ive been...

5. UNIX for Dummies Questions & Answers

arg list too long when trying to tar files

Hi, I am trying to perform this task: tar -cvf tar.newfile ??????.bas I got error "arg list too long". Is ther any way around? I have about 1500 file need to be tar together. Thanks in advance

6. UNIX for Dummies Questions & Answers

Arg List too Long in SCP

Hey guys. I have a program written in which i am trying to get the files from one remote machine and transferring the files to another remote machine using SCP. It works fine for 50 or 60 files but when the files grows to 250 then i get an error message stating "Arg list too long". #scp -p...

7. Shell Programming and Scripting

arg list too long

Hi, Help. I have a file that contains a list of users in a file. I want to cat the content of the file and feed it into sed to a preformated report. The error I got is "ksh: /usr/bin/sed: arg list too long" My method below. A=`cat FILE1.txt` B=`echo $A` sed "s#USERLIST#$B#" FILE2 >...

8. Shell Programming and Scripting

ls command - strange error - arg list too long

I am running a shell script which has the following command ls *.pdf | wc -l error: arg list too long Please post your thoughts on this..

9. Shell Programming and Scripting

arg list too long error

Hello, I'm trying to search through 30,000 files in 1 directory, and am getting the "arg list too long" error. I've searched this forum and have been playing around with xargs and can't get that to work either. I'm using ksh on Solaris. Here's my original code: nawk "/Nov 21/{_=2}_&&_--"...

10. UNIX for Dummies Questions & Answers

Arg list too long

Hello All, I am trying to find a file name with .sh exention from a list of .dat files inside a directory. find /app/folder1/* -name '*.dat'| xargs grep '.sh' ksh: /usr/local/bin/find: arg list too long Please help me finding the command. Thanks

LEARN ABOUT MOJAVE

vfs-filesystems

vfs-filesystems(n)														vfs-filesystems(n)

__________________________________________________________________________________________________________________________________________________

NAME

       vfs-filesystems - Filesystems provided by tclvfs

SYNOPSIS

       package require Tcl  8.4

       package require vfs  ?1.2.1?

       package require vfs::zip  ?1.0?

       package require vfs::mk4  ?1.6?

       package require vfs::tar  ?0.9?

       package require vfs::ftp  ?1.0?

       package require vfs::ns	?1.0?

       package require vfs::webdav  ?0.1?

       package require vfs::http  ?0.5?

       package require vfs::urltype  ?1.0?

       vfs::zip::Mount path to

       vfs::mk4::Mount path to

       vfs::tar::Mount path to

       vfs::ftp::Mount path to

       vfs::ns::Mount path to

       vfs::webdav::Mount path to

       vfs::http::Mount path to

       vfs::urltype::Mount path to

_________________________________________________________________

DESCRIPTION

       The  package  vfs  provides  not  only  the means to implement a virtual filesystem at the tcl level, but also a number of ready to be used
       filesystems as well.

       Each of these filesystem exists as its own package, and can be accessed through package require vfs::NAME.  The whole set of these  virtual
       filesystems is known informally as 'vfslib'.

SUPPORTED VFS TYPES

       Currently  supported are ftp, tar, http, zip, mk4, ns, and webdav.  In addition there is the ability to mount any 'urltype' as a new direc-
       tory, provided an appropriate vfs is supported.	This means that you can treat urls based on the schemes ftp://,  http://  and  file://	as
       files.	To  do	this, simply evaluate the command vfs::urltype::Mount ftp for example.	Any access inside the new volume will result in an
       attempt to require a package through package require vfs::${type}, which must therefore exist, or errors will be thrown.  If  a	filesystem
       is loaded, use the associated command listed below to mount a source for that filesystem as a tcl directory.

       vfs::zip::Mount path to
	      Mount the zip file path as directory to.

       vfs::mk4::Mount path to
	      Mount the metakit database file file path as directory to.

       vfs::tar::Mount path to
	      Mount the tar file path as directory to.

       vfs::ftp::Mount path to
	      Mount the ftp url path as directory to.

       vfs::ns::Mount path to
	      Mount the tcl namespace path as directory to.

       vfs::webdav::Mount path to
	      Mount the webdav url path as directory to.

       vfs::http::Mount path to
	      Mount the http url path as directory to.

       vfs::urltype::Mount path to
	      Mount the url path, of type urltype as directory to.

LIMITATIONS

       Most of the vfs types listed above have not been very well debugged as yet.  Please test them!

SEE ALSO

       vfs, vfs-fsapi

KEYWORDS

       file, filesystem, ftp, http, metakit, namespace, tar, vfs, vfslib, webdav, zip

COPYRIGHT

       Copyright (c) 2001-2003 Vince Darley <vincentdarley@users.sourceforge.net>
       Copyright (c) 2003 Andreas Kupries <andreas_kupries@users.sourceforge.net>

Tcl-level Virtual Filesystems						1.0							vfs-filesystems(n)