Compress multiple files at one go Post: 302300245

Sponsored Content

Top Forums UNIX for Dummies Questions & Answers Compress multiple files at one go Post 302300245 by kedar.mehta on Monday 23rd of March 2009 03:18:50 PM

03-23-2009

Registered User

@ cbo0485.

First of all thanks to you...

I didn't get you actually.. Is your code (quoted ) going to process alll the files' list? Do you mean my code will get only one file compressed? m Bit confused .

Quote:

Originally Posted by cbo0485

Code:

find ./ -type f -mtime +1176 -exec gzip {}\;

That won't zip them at the exact same time, but it will filter through the results and zip them up one at a time.

The problem is with exec I believe..I got thousands of files.. (Total size 50 Gigs) I think, this code will still get me the same errors. "Too many arguments". I think, xargs is required over here.

The bottom line question is, I got thousands of files, which I can obtain using some find command. Now I want to compress them all.

(Just an added info -All the files under same directory - on the same mound point. None of the file has funny characters like *,&,etc)

@Tony,

Thanks for ellaborating on tar & gzip. It was definately some value addition! I got the point about type -f (no directories).

The problem is the same old thing -

I want to compress list of files at a time. I got thousands of file , so -exec is running short to handle that large no of argument.

I can first copy the name of files into a temp file & use it with gzip, but why to do so if i can do it in one line command ? (if I can do so). The volume is such large that it will take 1/2 hours just to list all the required files !

Please help me to get though this problem.. Plz post the syntax /code as well.

Thanks,
Kedar

kedar.mehta

View Public Profile for kedar.mehta

Find all posts by kedar.mehta

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compress all INACTIVE Files

Hi gurus, I have a batch job running daily night automatically. The job produces file with extension '.0' like a.0, b.0 etc. Now due to file space constraints, most of the time, the job fails with insufficient disk space and then we have to manually start the job again and keep running the...

2. Shell Programming and Scripting

Compress multiple files

Hi Friends, Can anyone help me out with compressing multiple files. I have multiple files in directory , I have to compress these into a single file, I tried using gzip -r outfile.gz file1 file2 file3. It is not working Thanks in advance for your help S :)

3. UNIX for Dummies Questions & Answers

Compress files

Hi All, I would like to archive some of the scripts below(USFINUM042006_01.CSV USFINUM042006_02.CSV and USFINUM042006_03.CSV )and also use a wildcard e.g. <command> USFINUM*.CSV. Also there are a lot of similar files but I want only the three latest files to be compressed. Which is the best...

4. Shell Programming and Scripting

compress files

Could someone give me an idea how to compress all files from a given directory that are not of type .z (compressed). Please help.

5. UNIX for Dummies Questions & Answers

find new files and compress them

Hi! First off I'd like to stress that I'm a true dummy :) I have a website with SSH access and since it has user generated content I want to backup my website every day end send it through FTP to a different server. I got it working for my mysql database, so the only thing remaining are the...

6. UNIX for Dummies Questions & Answers

How to compress files without extension

Could someone please help? I'm trying to compress all the files in a directory without extension. I know for typical files with extension, the command is something like: tar -zcvf file.tar.gz *.doc What is the command for files without extension? Thanks.

7. UNIX for Dummies Questions & Answers

Issue: Compress in unix server and FTP to windows and open the compress file using Winzip

Hi All ! We have to compress a big data file in unix server and transfer it to windows and uncompress it using winzip in windows. I have used the utility ZIP like the below. zip -e <newfilename> df2_test_extract.dat but when I compress files greater than 4 gb using zip utility, it...

8. Shell Programming and Scripting

Compress files as per timestamp in multiple subdirectories

I'd really appreciate if anyone could assist me with this code A directory with multiple subdirectories has multiple files which are timestamp'ed. We need to - compress files as per timestamp - save compressed file/s in the respective folder - delete the source files ============...

9. Shell Programming and Scripting

Compress Files in Multiple Directories

I would like to compress the files in multiple directories. For some reason, it only compress the first directory (/Sanbox/logs1) but not the rest of the other directories ("/Sanbox/logs2" "/Sanbox/logs3" "/Sanbox/logs4" ). Any help would be appreciated. Here's my code: #!/bin/bash...

10. UNIX for Beginners Questions & Answers

Compress multiple gzip files

Good afternoon friends. I wanted to make a query, how to compress several files and leave them all in 1, for example flat text files: filename_1.csv filename_2.csv filename_3.csv expected result filename_end.gzip = (filename_1.csv filename_2.csv filename_3.csv) please

LEARN ABOUT NETBSD

gzexe

GZEXE(1)						    BSD General Commands Manual 						  GZEXE(1)

NAME

     gzexe -- create auto-decompressing executables

SYNOPSIS

     gzexe [-d] file ...

DESCRIPTION

     The gzexe utility uses gzip(1) to compress executables, producing executables that decompress on-the-fly when executed.  This saves disk
     space, at the cost of slower execution times.  The original executables are saved by copying each of them to a file with the same name with a
     '~' suffix appended.  After verifying that the compressed executables work as expected, the backup files can be removed.

     The options are as follows:

     -d      Decompress executables previously compressed by gzexe.

     The gzexe program refuses to compress non-regular or non-executable files, files with a setuid or setgid bit set, files that are already com-
     pressed using gzexe or programs it needs to perform on-the-fly decompression: sh(1), mktemp(1), rm(1), echo(1), tail(1), gzip(1), and
     chmod(1).

SEE ALSO

     gzip(1)

CAVEATS

     The gzexe utility replaces files by overwriting them with the generated compressed executable.  To be able to do this, it is required that
     the original files are writable.

BSD
								   July 30, 2003							       BSD

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Compress all INACTIVE Files

Discussion started by: super_duper_guy

2. Shell Programming and Scripting

Compress multiple files

Discussion started by: sbasetty

3. UNIX for Dummies Questions & Answers

Compress files

Discussion started by: indira

4. Shell Programming and Scripting

compress files

Discussion started by: lesstjm