tar and gzip problem

Thread Tools Search this Thread
Top Forums Shell Programming and Scripting tar and gzip problem
# 1  
Old 07-27-2009
tar and gzip problem

Hi Guys,

I have a few files. i want to tar these files and zip it using gzip it.
-rw-r-----   1 magesh  magesh    12940369 Jul 27 09:26 dcx_imds_c.asc
-rw-r-----   1 magesh  magesh     1221391 Jul 27 09:27 dcx_imds_h.asc
-rw-r-----   1 magesh  magesh     1105673 Jul 27 09:27 dcx_imds_mc.asc
-rw-r-----   1 magesh  magesh    10676635 Jul 27 09:27 dcx_imds_m.asc
-rw-r-----   1 magesh  magesh      967019 Jul 27 09:27 dcx_imds_mi.asc
-rw-r-----   1 magesh  magesh    25975881 Jul 27 09:27 dcx_imds_ml.asc
-rw-r-----   1 magesh  magesh     8466649 Jul 27 09:27 dcx_imds_mn.asc
-rw-r-----   1 magesh  magesh     3007118 Jul 27 09:27 dcx_imds_r.asc
-rw-r-----   1 magesh  magesh    22433288 Jul 27 09:27 dcx_imds_ra.asc
-rw-r-----   1 magesh  magesh   491930039 Jul 27 09:27 dcx_imds_rp.asc
-rw-r-----   1 magesh  magesh    76974343 Jul 27 09:27 dcx_imds_rw.asc
-rw-r-----   1 magesh  magesh    25062622 Jul 27 09:27 dcx_imds_s.asc
-rw-r-----   1 magesh  magesh    50828494 Jul 27 09:27 dcx_imds_ss.asc
-rw-r--r--   1 magesh  magesh   312270848 Jul 27 09:36 07272009.tar

As you can see i can tar all the files. But when i gave the gzip command, i am getting an error in it. The following is the command and its error.

acidmmm:gzip 07272009.tar

gzip: 07272009.tar.gz: No space left on device

Is there any limit on size of the file.. If so, Please advise me on how to take it forward. I just want to archive these files in as much less memory i can.

Thanks for your help in advance,

# 2  
Old 07-27-2009
try running below command and see if any of the file systems is 100%
$df -k .
# 3  
Old 07-27-2009

You can tar and gzip files at the same time:

tar cvf - * | gzip -9 > myfile.tar.gz

This saves you the space of the tar file as it's is never actually created.
# 4  
Old 07-28-2009
Hi Scotn,

Thanks for your reply.. can i what is the use of "-" in the tar part and "-9" in gzip part..

I like to understand the command you have given.
# 5  
Old 07-28-2009

The - in tar means (with the c option) write to standard output (or read from standard input with the x option).

The -9 means maximum compression (9) (you can use -c also, which means read from standard input with gzip, and write to standard output with gunzip, but it seems most gzips are happy without it)

It's all explained in the man pages.

Sorry I didn't explain it very well (or at all!).

tar cvf - files_or_directories

Will tar up the files or directories you specify and write the tarfile to standard output.

 | gzip -9

will pipe the output (the tar file) into gzip and compress it (using maximum compression, -9) and write this to standard output (as it doesn't have either an input or output filename to work with)

 > myfile.tar.gz

will direct standard output (your compressed tar archive) to myfile.tar.gz.

You can do the reverse also:

gunzip -c myfile.tar.gz | tar xvf -

This is quicker and saves diskspace in the short term. You can do similar things with pipes, such as when exporting large database schemas directly to compressed files, etc, if you don't have enough space for the .dmp file.

In fact, you can set up just about anything to write directly to a compressed file.

mknod myLogFile.txt p
cat myLogFile.txt | gzip -9 > myLogFile.txt.gz &

(run your program or script that writes to myLogFile.txt)

The background process "cat .... &" will end when your program or script does

Last edited by Scott; 07-28-2009 at 03:09 PM..
# 6  
Old 08-01-2009
sorry for the late reply.. but thanks to your explanation...
# 7  
Old 08-02-2009
tar cvf - filenames | gzip > file.tar.gz
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. UNIX for Beginners Questions & Answers

Need help ASAP - FIND - TAR - GZIP

Hi, I need to combined in 1 line the execution below : find * -type f -mtime -$nb_days -print | xargs tar -cvf $MAITUT/BCK_DATA.tar gzip $MAITUT/BCK_DATA.tar.gz The fact that the TAR is very big, at the end I need to generate only the GZ file. The option z on the tar... (2 Replies)
Discussion started by: royinfo.alain
2 Replies

2. UNIX for Dummies Questions & Answers

Failed to use find-tar-gzip together

Hello I am trying to select multiple files older than 14 days and create a single compressed file out of it. (AIX Release 3 Version 5) I am trying to achieve it by following tar -cvf db01_log.tar `find . -name "db01*.log" -mtime +14" -print`| gzip > db01_log.tar however it just... (7 Replies)
Discussion started by: Chetanz
7 Replies

3. Shell Programming and Scripting

tar and gzip files

Hi Guys, I am using RHEL5 and Solaris 9 & 10. I want to tar and gzip my files then remove them after a successful tar command... Lets say I have files with extension .arc then I want to tar and gzip these files. After successful tar command I want to remove all these files (i.e .arc). ... (3 Replies)
Discussion started by: Phuti
3 Replies

4. Shell Programming and Scripting

tar + gzip + split together

Hi All I need guidance on this requirement . We have a directory structure which has data of approx 100 GB We need to tar the structure then zip it and create different files of not more than 10 GB A separate tar file then a .gz should not be created , on the fly a script is needed... (7 Replies)
Discussion started by: aamir1234
7 Replies

5. UNIX for Dummies Questions & Answers

shortcut for tar cvf - [filename] | gzip > [filename].tar.gz

i'd like to have an alias (or something similar) where i can type a command like "archive" and a filename and have it tar and gzip the file, so... $ archive filename results in filename.tar.gz...do i have to write a script to do this? (4 Replies)
Discussion started by: bcamp1973
4 Replies

6. UNIX for Dummies Questions & Answers

tar and gzip

Hi, I would like to have a combined gzip and tar that will compress and create multiple output tar.gz files. I want to have multiple files output because i cannot create an archive because there is no more space on my harddisk. I cannot transfer it locally because of slow connection. I want to... (3 Replies)
Discussion started by: tungaw2004
3 Replies

7. UNIX for Advanced & Expert Users

tar/gzip/gz...which one to use?

P0251WLADC.svm_wl1 > /svm_wl1/billing/data/server/archive/ALLEVT $ du -k FEB2006 22050224 FEB2006 As you can see,i have a folder called "FEB2006" which is around 22 GB. i guess zip or compress wont work...( i don know how do we compress a folder) i wished to use ""tar" ( i suppose... (5 Replies)
Discussion started by: abhijeetkul
5 Replies

8. UNIX for Dummies Questions & Answers

TAR and GZIP help

Hi, There are 700 .pdf files in a certain directory on the server and I need to TAR them first and then compress them using GZIP to free up the space. The combined size of the .pdf files is 3gb. However, there is only 1gb of free space on the server. So as you can see when I try to TAR these... (3 Replies)
Discussion started by: VandeMatram
3 Replies

9. UNIX for Dummies Questions & Answers

can i tar and gzip in one liner ?

hello can i combine this 2 commands in one liner command? (1 Reply)
Discussion started by: umen
1 Replies

10. UNIX for Dummies Questions & Answers

Combine tar and gzip together?

Hello I just wandering, instead to doing "tar cvf foo.tar * " and then gzip foo.tar , can't it be combined to one command ? (1 Reply)
Discussion started by: umen
1 Replies
Login or Register to Ask a Question