tar and gzip


 
Thread Tools Search this Thread
Top Forums UNIX for Dummies Questions & Answers tar and gzip
# 1  
Old 06-22-2007
tar and gzip

Hi,

I would like to have a combined gzip and tar that will compress and create multiple output tar.gz files. I want to have multiple files output because i cannot create an archive because there is no more space on my harddisk. I cannot transfer it locally because of slow connection. I want to have a script that once it reached the maximum limit (e.g.100MB), it will prompt me to create a new file.

Anyone can help?

thanks,

btw, i already did this

$tar cvf - filename.xxx |gzip > filename.tar.gz
# 2  
Old 06-22-2007
Quote:
I would like to have a combined gzip and tar that will compress and create multiple output tar.gz files. I want to have multiple files output because i cannot create an archive because there is no more space on my harddisk.
What do you mean by multiple file output? Do you want multiple tar.gz files ?

Code:
I cannot transfer it locally because of slow connection. I want to have a script that once it reached the maximum limit (e.g.100MB), it will prompt me to create a new file.

Do you want to create a new tar.gz file once the current tar.gz file has reached the size of 100MB?

Please answer my queries and may be i can help.
kamitsin
# 3  
Old 06-22-2007
Tar and gzip

Here is the scenario:

1. I have a 5.7 GB log which i want to archive. However, my problem is the hdisk has no more space available.

Solution i want to have :

a. create a backup of the file through tar/gzip command but will have a limit of 100MB/file or depending on the maximum limit i will set. It will prompt me that it reached the limit. From there, i can transfer the first file to my local machine and continue creating the next file gz.
# 4  
Old 06-22-2007
#!/bin/ksh

LOGDIR=/home/XXXX
ARCHIVE_NAME=/tmp/archive.tar
MAX_ARCHIVE_SIZE=XXX # your choice

tar -cvf ${ARCHIVE_NAME}

for FILENAME in `ls -lrt ${LOGDIR}|awk '{print $9}'`
do
gzip ${FILENAME} 2>/dev/null
tar -rvf ${ARCHIVE_NAME} ${FILENAME}.gz 2>/dev/null
rm -f ${FILENAME}.gz 2>/dev/null
SIZE=`ls -l ${ARCHIVE_NAME} | awk '{print $5}'`
if [[ "${SIZE}" >= "${MAX_ARCHIVE_SIZE}" ]]
then
move_delete_file; # function to move and delete the archive from LOGDIR
fi
done

Last edited by kamitsin; 06-23-2007 at 05:11 AM..
kamitsin
 
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

Facing issues with tar and gzip !

Hi, I am trying to :- (1.) Tar the file and then (2.) Gzip it ! Tar command :- tar -cvf BLUESTAR_Archive.log_$(date +%y_%m_%d_%H_%M).tar /app/local/XXX/XXX/XXX/logs Gzip command :- Gzip /app/local/XXX/XXX/XXX/logs/BLUESTAR_Archive.log_$(date +%y_%m_%d_%H_%M).tar ... (9 Replies)
Discussion started by: acidburn_007
9 Replies

2. Shell Programming and Scripting

tar and gzip files

Hi Guys, I am using RHEL5 and Solaris 9 & 10. I want to tar and gzip my files then remove them after a successful tar command... Lets say I have files with extension .arc then I want to tar and gzip these files. After successful tar command I want to remove all these files (i.e .arc). ... (3 Replies)
Discussion started by: Phuti
3 Replies

3. UNIX for Advanced & Expert Users

tar and gzip extraction issues

Not sure if this is really in the right forum but here goes.... Looking for a way to extract individual compressed files from a compressed tarball WITHOUT tar -zxvf and then recompressing. Basically we need to be able to chunk out an individual compressed file while it still remains... (6 Replies)
Discussion started by: athos
6 Replies

4. Shell Programming and Scripting

tar and gzip problem

Hi Guys, I have a few files. i want to tar these files and zip it using gzip it. -rw-r----- 1 magesh magesh 12940369 Jul 27 09:26 dcx_imds_c.asc -rw-r----- 1 magesh magesh 1221391 Jul 27 09:27 dcx_imds_h.asc -rw-r----- 1 magesh magesh 1105673 Jul 27 09:27... (6 Replies)
Discussion started by: mac4rfree
6 Replies

5. Shell Programming and Scripting

tar + gzip + split together

Hi All I need guidance on this requirement . We have a directory structure which has data of approx 100 GB We need to tar the structure then zip it and create different files of not more than 10 GB A separate tar file then a .gz should not be created , on the fly a script is needed... (7 Replies)
Discussion started by: aamir1234
7 Replies

6. UNIX for Dummies Questions & Answers

shortcut for tar cvf - [filename] | gzip > [filename].tar.gz

i'd like to have an alias (or something similar) where i can type a command like "archive" and a filename and have it tar and gzip the file, so... $ archive filename results in filename.tar.gz...do i have to write a script to do this? (4 Replies)
Discussion started by: bcamp1973
4 Replies

7. UNIX for Advanced & Expert Users

tar/gzip/gz...which one to use?

P0251WLADC.svm_wl1 > /svm_wl1/billing/data/server/archive/ALLEVT $ du -k FEB2006 22050224 FEB2006 As you can see,i have a folder called "FEB2006" which is around 22 GB. i guess zip or compress wont work...( i don know how do we compress a folder) i wished to use ""tar" ( i suppose... (5 Replies)
Discussion started by: abhijeetkul
5 Replies

8. UNIX for Dummies Questions & Answers

TAR and GZIP help

Hi, There are 700 .pdf files in a certain directory on the server and I need to TAR them first and then compress them using GZIP to free up the space. The combined size of the .pdf files is 3gb. However, there is only 1gb of free space on the server. So as you can see when I try to TAR these... (3 Replies)
Discussion started by: VandeMatram
3 Replies

9. UNIX for Dummies Questions & Answers

can i tar and gzip in one liner ?

hello can i combine this 2 commands in one liner command? (1 Reply)
Discussion started by: umen
1 Replies

10. UNIX for Dummies Questions & Answers

Combine tar and gzip together?

Hello I just wandering, instead to doing "tar cvf foo.tar * " and then gzip foo.tar , can't it be combined to one command ? (1 Reply)
Discussion started by: umen
1 Replies
Login or Register to Ask a Question