Sponsored Content
Full Discussion: tar + gzip + split together
Top Forums Shell Programming and Scripting tar + gzip + split together Post 302100973 by Terrible on Tuesday 26th of December 2006 11:32:01 AM
Old 12-26-2006
Quote:
Originally Posted by aamir1234
Hi All
I need guidance on this requirement .
We have a directory structure which has data of approx 100 GB
We need to tar the structure then zip it and create different files of not more than 10 GB
A separate tar file then a .gz should not be created , on the fly a script is needed which should tar then gzip it and create splitted zipped files of not more than 10 GB only
Please advice on this
I would really apprecite it.

Thanks
Aamir

are you getting any error messages when attempting these?

what you can do is go into the directory with the 100GB size. once in the directory, issue a du -sk * | sort -rn

that will list to you the all the other directories in the directory and their sizes from biggest to smallest.

using that information, you add up the directory sizes. you can pick the first 2 or 3 or 4 or whatever till it adds up to 10GB. Then you create a tar archive for this first 10GB like this

create tar archive = tar cf /name-to-give-archive /directory-to-archive

Example = tar cf /var/tmp/jamesbond1.tar /usr/impt/dir1 /usr/impt/dir2 /usr/impt/dir3 ...etc


for the second 10GB data you archive u do the same; you add up the remaining directory sizes till it reaches 10GB. then u also archive that.


create tar archive = tar cf /name-to-give-archive /directory-to-archive

Example = tar cf /var/tmp/jamesbond2.tar /usr/impt/dir1 /usr/impt/dir2 /usr/impt/dir3 ...etc
Terrible
 

10 More Discussions You Might Find Interesting

1. UNIX for Dummies Questions & Answers

Combine tar and gzip together?

Hello I just wandering, instead to doing "tar cvf foo.tar * " and then gzip foo.tar , can't it be combined to one command ? (1 Reply)
Discussion started by: umen
1 Replies

2. UNIX for Dummies Questions & Answers

can i tar and gzip in one liner ?

hello can i combine this 2 commands in one liner command? (1 Reply)
Discussion started by: umen
1 Replies

3. UNIX for Dummies Questions & Answers

TAR and GZIP help

Hi, There are 700 .pdf files in a certain directory on the server and I need to TAR them first and then compress them using GZIP to free up the space. The combined size of the .pdf files is 3gb. However, there is only 1gb of free space on the server. So as you can see when I try to TAR these... (3 Replies)
Discussion started by: VandeMatram
3 Replies

4. UNIX for Advanced & Expert Users

tar/gzip/gz...which one to use?

P0251WLADC.svm_wl1 > /svm_wl1/billing/data/server/archive/ALLEVT $ du -k FEB2006 22050224 FEB2006 As you can see,i have a folder called "FEB2006" which is around 22 GB. i guess zip or compress wont work...( i don know how do we compress a folder) i wished to use ""tar" ( i suppose... (5 Replies)
Discussion started by: abhijeetkul
5 Replies

5. UNIX for Dummies Questions & Answers

tar and gzip

Hi, I would like to have a combined gzip and tar that will compress and create multiple output tar.gz files. I want to have multiple files output because i cannot create an archive because there is no more space on my harddisk. I cannot transfer it locally because of slow connection. I want to... (3 Replies)
Discussion started by: tungaw2004
3 Replies

6. UNIX for Dummies Questions & Answers

shortcut for tar cvf - [filename] | gzip > [filename].tar.gz

i'd like to have an alias (or something similar) where i can type a command like "archive" and a filename and have it tar and gzip the file, so... $ archive filename results in filename.tar.gz...do i have to write a script to do this? (4 Replies)
Discussion started by: bcamp1973
4 Replies

7. Shell Programming and Scripting

tar and gzip problem

Hi Guys, I have a few files. i want to tar these files and zip it using gzip it. -rw-r----- 1 magesh magesh 12940369 Jul 27 09:26 dcx_imds_c.asc -rw-r----- 1 magesh magesh 1221391 Jul 27 09:27 dcx_imds_h.asc -rw-r----- 1 magesh magesh 1105673 Jul 27 09:27... (6 Replies)
Discussion started by: mac4rfree
6 Replies

8. Shell Programming and Scripting

tar and gzip files

Hi Guys, I am using RHEL5 and Solaris 9 & 10. I want to tar and gzip my files then remove them after a successful tar command... Lets say I have files with extension .arc then I want to tar and gzip these files. After successful tar command I want to remove all these files (i.e .arc). ... (3 Replies)
Discussion started by: Phuti
3 Replies

9. UNIX for Beginners Questions & Answers

Need help ASAP - FIND - TAR - GZIP

Hi, I need to combined in 1 line the execution below : find * -type f -mtime -$nb_days -print | xargs tar -cvf $MAITUT/BCK_DATA.tar gzip $MAITUT/BCK_DATA.tar.gz The fact that the TAR is very big, at the end I need to generate only the GZ file. The option z on the tar... (2 Replies)
Discussion started by: royinfo.alain
2 Replies

10. UNIX for Advanced & Expert Users

Tar gzip compression rate

How good is the compression rate of gzip when you use tar with the gzip option? I am pretty amazed that a 1 GB file was reduced to 1019K. This is what I did. tar -cvf tar_test.tar.gz -T /list_of_files ls -hl -rw-r-----. 1 owner group 19 Jul 23 16:00 list_of_files -rw-r-----. 1 owner group... (7 Replies)
Discussion started by: cokedude
7 Replies
TAR(1)							      General Commands Manual							    TAR(1)

NAME
tar - archiver SYNOPSIS
tar key [ file ... ] DESCRIPTION
Tar saves and restores file trees. It is most often used to transport a tree of files from one system to another. The key is a string that contains at most one function letter plus optional modifiers. Other arguments to the command are names of files or directories to be dumped or restored. A directory name implies all the contained files and subdirectories (recursively). The function is one of the following letters: c Create a new archive with the given files as contents. x Extract the named files from the archive. If a file is a directory, the directory is extracted recursively. Modes are restored if possible. If no file argument is given, extract the entire archive. If the archive contains multiple entries for a file, the lat- est one wins. t List all occurrences of each file in the archive, or of all files if there are no file arguments. r The named files are appended to the archive. The modifiers are: v (verbose) Print the name of each file treated preceded by the function letter. With t, give more details about the archive entries. f Use the next argument as the name of the archive instead of the default standard input (for keys x and t) or standard output (for keys c and r). u Use the next (numeric) argument as the user id for files in the output archive. This is only useful when moving files to a non-Plan 9 system. g Use the next (numeric) argument as the group id for files in the output archive. EXAMPLES
Tar can be used to copy hierarchies thus: {cd fromdir; tar c .} | {cd todir; tar x} SOURCE
/sys/src/cmd/tar.c SEE ALSO
ar(1), bundle(1), tapefs(1) BUGS
There is no way to ask for any but the last occurrence of a file. File path names are limited to 100 characters. The tar format allows specification of links and symbolic links, concepts foreign to Plan 9: they are ignored. TAR(1)
All times are GMT -4. The time now is 06:23 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy