Sponsored Content
Top Forums Shell Programming and Scripting Converting Huge Archive into smaller ones Post 302247384 by Legend986 on Wednesday 15th of October 2008 03:08:14 PM
Old 10-15-2008
Converting Huge Archive into smaller ones

I have a 13G gz archive... The problem is that when I expand it, it goes to 300G and I don't have so much of hdd space. The file is a one huge file: rrc.tar.gz. What I want to do is to extract the archive but at each step gzip the resulting file.

So, if

Code:
gunzip -c rrc00.tar.gz | tar -xvf -

gives me an uncompressed directory, I want each of the files to be gzipped as and when they are extracted. So for example, if the resulting directory is something like

2007/fileA.txt
2007/fileB.txt

I want fileA.txt to be gzipped into fileA.txt.gz before it goes and extracts fileB.txt. Is there a way that this is possible?
 

8 More Discussions You Might Find Interesting

1. Post Here to Contact Site Administrators and Moderators

Smaller splash graphic

Not to complain, but the large graphic at the top of the page ensures that I have to scroll down everytime I change pages. Maybe the problem is the 1024x768 of my laptop screen, but it does seem excessive. Keith (2 Replies)
Discussion started by: kduffin
2 Replies

2. UNIX for Dummies Questions & Answers

Anything smaller than sleep 1

I'm writting a shell script to email customers invoices. after each RCPT to: email@address.com, i've put in a sleep 1 command, but with 2000 customers to email and about 5 or 6 of these sleep commands it can take a very long time. Is there any smaller amount of time the sleeper can sleep for... (4 Replies)
Discussion started by: markms
4 Replies

3. Shell Programming and Scripting

Grab a smaller and larger value

Hi All, I am trying to grab a term which is just smaller and larger than the assigned value using the below code. But there seems to be some problem. The value i assign is 25 so i would expect it to output a smaller value to be 20 instead of 10 and 20 and larger value to be 30 instead of 30 and... (3 Replies)
Discussion started by: Raynon
3 Replies

4. Shell Programming and Scripting

Extracting from archive | compressing to new archive

Hi there, I have one huge archive (it's a system image). I need sometime to create smaller archives with only one or two file from my big archive. So I'm looking for a command that extracts files from an archive and pipe them to another one. I tried the following : tar -xzOf oldarchive.tgz... (5 Replies)
Discussion started by: chebarbudo
5 Replies

5. Shell Programming and Scripting

Number of lines smaller than specified value

Hi All, I have a problem to find number of lines per column smaller than the values given in a different file. In example, compare the 1st column of file1 with the 1st line of the file2, 2nd column of file1 with the 2nd line of the file2, etc cat file1 0.2 0.9 0.8 0.5 ... 0.6 0.5... (9 Replies)
Discussion started by: senayasma
9 Replies

6. Shell Programming and Scripting

Converting huge xls(having multiple tabs) to csv

hello I have browsed for the similar requirement i found this https://www.unix.com/shell-programming-scripting/40163-xls-csv-conversion.html but my problem is i have multiple tabs in xls file having same metadata I want to convert it into single csv file any ways to do it pls... (5 Replies)
Discussion started by: joshiamit
5 Replies

7. Shell Programming and Scripting

Breaking out ip subnet to smaller subnets

I have a script and it works fine, but I am sure this can be shrunk down to something much better. I would appreciate someone taking a crack at it for me. What it does is take the ip block submitted and breaks it out down to /24's. #!/bin/ksh ipadd=${1} octet1=`echo $ipadd | nawk -F.... (3 Replies)
Discussion started by: numele
3 Replies

8. Shell Programming and Scripting

Script to archive logs and sftp to another archive server

Requirement: Under fuse application we have placeholders called containers; Every container has their logs under: <container1>/data/log/fuse.log <container1>/data/log/fuse.log.1 <container1>/data/log/fuse.log.XX <container2>/data/log/fuse.log... (6 Replies)
Discussion started by: Arjun Goswami
6 Replies
ARK(1)                                                           KDE User's Manual                                                          ARK(1)

NAME
ark - KDE archiving tool SYNOPSIS
ark [-b] [-a] [-e] [-c] [-f suffix] [-p] [-t file] [-d] [-o directory] [KDE Generic Options] [Qt(TM) Generic Options] DESCRIPTION
Ark is a program for managing various compressed file formats within KDE. Archives can be viewed, extracted, created and modified with Ark. The program can handle various formats such as tar, gzip, bzip2, zip, rar (when the appropriate libraries or command-line programs are installed). OPERATION MODES
Ark can be used either as a stand-alone GUI program as well as a command-line program in order to perform some specific tasks. If invoked without the -b (--batch) or -c (--add) options, Ark is started as a normal GUI program. When the -b (--batch) option is used, Ark can be used to extract the contents of one or more files directly from the command-line, without launching its GUI. When the -c (--add) option is used, Ark prompts for files that should be added to a new archive or to an existing archive. OPTIONS
-d, --dialog Show a dialog for specifying the options for a batch or add operation. -o, --destination directory Default the extraction directory to directory. If not passed, the current path is used. Options for adding files -c, --add Query the user for an archive filename and add specified files to it. Quit when finished. -t, --add-to filename Add the specified files to filename. Create archive if it does not exist. Quit when finished. -p, --changetofirstpath Change the current directory to the first entry and add all other entries relative to this one. -f, --autofilename suffix Automatically choose a filename, with the selected suffix (for example rar, tar.gz, zip or any other supported types). Options for batch extraction b, --batch Use the batch interface instead of the usual dialog. This option is implied if more than one url is specified. -e, --autodestination The destination argument will be set to the path of the first file supplied. -a, --autosubfolder Archive contents will be read, and if detected to not be a single folder archive, a subfolder by the name of the archive will be created. EXAMPLES
ark --batch archive.tar.bz2 Will extract archive.tar.bz2 into the current directory without showing any GUI. ark -b -d archive.tar.bz2 archive2.zip Will first show an extraction options dialog and then extract both archive.tar.bz2 and archive2.zip into the directory chosen in the dialog. ark --add-to my-archive.zip photo1.jpg text.txt Will create my-archive.zip if does not exist and then add photo1.jpg and text.txt to it. AUTHORS
Ark is currently maintained by Harald Hvaal haraldhv@stud.ntnu.no and Raphael Kubo da Costa kubito@gmail.com. This man page was first written by Lauri Watts lauri@kde.org in 2005 for KDE 3.4, and was later updated in 2009 by Raphael Kubo da Costa kubito@gmail.com. AUTHORS
Lauri Watts <lauri@kde.org> Author. Raphael Kubo da Costa <kubito@gmail.com> Author. K Desktop Environment 2.13 (KD 2009-09-10 ARK(1)
All times are GMT -4. The time now is 03:10 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy