Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Pipelining with tar
Top Forums UNIX for Dummies Questions & Answers Pipelining with tar Post 302465050 by huntreilly25 on Thursday 21st of October 2010 02:46:58 PM
Old 10-21-2010
Aight, I'm starting to see where my supervisor is going with the compressing and decompressing bit. I believe it's to compress the file then transfer through ssh and then uncompress on another machine. If I wanted to get a head start on that where should I start?
am I going to be using scp?
or is there a way for me to use "...| tar -C opt/" and replace the opt/ and refer to the directory of the local machine I am transfering the files to?
 

10 More Discussions You Might Find Interesting

1. Programming

Pipelining Processes

I am doing a program that will calculate the 199th fibonacci number using pipelines and multiple processes for each calculation. I have figured everything out except why none of the processes before the last one never execute the findfib() function; Our teacher gave us the pipeline code to... (3 Replies)
Discussion started by: Trivialnight
3 Replies

2. UNIX for Advanced & Expert Users

Does tar do crc checking on a tape or tar file?

Trying to answer a question about whether tar table-of-contents is a good tool for verifying tape data. (1 Reply)
Discussion started by: tjlst15
1 Replies

3. Shell Programming and Scripting

Pipelining

My problem is more a question of how to do it more elegantly than how to do it at all. The problem: I have a pipeline which has to write to the screen AND to a logfile: proc1 | tee -a <logfile> What makes things difficult is i also need the return code of proc1. But proc1 | tee -a... (6 Replies)
Discussion started by: bakunin
6 Replies

4. UNIX for Advanced & Expert Users

Tar utility (untar a .tar file) on VxWorks

Hi All Can someone pls guide me if there any utility to compress file on windows & uncompress on vxworks I tried as - - compressed some folders on windows ... i created .tar ( to maintain directory structure ) and compressed to .gz format. - on VxWorks i have uncompressed it to .tar... (1 Reply)
Discussion started by: uday_01
1 Replies

5. UNIX for Advanced & Expert Users

How to create a Tar of multiple Files in Unix and FTP the tar to Windows.

Hi, On my Unix Server in my directory, I have 70 files distributed in the following directories (which have several other files too). These files include C Source Files, Shell Script Source Files, Binary Files, Object Files. a) /usr/users/oracle/bin b) /usr/users/oracle... (1 Reply)
Discussion started by: marconi
1 Replies

6. UNIX for Dummies Questions & Answers

tar -cvf test.tar `find . -mtime -1 -type f` only tar 1 file

Hi all, 4 files are returned when i issue 'find . -mtime -1 -type f -ls'. ./ora_475244.aud ./ora_671958.aud ./ora_934052.aud ./ora_934050.aud However, when I issued the below command: tar -cvf test.tar `find . -mtime -1 -type f`, the tar file only contains the 1st file -... (2 Replies)
Discussion started by: ahSher
2 Replies

7. Shell Programming and Scripting

Bash pipelining

Hello, There is a symbolic link in a folder. I would like to read destination of this link and get base name of pointed file. Let's say, there is symlink : symlink -> ../file.txt. I can do that what I want by this script: readlink symlink | while read var do echo `basename $var` done but... (1 Reply)
Discussion started by: scdmb
1 Replies

8. Shell Programming and Scripting

tar command to explore multiple layers of tar and tar.gz files

Hi all, I have a tar file and inside that tar file is a folder with additional tar.gz files. What I want to do is look inside the first tar file and then find the second tar file I'm looking for, look inside that tar.gz file to find a certain directory. I'm encountering issues by trying to... (1 Reply)
Discussion started by: bashnewbee
1 Replies

9. UNIX for Dummies Questions & Answers

Do I need to extract the entire tar file to confirm the tar folder is fine?

I would like to confirm my file.tar is been tar-ed correctly before I remove them. But I have very limited disc space to untar it. Can I just do the listing instead of actual extract it? Can I say confirm folder integrity if the listing is sucessful without problem? tar tvf file1.tar ... (1 Reply)
Discussion started by: vivien_chu
1 Replies

10. AIX

Tar - pre-checking before making the Tar file

Coming from this thread, just wondering if there is an option to check if the Tar of the files/directory will be without any file-errors without actually making the tar. Scenario: Let's say you have a directory of 20GB, but you don't have the space to make Tar file at the moment, and you want... (14 Replies)
Discussion started by: filosophizer
14 Replies

LEARN ABOUT DEBIAN

backup-manager-upload

BACKUP-MANAGER-UPLOAD(8)				       backup-manager-upload					  BACKUP-MANAGER-UPLOAD(8)

NAME

       backup-manager-upload - Multiprotocol uploader for backup-manager.

SYNOPSIS

       backup-manager-upload [options] date

DESCRIPTION

       backup-manager-upload will upload all the archives generated on the given date to the specified host with either ftp or scp.  It's also
       possible to use this program for uploading data to an Amazon S3 account.  Some metadates are available like "today" or "yesterday".

REQUIRED ARGS

       --mode=transfer-mode
	   Select the transfer mode to use : ftp, scp, or s3.

       --host=hostname1,hostname2,...,hostnameN
	   Select a list of remote hosts to connect to.

       --user=username
	   Select the user to use for connection.

OPTIONAL ARGS

       --password=password
	   Select the ftp user's password (only needed for ftp transfers).

       --key=path_to_private_key
	   Select the ssh private key file to use when opening the ssh session for scp transfer.  Obviously, this is only needed for scp transfer
	   mode.  If you don't specify a key file, the user's default private key will be used.

       --directory=directory
	   Select the location on the remote host where files will be uploaded.  Default is /backup/uploads.

       --bucket=bucket
	   Sets the bucket name for the Amazon S3 service backup into.

       --root=directory
	   Select the local directory where files are.	Default is /var/archives

       --gpg-recipient=gpg-recipient
	   Select the gpg public key for encryptiong the archives when uploading with the method ssh-gpg. This can be a short or long key id or a
	   descriptive name. The precise syntax is described in the gpg man page.

       --list
	   Just list the files to upload.

       --ftp-purge
	   Purge the remote directory before uploading files in FTP mode.

       --s3-purge
	   Purge the remote directory before uploading files in FTP mode.

       --ssh-purge
	   Purge the remote directory before uploading files in SSH mode.

       --verbose
	   Flag to enable verbose mode.

       date
	   Date pattern to select some files to upload, can be a valid date (YYYYMMDD) or 'today' or 'yesterday'.

ERROR CODES

       If something goes wrong during an upload, backup-manager-upload will exit with a non null value. In such a case every error messages are
       sent to STDERR.

       Here are the possible error codes:

       bad command line (wrong arguments) : 10
       FTP transfer failure : 20
       SCP transfer failure : 21
       S3 transfer failure : 22
       Unknown upload method: 23

SEE ALSO

       backup-manager(3)

AUTHORS

       Alexis Sukrieh - main code and design

       Brad Dixon - Amazon S3 upload method

       Jan Metzger - ssh-gpg upload method

perl v5.14.2							    2012-05-09						  BACKUP-MANAGER-UPLOAD(8)
All times are GMT -4. The time now is 01:30 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy