Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Rsync in progress, strange results
Top Forums UNIX for Advanced & Expert Users Rsync in progress, strange results Post 302894375 by DustinT on Tuesday 25th of March 2014 06:57:12 AM
Old 03-25-2014
Quote:
Originally Posted by DustinT
On another note, it's interesting because while the file is being copied, I can see it if I browse the remote directory. Once the transfer is completed, the remote version disappears.
Turns out that error was because I wasn't running rsync with enough permissions. That was an easy fix but I needed one more thing to complete this project.

I ended up having the user onsite at the remote location send the files on a USB drive and then I used rysnc to complete the transfer once the drive was here. It proceeded much more quickly and wrapped up after about 48 hours. The remote user sent more files than I was initially targeting so the final transfer ended up being 2.6 million files.
 

10 More Discussions You Might Find Interesting

1. AIX

Strange ls results..

Multipart question.. Can anybody explain why this happens : -rw-rw-r-- 1 fnsw fnusr 1531061 Feb 13 21:45 filename1.log -rw-rw-r-- 1 fnsw fnusr 1760706 Feb 10 22:10 filename2.log -rw-rw-r-- 1 fnsw fnusr 1525805 Aug 16 2005 filename3.log -rw-rw-r-- 1... (3 Replies)
Discussion started by: dbridle
3 Replies

2. UNIX for Dummies Questions & Answers

Strange Results

I am using th following to get the percentage and have never used bc before: percent=$(echo "scale=4;(34117/384000)*100" | bc) 8.884600 percent=$(echo "scale=2;(34117/384000)*100" | bc) 8.00 Why do I get the results of 8.00 instead of 8.88 when using a scale of 2. I only want 2 decimal... (2 Replies)
Discussion started by: mariaa33
2 Replies

3. Shell Programming and Scripting

Strange results from FDISK?????

Hi all, I am writing script that returns the size of each disk or partition when called. I am using FDISK -l and parsing the results to get the result I want. When I execute fdisk -l it shows correct results, BUT when I execute the same thing with results to be put in a variable, I get strange... (5 Replies)
Discussion started by: alirezan
5 Replies

4. Shell Programming and Scripting

Can ctag and cscope support recording search results and displaying the history results ?

Hello , When using vim, can ctag and cscope support recording search results and displaying the history results ? Once I jump to one tag, I can use :tnext to jump to next tag, but how can I display the preview search result? (0 Replies)
Discussion started by: 915086731
0 Replies

5. Shell Programming and Scripting

Rsync, compression, progress and logging

Hello. Using Rsync to synchronize files on 2 red hat servers, works fine. Trying to use the compress options, but I don't know if it is working? Nothing logged in the progress messages. Not sure in my case if compression will be helpful in my case, so I would like to see some statistics. Is... (2 Replies)
Discussion started by: JimBurns
2 Replies

6. Shell Programming and Scripting

Find with rm command gives strange results

I want to remove any files that are older than 2 days from a directory. It deletes those files. Then it comes back with a message it is a directory. What am I doing wrong here? + find /mydir -mtime +2 -exec rm -f '{}' ';' rm: /mydir is a directory (2 Replies)
Discussion started by: jtamminen
2 Replies

7. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies

8. UNIX for Beginners Questions & Answers

Strange sort -r results

Hi Folks - I have this file that looks like this: outbox/logs/Client_1042.log outbox/logs/Client_941.log outbox/logs/Client_942.log outbox/logs/Client_943.log outbox/logs/Client_944.log And this is my code: #!/bin/bash _OUTBOX_BIN="outbox/logs/" _NAME="Client" _TEMP="temp.txt"... (9 Replies)
Discussion started by: SIMMS7400
9 Replies

9. Shell Programming and Scripting

I want to add a variable for the results from the formula of one variable and results of another var

Good morning all, This is the file name in question OD_Orders_2019-02-19.csv I am trying to create a bash script to read into files with yesterdays date on the file name while retaining the rest of the files name. I would like for $y to equal, the name of the file with a formula output with... (2 Replies)
Discussion started by: Ibrahim A
2 Replies

10. UNIX for Beginners Questions & Answers

Strange results from 'strings | sort'

Using the 'strings' command and piping the result to 'sort' is producing strange results. I get block of lines that begin with asterisks, then a block that begins with some text, then more lines that begin with asterisks. The actual content is correct - lines beginning with asterisks is the... (5 Replies)
Discussion started by: edstevens
5 Replies

LEARN ABOUT DEBIAN

backup-manager-upload

BACKUP-MANAGER-UPLOAD(8)				       backup-manager-upload					  BACKUP-MANAGER-UPLOAD(8)

NAME

       backup-manager-upload - Multiprotocol uploader for backup-manager.

SYNOPSIS

       backup-manager-upload [options] date

DESCRIPTION

       backup-manager-upload will upload all the archives generated on the given date to the specified host with either ftp or scp.  It's also
       possible to use this program for uploading data to an Amazon S3 account.  Some metadates are available like "today" or "yesterday".

REQUIRED ARGS

       --mode=transfer-mode
	   Select the transfer mode to use : ftp, scp, or s3.

       --host=hostname1,hostname2,...,hostnameN
	   Select a list of remote hosts to connect to.

       --user=username
	   Select the user to use for connection.

OPTIONAL ARGS

       --password=password
	   Select the ftp user's password (only needed for ftp transfers).

       --key=path_to_private_key
	   Select the ssh private key file to use when opening the ssh session for scp transfer.  Obviously, this is only needed for scp transfer
	   mode.  If you don't specify a key file, the user's default private key will be used.

       --directory=directory
	   Select the location on the remote host where files will be uploaded.  Default is /backup/uploads.

       --bucket=bucket
	   Sets the bucket name for the Amazon S3 service backup into.

       --root=directory
	   Select the local directory where files are.	Default is /var/archives

       --gpg-recipient=gpg-recipient
	   Select the gpg public key for encryptiong the archives when uploading with the method ssh-gpg. This can be a short or long key id or a
	   descriptive name. The precise syntax is described in the gpg man page.

       --list
	   Just list the files to upload.

       --ftp-purge
	   Purge the remote directory before uploading files in FTP mode.

       --s3-purge
	   Purge the remote directory before uploading files in FTP mode.

       --ssh-purge
	   Purge the remote directory before uploading files in SSH mode.

       --verbose
	   Flag to enable verbose mode.

       date
	   Date pattern to select some files to upload, can be a valid date (YYYYMMDD) or 'today' or 'yesterday'.

ERROR CODES

       If something goes wrong during an upload, backup-manager-upload will exit with a non null value. In such a case every error messages are
       sent to STDERR.

       Here are the possible error codes:

       bad command line (wrong arguments) : 10
       FTP transfer failure : 20
       SCP transfer failure : 21
       S3 transfer failure : 22
       Unknown upload method: 23

SEE ALSO

       backup-manager(3)

AUTHORS

       Alexis Sukrieh - main code and design

       Brad Dixon - Amazon S3 upload method

       Jan Metzger - ssh-gpg upload method

perl v5.14.2							    2012-05-09						  BACKUP-MANAGER-UPLOAD(8)
All times are GMT -4. The time now is 01:03 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy