Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: Using rsync with xargs
Top Forums Shell Programming and Scripting Using rsync with xargs Post 302907910 by Peasant on Wednesday 2nd of July 2014 10:31:59 AM
Old 07-02-2014
Can you use --files-from=FILE read list of source-file names from FILE

Generate a FILE with find results
Split the file using split command on n desired parts naming them from 0 to n, and putting total count into variable

For total count run iterate rsync --files-from=FILEn ... &

Of course, if you want to ran batches 5 x 5 FILES or you have alot of rsyncs which can hit the machine hard, you will have to include wait command. There are some quality examples of shell parallelism on this forums.

If you want to run like 5 rsyncs at the same time (single time script is ran), you will not need the extra overhead in coding.

Hope that helps
Regards
Peasant
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

why we use xargs..

hi , can anyone help me by saying why we use xargs.. is it acing like a place holder..? thanks, Krips. (3 Replies)
Discussion started by: kripssmart
3 Replies

2. UNIX for Advanced & Expert Users

xargs -P

I discovered that GNU's xargs has a -P option to allow its processes to run in parallel. Great! Is this a GNU thing, or is it supported by other platforms as well? (4 Replies)
Discussion started by: otheus
4 Replies

3. Shell Programming and Scripting

Using xargs

hi i just want to know that how do we use xargs command to find files which are greater than specified memory in a given directory (6 Replies)
Discussion started by: sumit the cool
6 Replies

4. Shell Programming and Scripting

Help in using xargs

Hi, I have a requirement to RCP the files from remote server to local server. Also the RCP has to run in parallel. However using 'xargs' retrives 2 file names during each loop. How do we restrict to only one file name using xargs and loop till remaining files. I use the below code for... (2 Replies)
Discussion started by: senthil3d
2 Replies

5. Shell Programming and Scripting

Help with xargs

hi Could any one please tell me the option using which we can run multiple commands using xargs I have list of files, I want to run dos2unix and chmod at one shot on them I tried google n searched man pages but couldnt really find the solution , please help right now im doing this ls... (4 Replies)
Discussion started by: sunilmenhdiratt
4 Replies

6. Shell Programming and Scripting

xargs

Dear all , any suggest on xargs to combine from (1.txt and 2.txt) to output.txt ? thanks a lot. 1.txt 0123 BUM-5M BUM-5M 93490481 63839 0124 BUM-5M BUM-5M 112112 ... (3 Replies)
Discussion started by: samoptimus
3 Replies

7. Shell Programming and Scripting

xargs

I have dir with many files ( close to 4M ) . $ ls -la total 76392 drwxr-xr-x 10 oracle dba 512 Jun 06 14:39 . drwxr-xr-x 11 oracle dba 512 Dec 20 13:21 .. drwxr-xr-x 2 oracle dba 39074816 Jun 15 14:07 ad I am trying to delete them using... (8 Replies)
Discussion started by: talashil
8 Replies

8. UNIX for Dummies Questions & Answers

Xargs

Hi, can anyone tell me in detail ? what the following do in detail ? I am trying to get a largest number in a list Thanks Tao LARGEST=$(echo $* | xargs -n1 | sort -nr | tail -1) (3 Replies)
Discussion started by: ccp
3 Replies

9. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies

10. Shell Programming and Scripting

Xargs and rsync not sending all files

Hi all, I have a script issue I can't seem to work out. In a directory I have several folders and I want to send just the sapdata1 to sapdata14 folders and their contents but not sapdataXX/.snapshot the script is: #!/bin/bash # SETUP OPTIONS export SRCDIR="/scratch/doug/test/sapdata*"... (5 Replies)
Discussion started by: DougyC
5 Replies

LEARN ABOUT DEBIAN

dtc-xen_migrate

dtc-xen_migrate(8)					      System Manager's Manual						dtc-xen_migrate(8)

NAME

       dtc-xen_migrate - migrate a VPS to another Xen server

SYNOPSIS

       LOCAL_VPS_ID DESTINATION_HOSTNAME [ DEST_VPS_ID ]

DESCRIPTION

       dtc-xen_migrate	This  shell  script  is a part of the dtc-xen package that is to be used by the dtc panel to manage a Xen VPS server. Note
       that you need rsync in both the source and the destination dom0.

       This script is used to move the content of a Xen virtual machine (VM) managed with dtc-xen to another Xen server of the same type.  The	VM
       destination will first be prepared, then the local VM will be shut down, then it's content will be transfered over using rsync.

       Note that this is NOT a live migration, and down time of approximatively the time needed for the rsync will occure.

PARAMETERS

       LOCAL_VPS_ID The DTC-Xen id of the VM, from 00 to 99.

       DESTINATION_HOSTNAME Destination Xen server hostname to migrate to.

       DEST_VPS_ID Destination DTC-Xen id of the VM, from 00 to 99.

EXAMPLE

       dtc-xen_migrate 19 alpha.example.com 21

       This will migrate the content of xen19 on the local machine to the destination server alpha.example.com using xen21 as VM name.

SEE ALSO

       dtc_reinstall_os(8), dtc_kill_vps_disk(8)

																dtc-xen_migrate(8)
All times are GMT -4. The time now is 04:53 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy