Sponsored Content
Full Discussion: Using rsync with xargs
Top Forums Shell Programming and Scripting Using rsync with xargs Post 302907910 by Peasant on Wednesday 2nd of July 2014 10:31:59 AM
Old 07-02-2014
Can you use --files-from=FILE read list of source-file names from FILE

Generate a FILE with find results
Split the file using split command on n desired parts naming them from 0 to n, and putting total count into variable

For total count run iterate rsync --files-from=FILEn ... &

Of course, if you want to ran batches 5 x 5 FILES or you have alot of rsyncs which can hit the machine hard, you will have to include wait command. There are some quality examples of shell parallelism on this forums.

If you want to run like 5 rsyncs at the same time (single time script is ran), you will not need the extra overhead in coding.

Hope that helps
Regards
Peasant
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

why we use xargs..

hi , can anyone help me by saying why we use xargs.. is it acing like a place holder..? thanks, Krips. (3 Replies)
Discussion started by: kripssmart
3 Replies

2. UNIX for Advanced & Expert Users

xargs -P

I discovered that GNU's xargs has a -P option to allow its processes to run in parallel. Great! Is this a GNU thing, or is it supported by other platforms as well? (4 Replies)
Discussion started by: otheus
4 Replies

3. Shell Programming and Scripting

Using xargs

hi i just want to know that how do we use xargs command to find files which are greater than specified memory in a given directory (6 Replies)
Discussion started by: sumit the cool
6 Replies

4. Shell Programming and Scripting

Help in using xargs

Hi, I have a requirement to RCP the files from remote server to local server. Also the RCP has to run in parallel. However using 'xargs' retrives 2 file names during each loop. How do we restrict to only one file name using xargs and loop till remaining files. I use the below code for... (2 Replies)
Discussion started by: senthil3d
2 Replies

5. Shell Programming and Scripting

Help with xargs

hi Could any one please tell me the option using which we can run multiple commands using xargs I have list of files, I want to run dos2unix and chmod at one shot on them I tried google n searched man pages but couldnt really find the solution , please help right now im doing this ls... (4 Replies)
Discussion started by: sunilmenhdiratt
4 Replies

6. Shell Programming and Scripting

xargs

Dear all , any suggest on xargs to combine from (1.txt and 2.txt) to output.txt ? thanks a lot. 1.txt 0123 BUM-5M BUM-5M 93490481 63839 0124 BUM-5M BUM-5M 112112 ... (3 Replies)
Discussion started by: samoptimus
3 Replies

7. Shell Programming and Scripting

xargs

I have dir with many files ( close to 4M ) . $ ls -la total 76392 drwxr-xr-x 10 oracle dba 512 Jun 06 14:39 . drwxr-xr-x 11 oracle dba 512 Dec 20 13:21 .. drwxr-xr-x 2 oracle dba 39074816 Jun 15 14:07 ad I am trying to delete them using... (8 Replies)
Discussion started by: talashil
8 Replies

8. UNIX for Dummies Questions & Answers

Xargs

Hi, can anyone tell me in detail ? what the following do in detail ? I am trying to get a largest number in a list Thanks Tao LARGEST=$(echo $* | xargs -n1 | sort -nr | tail -1) (3 Replies)
Discussion started by: ccp
3 Replies

9. Shell Programming and Scripting

Rsync Error: rsync: link_stat failed: No such file or directory (2)

I wish to copy all the files & folder under /web/Transfer_Files/data/ on mymac1 (Linux) to remote server mybank.intra.com (Solaris 10) /tmp/ location I am using Ansible tool synchronize module which triggers the unix rsync command as below:rsync --delay-updates -F --compress --archive --rsh=ssh... (2 Replies)
Discussion started by: mohtashims
2 Replies

10. Shell Programming and Scripting

Xargs and rsync not sending all files

Hi all, I have a script issue I can't seem to work out. In a directory I have several folders and I want to send just the sapdata1 to sapdata14 folders and their contents but not sapdataXX/.snapshot the script is: #!/bin/bash # SETUP OPTIONS export SRCDIR="/scratch/doug/test/sapdata*"... (5 Replies)
Discussion started by: DougyC
5 Replies
sigtool(1)							  Clam AntiVirus							sigtool(1)

NAME
sigtool - signature and database management tool SYNOPSIS
sigtool [options] DESCRIPTION
sigtool can be used to generate MD5 checksums, convert data into hexadecimal format, list virus signatures and build/unpack/test/verify CVD databases and update scripts. OPTIONS
-h, --help Output help information and exit. -V, --version Print version number and exit. --quiet Be quiet - output only error messages. --stdout Write all messages to stdout. --hex-dump Read data from stdin and write hex string to stdout. --md5 [FILES] Generate MD5 checksum from stdin or MD5 sigs for FILES. --mdb [FILES] Generate .mdb signatures for FILES. --html-normalise=FILE Create normalised HTML files comment.html, nocomment.html, and script.html in current working directory. --utf16-decode=FILE Decode UTF16 encoded data. --vba=FILE Extract VBA/Word6 macros from given MS Office document. --vba-hex=FILE Extract Word6 macros from given MS Office document and display the corresponding hex values. -i, --info Print a CVD information and verify MD5 and a digital signature. -b, --build Build a CVD file. -s, --server is required. --server ClamAV Signing Service address (for virus database maintainers only). --unpack FILE, -u FILE Unpack FILE (CVD) to a current directory. --unpack-current Unpack a local CVD file (main or daily) to current directory. --diff=OLD NEW, -d OLD NEW Create a diff file for OLD and NEW CVDs/INCDIRs. --run-cdiff=FILE, -r FILE Execute update script FILE in current directory. --verify-cdiff=FILE, -r FILE Verify DIFF against CVD/INCDIR. -l[FILE], --list-sigs[=FILE] List all signature names from the local database directory (default) or from FILE. -fREGEX, --find-sigs=REGEX Find and display signatures from the local database directory which match the given REGEX. The whole signature body (name, hex string, etc.) is checked. -fREGEX, --decode-sigs=REGEX Decode signatures read from the standard input (eg. piped from --find-sigs) -fREGEX, --test-sigs=DATABASE TARGET_FILE Test all signatures from DATABASE against TARGET_FILE. EXAMPLES
Generate hex string from testfile and save it to testfile.hex: cat testfile | sigtool --hex-dump > testfile.hex CREDITS
Please check the full documentation for credits. AUTHOR
Tomasz Kojm <tkojm@clamav.net> SEE ALSO
freshclam(1), freshclam.conf(5) ClamAV 0.96.1 February 12, 2007 sigtool(1)
All times are GMT -4. The time now is 05:11 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy