Sponsored Content
Top Forums Shell Programming and Scripting Xargs and rsync not sending all files Post 303039536 by DougyC on Wednesday 9th of October 2019 04:50:29 AM
Old 10-09-2019
Hi,

Found the issue.

I modified sshd_config on the destination with the following param and restarted sshd:
Code:
MaxStartups 50:30:100

It wasn't set, so the default was 10 max before it started dropping connections.

Thanks for your help.
This User Gave Thanks to DougyC For This Post:
 

10 More Discussions You Might Find Interesting

1. Shell Programming and Scripting

MV files with xargs or -exec

Hi I need to move multiple (say 10 files) from one location to another location. My selection would be like this... ls -ltr *.arc | head ---> Need to move top 10 files with single command without iterating in loop. I know we can move files like this with find command but not sure if I can... (4 Replies)
Discussion started by: malaymaru
4 Replies

2. Shell Programming and Scripting

find with xargs to rm found files

I believe what is happening is rm is executing in the script on every directory and on failure of the first it stops although returns status 0. find $HOME -name /directory/filename | xargs -l rm This is the code I use but file remains. I am using sun solaris system which has way limited... (4 Replies)
Discussion started by: Ebodee
4 Replies

3. Shell Programming and Scripting

move files using xargs

Hi, I have many files like below in my currect dir test1.me test2.me test3.me I wanted them to rename without .me extention I tried below find . -name "*.me" | xargs -i mv {} `echo {} | sed 's/\.me//'` It thorws error that cant mv ./test1.me to ./test1.me as they are... (6 Replies)
Discussion started by: sunilmenhdiratt
6 Replies

4. Shell Programming and Scripting

help using find/xargs to apply mp3gain to files

I need to apply mp3gain (album mode) to all mp3 files in a given directory. Each album is in its own directory under /media/data/music/albums for example: /media/data/music/albums/foo /media/data/music/albums/bar /media/data/music/albums/more What needs to happen is: cd... (4 Replies)
Discussion started by: audiophile
4 Replies

5. Shell Programming and Scripting

Fast processing(mv command) of 1 million+ files using find, mv and xargs

Hi, I'd like to ask if anybody can help improve my code to move 1 million+ files from a directory to another: find /source/dir -name file* -type f | xargs -I '{}' mv {} /destination/dir I learned this line of code from this forum as well and it works fine. However, file movement is kinda... (6 Replies)
Discussion started by: agentgrecko
6 Replies

6. Shell Programming and Scripting

How to copy files from one location to another using xargs??

Hello Experts, I need to copy files from one location to another using xargs. Tried something like this (In Ubuntu & Solaris ). mkdir -p 1234; find /home/emd/Desktop/n007/M007/ -type f -name "A2014*" | xargs -0 cp -r {} /home/emd/Desktop/1234 But every time i run this, a weird error... (6 Replies)
Discussion started by: Saidul
6 Replies

7. Shell Programming and Scripting

How to delete directories and files with xargs?

Hello, i have an dynamical apache_cache that I need to clean all days (older tant one day) with an unix command : find /usr/IBM/HTTPServer/apache_cache/ -name '*' -mtime +1 -print0|xargs -0 rm -r -- but it didn't work. Could you explain me why. So I will put below all my script :... (13 Replies)
Discussion started by: steiner
13 Replies

8. Shell Programming and Scripting

Using rsync with xargs

I want to run parallelise rsync with xargs. The plan is to take separate directories and run rsync in parallel. find . -mindepth 1 -maxdepth 1 print0 | xargs -n1 -P0 rsync -avz Hoxever I am stuck on how to use rsync in this way ---------- Post updated at 04:44 AM ---------- Previous... (3 Replies)
Discussion started by: kristinu
3 Replies

9. Shell Programming and Scripting

Linux command rsync sending files incrementally

Please, i have a question about rsync command: Here is the command that i have used in my script: rsync -ratlz --rsh="/usr/bin/sshpass ssh -o StrictHostKeyChecking=no" -aAXHltzh --progress --numeric-ids --devices --rsync-path="rsync" $1 $hostname:$1 using this command, i can... (0 Replies)
Discussion started by: chercheur111
0 Replies

10. Shell Programming and Scripting

Xargs to call python executable to process multiple bam files

I am running the below loop that to process the 3 bam files (which isn't always the case). A .py executable is then called using | xargs sh to further process. If I just run it with echo the output is fine and expected, however when | xargs sh is added I get the error. I tried adding | xargs... (4 Replies)
Discussion started by: cmccabe
4 Replies
MRB(8)							      System Manager's Manual							    MRB(8)

NAME
mrb - manage incremental snapshots with rsync/make. SYNOPSIS
mrb command DESCRIPTION
mrb is a simple aid to creating efficient incremental snapshots of a set, or sets, of directories whenever that may be required. It may be used as part of a regular automated backup regime, or for manually checkpointing changes at convenient points in time. COMMANDS
The following commands are recognised (where 'MODULE' is the name of one of your snapshot definitions): new-MODULE Create a skeleton definition for a new snapshot 'MODULE'. dest-MODULE Create the destination dir for 'MODULE'. This directory must exist to create a snapshot. snap-MODULE Create a snapshot of 'MODULE'. sync Create snapshots of all defined modules. If run as root this may be configured to include the modules of other users too (see MRB_SYNC_USERS in ~/.mrb/defaults). help Show mrb's own help text. CONFIGURATION FILES
Per-user configuration The following files may be used to specify global and local configuration options. /etc/default/mrb system default configuration. ~/.mrb/defaults per-user configuration. Per-user options The following options control behaviour for all of a user's modules. MRB_SNAPSHOT_LOG An optional file path where transfer details will be recorded. If unset these details will not be logged. MRB_SYNC_USERS A space separated list of users whose modules should be included in a sync. This is mostly only useful for root, as mrb will assume the identity of each user before creating snapshots of their modules. If unset, only the invoking user's modules will be sync'ed. MRB_CONFDIR An space separated list of the directories to search for module definition (*.mrc) files. They will be searched in the order given, with new modules added by default to the last one listed. There should be few reasons to change the default value. Per-module configuration The default MRB_CONFDIR value will search for module definitions in: /etc/mrb/*.mrc ~/.mrb/*.mrc Those created by new-MODULE will be placed in this latter location by default. Per-module options In each case module below is the name of the particular module that the value set should apply to. These options should be defined in a file named module.mrc. module_SRC A space separated list of the files and (top level) directories to include in the snapshots for this module. module_DEST The directory root where snapshots of module should be stored. module_INCLUDE An optional list of rsync(1) include patterns. module_EXCLUDE An optional list of rsync(1) exclude patterns. module_FILTER An optional list of rsync(1) filter patterns. module_FILTER_FILE An optional filename for rsync(1) dir-merge filtering support. module_RSYNC_OPTIONS Optional additional rsync(1) options to pass verbatim when it is invoked. module_PRECOMMAND An optional shell command to invoke just prior to creating a new snapshot. If the command does not return a successful exit status, then the snapshot creation will be aborted before it begins. It may be used to mount removable media or similar. module_POSTCOMMAND An optional shell command to execute after making the snapshot. It will not be called if the snaphot creation failed at an earlier stage, and its return status may halt a sync operation if it fails with more modules still to process. It may be used, for example, to unmount removable media again. module_USER An optional user name to check that mrb is running as before performing a snapshot. This can be used to ensure you have the correct permisson to access the files being mirrored before you get too far. SEE ALSO
rsync(1), make(1). AUTHOR
mrb was written by Ron <ron@debian.org>. May 9, 2006 MRB(8)
All times are GMT -4. The time now is 07:35 AM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy