Rsync quite slow (using very little cpu): how to improve its speed? Post: 303018313

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

network speed is slow

Hello, everyone: i encounter a problem these days , pls help me ,thanks in advance. my env: machine: ES40 A ES40 B os: true64 Unix 4.0f note: src.tar 8M network card speed 100M my problem: ...

2. AIX

cpu speed

how do i determine the speed of a cpu on AIX 4.3.3 or 5.1?

3. HP-UX

How to find CPU Speed of HP UX

Need to find the CPU speed of HP UX for a non root login. echo "itick_per_usec/D" | adb /stand/vmunix /dev/mem | tail -1 will give the following for non root users ERROR: cannot open `/dev/mem', errno = 13, Permission denied

4. Shell Programming and Scripting

egrep is very slow : How to improve performance

We have an egrep search in a while loop. egrep -w "$key" ${PICKUP_DIR}/new_update >> ${PICKUP_DIR}/update_record_new ${PICKUP_DIR}/new_update is 210 MB file In each iteration, the egrep on an average takes around 50-60 seconds to search. Ther'es nothing significant in the loop other...

5. UNIX for Advanced & Expert Users

speed test +20,000 file existance checks too slow

Need to make a very fast file existence checker. Passing in 20-50K num of files In the code below ${file} is a file with a listing of +20,000 files. test_speed is the script. I am commenting out the results of <time test_speed try>. The normal "test -f" is much much too slow when a system...

6. Shell Programming and Scripting

Help to improve speed of text processing script

Hey together, You should know, that I'am relatively new to shell scripting, so my solution is probably a little awkward. Here is the script: #!/bin/bash live_dir=/var/lib/pokerhands/live for limit in `find $live_dir/ -type d | sed -e s#$live_dir/##`; do cat $live_dir/$limit/*...

7. Red Hat

RHEL 5.6 Slow rsync to NFS array

Hi All, I have RHEL 5.6 with a 70GB local directory of Web content. Images, PHP scripts etc. I need to copy all this content to an NFS array thats mounted on the RHEL server. I did a baseline cp to copy the content one week ago. Since my baseline copy the local directory has grown by 8GB....

8. Shell Programming and Scripting

Slow Perl script: how to speed up?

I had written a perl script to compare two files: new and master and get the output of the first file i.e. the first file: words that are not in the master file STRUCTURE OF THE TWO FILES The first file is a series of names ramesh sushil jonga sudesh lugdi whereas the second file (could be...

9. Shell Programming and Scripting

Improve script - slow process with big files

Gents, Please can u help me to improve this script to be more faster, it works perfectly but for big files take a lot time to end the job.. I see the problem is in the step (while) and in this part the script takes a lot time.. Please if you can find a best way to do will be great. ...

LEARN ABOUT DEBIAN

librsync

librsync(3)						     Library Functions Manual						       librsync(3)

NAME

       librsync - library for delta compression of streams

SYNOPSYS

	#include <stdio.h>
	#include <stdlib.h>
	#include <librsync.h>

	cc ... -lrsync

DESCRIPTION

       The  librsync library implements network delta-compression of streams and files.  The algorithm is similar to that used in the rsync(1) and
       xdelta(2) programs, but specialized for transfer of arbitrary-length octet streams.  Unlike most diff programs, librsync does  not  require
       access to both of the files on the same machine, but rather only a short ``signature'' of the old file and the complete contents of the new
       file.

       The canonical use of librsync is in the rproxy(8) reference implementation of the rsync proposed extension to HTTP.  It may  be	useful	to
       other  programs which wish to do delta-compression in HTTP, or within their own protocol.  There are HTTP-specific utility functions within
       librsync, but they need not be used.

       A number of tools such as rdiff(1) provide command-line and scriptable access to rsync functions.

SEE ALSO

       rdiff(1)

       rdiff and librsync Manual

       http://rproxy.sourceforge.net/.

       draft-pool-rsync

BUGS

       The rsync protocol is still evolving.  There may be bugs in the implementation.	The interface may change in the future, but it is becoming
       more stable.

       Many  routines  will panic in case of error rather than returning an error code to the caller.  Patches to fix this are welcome, but at the
       current state of development aborting seems as useful as trusting to possibly-incomplete checking in the client.

AUTHOR

       Martin Pool <mbp@samba.org>, with Andrew Tridgell <tridge@samba.org>.

       rdiff development has been supported by Linuxcare, Inc and VA Linux Systems.

Martin Pool						   $Date: 2003/06/12 06:03:32 $ 					       librsync(3)