Sponsored Content
Operating Systems Solaris Rsync quite slow (using very little cpu): how to improve its speed? Post 303018296 by priyadarshan on Saturday 2nd of June 2018 10:05:36 AM
Old 06-02-2018
Rsync quite slow (using very little cpu): how to improve its speed?

I have "inherited" a OmniOS (illumos based) server.

I noticed rsync is significantly slower in respect to my reference, FreeBSD 12-CURRENT, running on exactly same hardware.

Using same hardware, same command with same source and target disks, OmniOS r151026 gives:

Code:
test@omniosce:~# time rsync -aPt /zarc/images /home/test/
real    17m25.428s
user    28m33.792s
sys     2m46.217s


In FreeBSD 12-CURRENT:
Code:
 test@freebsd:~ % time rsync -aPt /zarc/images /home/test/

374.651u 464.028s 11:30.63 121.4%    567+210k 791583+780083io 2pf+0w

- I noticed that, under FreeBSD, rsync was running as 3 processes, all with nice=0, two of them consistently using 50% to 70% CPU time.

- On OmniOS rsync was also running as 3 processes, also with nice=0, but each one never more than 3%.


Probably different CPU usage is the reason execution time on same hardware is so different on FreeBSD and illumos?


I tried to renice the rsync process, to -20, with similar results.


I am also aware of priocntl and scheduling classes, but I was unable to change the speed.

How can I improve `rsync` execution time?

Thank you in advance.

Last edited by priyadarshan; 06-02-2018 at 11:22 AM..
 

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

network speed is slow

Hello, everyone: i encounter a problem these days , pls help me ,thanks in advance. my env: machine: ES40 A ES40 B os: true64 Unix 4.0f note: src.tar 8M network card speed 100M my problem: ... (3 Replies)
Discussion started by: q30
3 Replies

2. AIX

cpu speed

how do i determine the speed of a cpu on AIX 4.3.3 or 5.1? (5 Replies)
Discussion started by: csaunders
5 Replies

3. HP-UX

How to find CPU Speed of HP UX

Need to find the CPU speed of HP UX for a non root login. echo "itick_per_usec/D" | adb /stand/vmunix /dev/mem | tail -1 will give the following for non root users ERROR: cannot open `/dev/mem', errno = 13, Permission denied (2 Replies)
Discussion started by: surajb
2 Replies

4. Shell Programming and Scripting

egrep is very slow : How to improve performance

We have an egrep search in a while loop. egrep -w "$key" ${PICKUP_DIR}/new_update >> ${PICKUP_DIR}/update_record_new ${PICKUP_DIR}/new_update is 210 MB file In each iteration, the egrep on an average takes around 50-60 seconds to search. Ther'es nothing significant in the loop other... (7 Replies)
Discussion started by: hidnana
7 Replies

5. UNIX for Advanced & Expert Users

speed test +20,000 file existance checks too slow

Need to make a very fast file existence checker. Passing in 20-50K num of files In the code below ${file} is a file with a listing of +20,000 files. test_speed is the script. I am commenting out the results of <time test_speed try>. The normal "test -f" is much much too slow when a system... (2 Replies)
Discussion started by: nullwhat
2 Replies

6. Shell Programming and Scripting

Help to improve speed of text processing script

Hey together, You should know, that I'am relatively new to shell scripting, so my solution is probably a little awkward. Here is the script: #!/bin/bash live_dir=/var/lib/pokerhands/live for limit in `find $live_dir/ -type d | sed -e s#$live_dir/##`; do cat $live_dir/$limit/*... (19 Replies)
Discussion started by: lorus
19 Replies

7. Red Hat

RHEL 5.6 Slow rsync to NFS array

Hi All, I have RHEL 5.6 with a 70GB local directory of Web content. Images, PHP scripts etc. I need to copy all this content to an NFS array thats mounted on the RHEL server. I did a baseline cp to copy the content one week ago. Since my baseline copy the local directory has grown by 8GB.... (2 Replies)
Discussion started by: general_lee
2 Replies

8. Shell Programming and Scripting

Slow Perl script: how to speed up?

I had written a perl script to compare two files: new and master and get the output of the first file i.e. the first file: words that are not in the master file STRUCTURE OF THE TWO FILES The first file is a series of names ramesh sushil jonga sudesh lugdi whereas the second file (could be... (4 Replies)
Discussion started by: gimley
4 Replies

9. Shell Programming and Scripting

Improve script - slow process with big files

Gents, Please can u help me to improve this script to be more faster, it works perfectly but for big files take a lot time to end the job.. I see the problem is in the step (while) and in this part the script takes a lot time.. Please if you can find a best way to do will be great. ... (13 Replies)
Discussion started by: jiam912
13 Replies
PC-SYSINSTALL(8)					    BSD System Manager's Manual 					  PC-SYSINSTALL(8)

NAME
pc-sysinstall -- System installer backend SYNOPSIS
pc-sysinstall [-c file] [command] DESCRIPTION
The pc-sysinstall utility is a hybrid backend for installing FreeBSD. When run in install mode it takes a configuration file and performs an installation according to the parameters specified in the configuration file. When called with one of the system query commands it provides information about the system to aid a front end in building an appropriate configuration file. The following options are available: -c file Perform an installation as directed by file. COMMANDS
The command can be any one of the following: help Display a list of all commands. help command Display the help data for the specified command. disk-list Provide a listing of the storage devices detected on this system. disk-part disk Queries the specified storage device and returns information about its partitions. disk-info disk Returns information about a storage device's size, cylinders, heads, and sectors. detect-laptop Tests to see if this system is a laptop or desktop. detect-emulation Tests to see if this system is running in an emulator detect-nics Returns a listing of the detected network cards on this system. list-components Returns a listing of the available components which can be installed. list-rsync-backups user host port Returns a listing of available rsync-backups on the target server in the life-preserver/ directory. list-tzones Returns a listing of available timezones. query-langs Returns a list of languages that the installer supports. sys-mem Returns the size of installed system RAM in MegaBytes. test-netup test if an internet connection is available. update-part-list Returns a list of PC-BSD and FreeBSD installs on this system for updates. xkeyboard-layouts Returns a list of keyboard layouts that xorg supports. xkeyboard-models Returns a list of keyboard models that xorg supports. xkeyboard-variants Returns a list of keyboard variants that xorg supports. create-part disk size Create a new MBR primary slice on the target disk using size MB. delete-part partition Delete the disk partition specified. If this is the last partition, the disk partition layout will also be scrubbed, leaving a clean disk ready for MBR or GPT file system layouts. start-autoinstall file Start an automated installation with the specified file. Normally only used by automated install scripts. setup-ssh-keys user host port Setup SSH without a password for the target host, user, and port. Used to prompt the user to log into a server before doing a rsync + ssh restore. HISTORY
This version of pc-sysinstall first appeared in FreeBSD 9.0. AUTHORS
Kris Moore <kmoore@FreeBSD.org> BUGS
This utility was written to install PC-BSD and has seen limited use as an installer for FreeBSD. It's likely that usage to install FreeBSD will expose edge cases that PC-BSD doesn't, as well as generate feature requests based on unforeseen needs. BSD
June 24, 2010 BSD
All times are GMT -4. The time now is 09:38 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy