Sponsored Content
Operating Systems Solaris Rsync quite slow (using very little cpu): how to improve its speed? Post 303018387 by priyadarshan on Tuesday 5th of June 2018 09:49:13 AM
Old 06-05-2018
No, I have been running tests on a new system, with just OS install,
Code:
NAME    SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
 rpool   476G   136G   340G        -         -     0%    28%  1.00x  ONLINE  -

After advice on this forum, I simplified testing, now only on local SSD.

I created a 10G file (with urandom, to avoid zfs caching), and had following results (tested many times, best result reported):

Code:
### cp to same SDD

root@omniosce:~# time cp random.bin random1.bin

real    0m5.671s
user    0m0.134s
sys     0m4.974s

root@omniosce:~# time rsync -a random.bin random2.bin

real    1m25.644s
user    2m24.261s
sys     0m14.273s

### rsync'ing to same SDD with Joyent pkgsrc rsync

root@omniosce:~# time /opt/local/bin/rsync -a random.bin random1.bin

real    0m31.302s
user    0m40.634s
sys     0m13.994s

The last result is very close to what I get with FreeBSD on exact same hardware.

So, it seems to me, a possible reason could lie in OmniOS core rsync.

Last edited by priyadarshan; 06-05-2018 at 11:16 AM..
 

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

network speed is slow

Hello, everyone: i encounter a problem these days , pls help me ,thanks in advance. my env: machine: ES40 A ES40 B os: true64 Unix 4.0f note: src.tar 8M network card speed 100M my problem: ... (3 Replies)
Discussion started by: q30
3 Replies

2. AIX

cpu speed

how do i determine the speed of a cpu on AIX 4.3.3 or 5.1? (5 Replies)
Discussion started by: csaunders
5 Replies

3. HP-UX

How to find CPU Speed of HP UX

Need to find the CPU speed of HP UX for a non root login. echo "itick_per_usec/D" | adb /stand/vmunix /dev/mem | tail -1 will give the following for non root users ERROR: cannot open `/dev/mem', errno = 13, Permission denied (2 Replies)
Discussion started by: surajb
2 Replies

4. Shell Programming and Scripting

egrep is very slow : How to improve performance

We have an egrep search in a while loop. egrep -w "$key" ${PICKUP_DIR}/new_update >> ${PICKUP_DIR}/update_record_new ${PICKUP_DIR}/new_update is 210 MB file In each iteration, the egrep on an average takes around 50-60 seconds to search. Ther'es nothing significant in the loop other... (7 Replies)
Discussion started by: hidnana
7 Replies

5. UNIX for Advanced & Expert Users

speed test +20,000 file existance checks too slow

Need to make a very fast file existence checker. Passing in 20-50K num of files In the code below ${file} is a file with a listing of +20,000 files. test_speed is the script. I am commenting out the results of <time test_speed try>. The normal "test -f" is much much too slow when a system... (2 Replies)
Discussion started by: nullwhat
2 Replies

6. Shell Programming and Scripting

Help to improve speed of text processing script

Hey together, You should know, that I'am relatively new to shell scripting, so my solution is probably a little awkward. Here is the script: #!/bin/bash live_dir=/var/lib/pokerhands/live for limit in `find $live_dir/ -type d | sed -e s#$live_dir/##`; do cat $live_dir/$limit/*... (19 Replies)
Discussion started by: lorus
19 Replies

7. Red Hat

RHEL 5.6 Slow rsync to NFS array

Hi All, I have RHEL 5.6 with a 70GB local directory of Web content. Images, PHP scripts etc. I need to copy all this content to an NFS array thats mounted on the RHEL server. I did a baseline cp to copy the content one week ago. Since my baseline copy the local directory has grown by 8GB.... (2 Replies)
Discussion started by: general_lee
2 Replies

8. Shell Programming and Scripting

Slow Perl script: how to speed up?

I had written a perl script to compare two files: new and master and get the output of the first file i.e. the first file: words that are not in the master file STRUCTURE OF THE TWO FILES The first file is a series of names ramesh sushil jonga sudesh lugdi whereas the second file (could be... (4 Replies)
Discussion started by: gimley
4 Replies

9. Shell Programming and Scripting

Improve script - slow process with big files

Gents, Please can u help me to improve this script to be more faster, it works perfectly but for big files take a lot time to end the job.. I see the problem is in the step (while) and in this part the script takes a lot time.. Please if you can find a best way to do will be great. ... (13 Replies)
Discussion started by: jiam912
13 Replies
RoPkg::Rsync::Node(3pm) 				User Contributed Perl Documentation				   RoPkg::Rsync::Node(3pm)

NAME
RoPkg::Rsync::Node DESCRIPTION
A node is a rsync module. A node is formed of zero or more atoms. Example: [debian] path = /var/ftp/pub/mirrors/debian.org/ #This comment will show on rsync -v comment = Debian Mirror list = yes [debian] is the node. The node name is debian. The node has 4 atoms: *) param atom (path) *) comment atom (the comment) *) param atom (comment) *) param atom (list) SYNOPSIS
#!/usr/bin/perl use strict; use warnings; sub main { my $node = new RoPkg::Rsync::Node(node_name => 'debian'); $node->AddParam('path', '/var/ftp/pub/mirrors/debian.org'); $node->AddComment('#This comment will show on rsync -v'); $node->AddParam('comment', 'Debian Mirror'); $node->AddParam('list', 'yes'); print $node->ToString(); } main(); The result is: [debian] path = /var/ftp/pub/mirrors/debian.org #This comment will show on rsync -v comment = Debian Mirror list = yes METHODS
All methods, throw the OutsideClass exception, if you use them as class methods. Besides OutsideClass the methods are throwing other exceptions as well. Refer to each method documentation for more information. new(%hash) The constructor of the class. Expects a hash as parameter. At this time, the only valid option is node_name . Any other option will be dis- carded. The node_name is a required parameter. If is not defined, a Param::Missing exception will be raised. Example: my $node = new RoPkg::Rsync::Node(node_name => 'debian'); Add(%atom_details) Add a new atom to the node. The atom details (type, name and value) are keys from the hash. All three parameters must be defined. There are 2 special cases: when the atom is a comment or a blank. In both cases, RoPkg::Rsync::Node generates a name for them. If the atom is a com- ment or a blank the returned value is the name of the atom. If the atom is a parameter, the total number of atoms for this node is returned. Example: $node->Add( type => 'param', name => 'path', value => '/var/ftp/pub/mirrors/debian.org', ); The returned value is the total number of atoms for this node. Example: $node->Add( type => 'comment', value => '#This comment will show on rsync -v', ); The returned value is the name of the atom (the name is autogenerated). Exceptions: *) Param::Missing - $atom_details{type} is not defined *) Param::Wrong = $atom_details{name} or $atom_details{value} are not defined AddParam($pname, $pvalue) A wrapper around Add provided for comodity. See Add documentation for more details about the behaviour. AddComment($comment_value) A wrapper around Add provided for comodity. See Add documentation for more details about the behaviour. AddBlank($blank_value) A wrapper around Add provided for comodity. See Add documentation for more details about the behaviour. GetAtom(%atom_details) Returns a RoPkg::Rsync::Atom object based on parameters specified in %atom_details. The %atom_details fields can be: type, name and value. type and value must be specified. Exceptions: *) Param::Missing - type/name were not specified *) Param::Unknown - no objects were found Take note that only the first object who match the criterias is returned. GetParam($name) A wrapper around GetAtom provided for comodity. See GetAtom documentation for more details about the behaviour. GetComment($name) A wrapper around GetAtom provided for comodity. See GetAtom documentation for more details about the behaviour. GetBlank($name) A wrapper around GetAtom provided for comodity. See GetAtom documentation for more details about the behaviour. GetAll() Returns a array with all the atoms of the node. In scalar context returns the number of atoms. GetAtomsNo() Returns the number of atoms for this node. Has($atom) Returns 1 if the $atom object is already a atom for this node, 0 otherwise. Delete($atom_name) Removes the atom those name is $atom_name. Returns 1 on success (the atom was found and removed), 0 otherwise. Name($node_name) get/set method for node name. Using this method you can change the node name or find it. ToString($indent, $include_node_name) Returns the string representation of the node. If $indent is true, the atoms are indented. If $include_node_name is true, the node name will be included in the string. Example: $node = new RoPkg::Rsync::Node(node_name => 'debian'); $node->AddParam('gid', 'users'); print $node->ToString(0, 0),$/, $node->ToString(0, 1),$/, $node->ToString(1, 1),$/, $node->ToString(),$/; The result is: gid = users [debian] gid = users; [debian] gid = users [debian] gid = users PREREQUISITES
perl 5.008 (or later) is required. Besides perl, you must have the following: *) RoPkg::Exceptions *) Scalar::Util *) English SEE ALSO
RoPkg::Rsync::Atom RoPkg::Rsync::ConfFile RoPkg::Exceptions AUTHOR
Subredu Manuel <diablo@iasi.roedu.net> LICENSE
Copyright (C) 2005 Subredu Manuel. All Rights Reserved. This module is free software; you can redistribute it and/or modify it under the same terms as Perl itself. The LICENSE file contains the full text of the license. perl v5.8.8 2006-06-09 RoPkg::Rsync::Node(3pm)
All times are GMT -4. The time now is 06:33 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy