AIX networking performance, during copying files


 
Thread Tools Search this Thread
Operating Systems AIX AIX networking performance, during copying files
# 1  
Old 01-29-2019
AIX networking performance, during copying files

Hello, AIX-gurus! We have some AIX networking (?) issue, for test I created 2 LPARs (AIX 6.1) on 2 different blade IBM power servers (p702 with POWER7 on board), located in same BladeCenter H.


Networking bandwith between them is 1Gbit/s


Code:
# iperf -c 172.16.17.170
------------------------------------------------------------
Client connecting to 172.16.17.170, TCP port 5001
TCP window size: 63.6 KByte (default)
------------------------------------------------------------
[  3] local 172.16.17.53 port 37113 connected with 172.16.17.170 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0-10.0 sec  1.09 GBytes   935 Mbits/sec


But when I copy files with scp, even with fastest available cipher arcfour, it shows about 30 Mb/s (about 240 MBit/s bandwidth),


Code:
scp -o Cipher=arcfour root@172.16.17.170:/u01/exp/bigfile.dmp /u01/backup/2.dmp
The authenticity of host '172.16.17.170 (172.16.17.170)' can't be established.
RSA key fingerprint is SHA256:EuxnUV1Ru1nzf9RI0j6ui+tcC1vFGXrU0fLnVzJw0Ds.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added '172.16.17.170' (RSA) to the list of known hosts.
root@172.16.17.170's password: 
bigfile.dmp                                                                3% 2009MB  28.8MB/s   28:44 ETAK




I even tried rsync-daemon, which is not using encryption, unlike regular rsync, it gives about 36 Mb/s (same bandwidth as scp)


Code:
rsync -aHAxv --numeric-ids --progress rsync://172.16.17.170:/big-archive/bigfile.dmp /u01/backup/1.dmp
receiving incremental file list
bigfile.dmp
  2,212,724,736   4%   36.28MB/s    0:23:19

I think it's AIX issue, because we have some x86_64 machines in this network, and when I use scp on them, with same cipher I recieve about 80 Mb/s-100Mb/s download speed.
# 2  
Old 01-29-2019
I would be curious about cpio's results have you tried yet?
# 3  
Old 01-30-2019
Quote:
Originally Posted by vbe
I would be curious about cpio's results have you tried yet?

Code:
time ssh -o Cipher=arcfour oracle@172.16.17.170 "ls /u01/exp/3.dmp | cpio -ov" | cpio -imvd
oracle@172.16.17.170's password: 
/u01/exp/3.dmp
2097153 blocks 
/u01/exp/3.dmp
2097153 blocks 

real    0m38.634s
user    0m18.829s
sys     0m5.865s
bash-4.4# du -sg 3.dmp 
1.00    3.dmp

So, it's 1 Gb transferred by 38s, which is equal ~27 MB/s average download speed, about 216 Mbit/s bandwidth, if I made calculations right
# 4  
Old 01-30-2019
ssh, scp et al have high CPU overhead from encryption and aren't representative of down-to-the-wire performance.

You also have your disks to consider. How fast would that happen if you wrote to /dev/null instead of ssh? Also, caching. Does it speed up when you run it twice?
This User Gave Thanks to Corona688 For This Post:
# 5  
Old 01-30-2019
Quote:
Originally Posted by Corona688
You also have your disks to consider. How fast would that happen if you wrote to /dev/null instead of ssh?


Code:

du -sg 3.dmp 
1.00    3.dmp
bash-4.4# time ls ./3.dmp | cpio -ovB | cpio -imvdB /dev/null
3.dmp
20971602097160 blocks 
 blocks 

real    0m3.405s
user    0m2.064s
sys     0m0.934s

1 Gb for 3,4s, or ~300 MB/s (~30MB/s with ssh in comparsion).


Quote:
Does it speed up when you run it twice?
No, I don't observe such bechavior.
# 6  
Old 02-05-2019
Easiest utility I know to throw unencrypted content down the wire ASAP is udpcast. Of course, it's wide-open and limited to your local subnet. It can have more than one receiver with no bandwidth penalty however.

Code:
# sender
udp-sender < filename

Code:
# receiver
udp-receiver > /dev/null

Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. AIX

Performance stats from AIX 6

Hi, I'm supposed to capture many performance stats on AIX 6 and stuck up with below: Priority queue Disk cache hit% Page out rate Swap out rate Memory queue I see vmstatis helpful for "page out" but not sure how to get the "rate". Could anyone please let me know how to get these... (4 Replies)
Discussion started by: reddyr
4 Replies

2. AIX

Networking Issues - Opera, FreeBSD, AIX

(1) Hi, Am working on FreeBSD 7.4/i386 and installed Opera 11.01 through ports collection manually... But when I run first time am getting "opera: cannot connect X server. Error: Unknown error: 0" What is this error all about???? Please help me to sort out this issue!!! (2) Hi, currently am... (12 Replies)
Discussion started by: Priya Amaresh
12 Replies

3. AIX

AIX Networking Issue

Hello, I'm trying to set up an internet connection on an IBM RS/6000 7043-140 machine with AIX v 5.1. The problem is that no matter if it is setup to receive an IP address from another DHCP server or has a static IP set, it seems to act as a DHCP server that assigns a random IP address with a... (3 Replies)
Discussion started by: Xsystem
3 Replies

4. AIX

AIX performance issue

Hi Guys, This is the situation I am in. Provide your views and input where should I start? I have one P7 test server and a p520 production server. the job is taking pretty long on the P7 test server when compared to the P5 production server. below is the full detail. Informix... (5 Replies)
Discussion started by: ithinksgreen
5 Replies

5. AIX

performance issue in AIX

Gurus, i have process that runs 5 times a day. it runs normally (takes about 1 hour) to complete in 3 runs but it is takes about ( 3 hrs to complete) two times So i need to figure out why it takes significanlty high time during those 2 runs. The process is a shell script that connect to... (2 Replies)
Discussion started by: mad_man12
2 Replies

6. AIX

Performance issue in AIX 5.3

Is there is any way to increase the CPU utilization of a Embedded SQL program in AIX 5.3 .. for performance purpose. (0 Replies)
Discussion started by: Gyanendra Awast
0 Replies

7. AIX

AIX 5.2 performance question

I am trying to analyze the performance of an AIX system. I think I may have a disk I/O issue, but I am asking for help to validate or invalidate this assumption. I ran the commands below during a period of peak load. Please help me to find any performance bottlenecks. Thanks in advance for your... (15 Replies)
Discussion started by: jhall
15 Replies

8. AIX

Performance testing on AIX

I'm doing performance testing for one application which works on AIX. But I don't know which performance parameters of memory need to be collected. Now, I just know very few: 1. page in 2. page out 3. fre They are all collected by "vmstat" command. I want to know, except for above... (2 Replies)
Discussion started by: adasong
2 Replies

9. AIX

copying files to a remote aix server using tar!

Hi, I am using AIX 5.2, and I want to copy some files from one server to a remote server using tar command. Can anybody tell me exact command? Thanks. Aqeel (2 Replies)
Discussion started by: system-admin
2 Replies

10. UNIX for Dummies Questions & Answers

AIX performance

Hiya all, I am a newbie sysadmin to AIX, i have worked on HPUX for 3 years. I have started a new role with in an IBM house and because there is me and one other there are a couple of issues I cannot work out: We havehad a production server slowing down processing batch jbs over the past... (6 Replies)
Discussion started by: chlawren
6 Replies
Login or Register to Ask a Question