Login or Register to Ask a Question and Join Our Community


Solaris

zfs send receive performance issues

Login to Discuss or Reply to this Discussion in Our Community

 
Thread Tools Search this Thread
Operating Systems Solaris zfs send receive performance issues
# 8  
Old 10-30-2012
the iostat output seconds the need for mbuffer... btw zpool iostat would be a better tool for monitoring io on a zpool:
http://docs.oracle.com/cd/E19253-01/...mmt/index.html
# 9  
Old 10-31-2012
OP says mbuffer isn't going to be allowed.

Running
Code:
zfs send ... > /some/file/name

where the file is on a known FAST file system would help isolate if the issue is in the send or the receive. Run the send, see how fast it is, then run receive off that file and see how fast that is.

Maybe some useful data points can be generated.

And there might even be some way to use a file and some standard utilities to duplicate the functionality of mbuffer. Maybe something as simple as starting the send to a file, waiting a few minutes, then starting the receive might work if the send always runs faster than the receive and the receive won't hit EOF before the send is done.
# 10  
Old 10-31-2012
Achelen that seems to be good way to pin down what is slowing ..

followng is the zpool iostat o/p


Code:
bash-3.00$ zpool iostat -v  prd_pool prd_newpool 5
                                           capacity     operations    bandwidth
pool                                    alloc   free   read  write   read  write
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_newpool                          98.1G   101G      0      2    307   219K
  c5t6006016027C02C006E8E04308D17E211d0  98.1G   101G      0      2    307   219K
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_pool                             1.19T   714G    185     18  8.53M  1.09M
  c5t60060160EEB12C007A5677518D3CE111d0   296G   152G     44      4  2.07M   266K
  c5t60060160EEB12C0092C024408D3CE111d0   309G   187G     46      4  2.16M   282K
  c5t60060160EEB12C0094C024408D3CE111d0   308G   188G     47      4  2.15M   282K
  c5t60060160EEB12C0096C024408D3CE111d0   308G   188G     47      4  2.15M   282K
--------------------------------------  -----  -----  -----  -----  -----  -----

                                           capacity     operations    bandwidth
pool                                    alloc   free   read  write   read  write
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_newpool                          98.1G   101G      0      0      0      0
  c5t6006016027C02C006E8E04308D17E211d0  98.1G   101G      0      0      0      0
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_pool                             1.19T   714G  1.30K      1  29.7M  36.8K
  c5t60060160EEB12C007A5677518D3CE111d0   296G   152G    379      0  7.45M  11.2K
  c5t60060160EEB12C0092C024408D3CE111d0   309G   187G    248      0  7.36M  11.2K
  c5t60060160EEB12C0094C024408D3CE111d0   308G   188G    348      0  7.43M  5.60K
  c5t60060160EEB12C0096C024408D3CE111d0   308G   188G    353      0  7.46M  8.79K
--------------------------------------  -----  -----  -----  -----  -----  -----

                                           capacity     operations    bandwidth
pool                                    alloc   free   read  write   read  write
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_newpool                          98.1G   101G      0      0      0      0
  c5t6006016027C02C006E8E04308D17E211d0  98.1G   101G      0      0      0      0
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_pool                             1.19T   714G    830      0  19.7M  39.2K
  c5t60060160EEB12C007A5677518D3CE111d0   296G   152G    237      0  4.88M  10.4K
  c5t60060160EEB12C0092C024408D3CE111d0   309G   187G    147      0  4.92M  7.20K
  c5t60060160EEB12C0094C024408D3CE111d0   308G   188G    198      0  4.86M  16.0K
  c5t60060160EEB12C0096C024408D3CE111d0   308G   188G    246      0  5.04M  5.60K
--------------------------------------  -----  -----  -----  -----  -----  -----

                                           capacity     operations    bandwidth
pool                                    alloc   free   read  write   read  write
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_newpool                          98.1G   101G      0    280      0  26.0M
  c5t6006016027C02C006E8E04308D17E211d0  98.1G   101G      0    280      0  26.0M
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_pool                             1.19T   714G    477     23  13.4M   162K
  c5t60060160EEB12C007A5677518D3CE111d0   296G   152G    144      4  3.46M  53.9K
  c5t60060160EEB12C0092C024408D3CE111d0   309G   187G     86      8  3.31M  53.3K
  c5t60060160EEB12C0094C024408D3CE111d0   308G   188G    106      6  3.21M  28.3K
  c5t60060160EEB12C0096C024408D3CE111d0   308G   188G    139      4  3.45M  26.9K
--------------------------------------  -----  -----  -----  -----  -----  -----

                                           capacity     operations    bandwidth
pool                                    alloc   free   read  write   read  write
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_newpool                          98.4G   101G      0    203      0  24.0M
  c5t6006016027C02C006E8E04308D17E211d0  98.4G   101G      0    203      0  24.0M
--------------------------------------  -----  -----  -----  -----  -----  -----
prd_pool                             1.19T   714G    984      0  26.0M  25.6K
  c5t60060160EEB12C007A5677518D3CE111d0   296G   152G    233      0  6.21M  5.60K
  c5t60060160EEB12C0092C024408D3CE111d0   309G   187G    185      0  6.45M  8.79K
  c5t60060160EEB12C0094C024408D3CE111d0   308G   188G    269      0  6.75M  5.60K
  c5t60060160EEB12C0096C024408D3CE111d0   308G   188G    296      0  6.54M  5.60K
--------------------------------------  -----  -----  -----  -----  -----  -----

Last edited by fugitive; 10-31-2012 at 01:34 PM..
Login or Register to Ask a Question

Previous Thread | Next Thread

10 More Discussions You Might Find Interesting

1. Solaris

Zfs send & receive with encryption - how to retrieve data?

Good morning everyone, I'm looking for some help to retrieve data in a scenario where I might have made a big mistake. I'm hoping to understand what I did wrong. My system is made of two Solaris 11 Express servers (old free version for evaluation). The first if for data and the second is... (7 Replies)
Discussion started by: rnd
7 Replies

2. Shell Programming and Scripting

Send/receive file through serial using minicom

i have connected with my board through serial interface using minicom and i am running a bash script, which should test ethernet (ping test), USB read/write, RS232 .. I have managed to test ethernet and USB read/write. I test ethernet with ping. I test USB read/write, using dd and verifying... (10 Replies)
Discussion started by: linuxmember
10 Replies

3. Solaris

ZFS receive error

trying to clone a zfs file system on the same system using zfs send -r root/branch@snapshot |zfs receive root/newbranch and get the following error :parent does not exist. How do I fix this? (1 Reply)
Discussion started by: os2mac
1 Replies

4. Solaris

ZFS send issues

I have two servers, we'll call them sv1 and sv2. both are Solaris 11.1 LDOMS running on a T4-4 with RBAC enabled. my user has zfs allow send, receive on both servers and has ssh keys shared. on sv2 (the destination) I have a zpool called zones that has no zfs fs built on sv1 (the source) I... (5 Replies)
Discussion started by: os2mac
5 Replies

5. Shell Programming and Scripting

Send Receive Mails

Hi All, I am writing one script to automate one long process. In this process we need to upload some input files and download some output files. So , I want to automate this upload and download by using mail functionality. I want to trigger this script when I am sending mail to server. I know... (0 Replies)
Discussion started by: NirajThakar
0 Replies

6. Shell Programming and Scripting

How to monitor send/receive bytes

Hello, I need to create a script to monitor sent/received packets for a period of time (the period of time will be a users input) and write the result to some txt file. Is there any command (don`t want to use any 3rd party sw) what I can use? I`m using Solaris 10. Thank you (14 Replies)
Discussion started by: msojka77
14 Replies

7. Programming

Send/Receive buffer size??

Dear friends, How do I find the TCP send and receive buffer size? (1 Reply)
Discussion started by: nagalenoj
1 Replies

8. UNIX for Dummies Questions & Answers

Can send but not receive email

Hi, One of the users in our company can send but not receive email. We are using SENDMAIL in conjunction with procmail. The funny thing is that all his sent email is in his /var/spool/mail but the email client does not pick anything up! He is using IMAP. Anyone see have any ideas? (2 Replies)
Discussion started by: mojoman
2 Replies

9. UNIX for Dummies Questions & Answers

I can send but cannot receive mail with unix?

Hi all, First post! I have just discovered that I can use unix to send mail to a mail address. I normally use entourage for my mail. This unix mail is very intriguing to me, but something is not working... I tried the search, but could not find the answer... This works: (in terminal)... (1 Reply)
Discussion started by: bjorn
1 Replies

10. IP Networking

Tcp Ip Send Receive Server Program

Requirements: A server program should read a file and send the message to the client . if the file is not there, then switch to the receive part of the same program and receive any messages from the socket. If no messages to receive then switch to send part of the program to... (2 Replies)
Discussion started by: Rajeshsu
2 Replies
Login or Register to Ask a Question