Read speed too bad on NAS share on VM

 
Thread Tools Search this Thread
Operating Systems Linux Red Hat Read speed too bad on NAS share on VM
# 1  
Old 10-30-2014
Read speed too bad on NAS share on VM

Hi,
We have two servers in scenario (vmsoldot01 is Oracle VM with Linux and tldtppod15 is physical Linux server). One NAS share is mounted on both servers with similar permissions and access. But READ speed is too bad on virtual in comparison to physical server.
While trying to diagnose this, I see RX-DRP value is high. Can I assume that this is (also) playing role in it ? What else can I check ? Any pointer ?
Code:
[root@vmsoldot01 ~]# dd if=/dev/zero of=/tmp/bdev/testing/vmsoldot01 bs=1M count=1024 oflag=direct 
1024+0 records in 
1024+0 records out 
1073741824 bytes (1.1 GB) copied, 9.73523 s, 110 MB/s 
[root@vmsoldot01 ~]# dd if=/tmp/bdev/testing/vmsoldot01 of=/dev/null bs=1M count=1024 iflag=direct 
1024+0 records in 
1024+0 records out 
1073741824 bytes (1.1 GB) copied, 1246.77 s, 861 kB/s 
[root@vmsoldot01 ~]# dd if=/tmp/bdev/testing/vmsoldot01 of=/dev/null iflag=direct 
2097152+0 records in 
2097152+0 records out 
1073741824 bytes (1.1 GB) copied, 471.854 s, 2.3 MB/s 
[root@vmsoldot01 ~]# 
------------------------------------ 
[root@tldtppod15 tmp]# dd if=/dev/zero of=/tmp/bdev/testing/tldtppod15 bs=1M count=1024 oflag=direct 
1024+0 records in 
1024+0 records out 
1073741824 bytes (1.1 GB) copied, 100.014 s, 10.7 MB/s 
[root@tldtppod15 tmp]# dd if=/tmp/bdev/testing/tldtppod15 of=/dev/null bs=1M count=1024 iflag=direct 
1024+0 records in 
1024+0 records out 
1073741824 bytes (1.1 GB) copied, 92.4556 s, 11.6 MB/s 
[root@tldtppod15 tmp]# dd if=/tmp/bdev/testing/tldtppod15 of=/dev/null iflag=direct 
2097152+0 records in 
2097152+0 records out 
1073741824 bytes (1.1 GB) copied, 1112 s, 966 kB/s
--------------------------------------
[root@vmsoldot01 ~]# netstat -i
Kernel Interface table
Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
eth0 1500 0 22895564 0 101660 0 19052738 0 18 0 BMRU
eth1 1500 0 822638 0 221 0 13997 0 17 0 BMRU
lo 65536 0 4281740 0 0 0 4281740 0 0 0 LRU
[root@vmsoldot01 ~]#
------------------------------------
[root@tldtppod15 ~]# netstat -i
Kernel Interface table
Iface MTU Met RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
bond0 1500 0 30489184 0 5095 0 21940113 0 0 0 BMmRU
104b03261a 1500 0 2587924 0 673723 0 0 0 0 0 BMRU
108e4ab487 1500 0 804990 0 7994 0 0 0 0 0 BMRU
100225caed 1500 0 4589169 0 128230 0 0 0 0 0 BMRU
105042eef6 1500 0 10 0 0 0 6 0 0 0 BMRU
1087241aa6 1500 0 115495 0 2590 0 0 0 0 0 BMRU
1061370512 1500 0 2827742 0 21722 0 0 0 0 0 BMRU
bond0.839 1500 0 2837706 0 0 0 0 0 0 0 BMRU
bond0.840 1500 0 4592116 0 0 0 0 0 0 0 BMRU
bond0.842 1500 0 23051901 0 0 0 19030177 0 0 0 BMRU
bond1 1500 0 12194321 0 93820 0 12223822 0 0 0 BMmRU
bond1.350 1500 0 1035850 0 0 0 1068301 0 0 0 BMRU
bond1.941 1500 0 11062114 0 20537 0 9803285 0 0 0 BMRU
bond1.981 1500 0 10 0 0 0 6 0 0 0 BMRU
bond2 1500 0 949087 0 5092 0 309561 0 0 0 BMmRU
bond2.151 1500 0 116429 0 0 0 0 0 0 0 BMRU
bond2.152 1500 0 825020 0 0 0 13997 0 0 0 BMRU
eth4 1500 0 12105592 0 1 0 12223822 0 0 0 BMsRU
eth5 1500 0 949087 0 0 0 309561 0 0 0 BMsRU
eth6 1500 0 88729 0 88730 0 0 0 0 0 BMsRU
eth7 1500 0 30489184 0 0 0 21940113 0 0 0 BMsRU
lo 65536 0 174 0 0 0 174 0 0 0 LRU
vif1.0 1500 0 19030177 0 0 0 22864644 0 0 0 BMRU
vif1.1 1500 0 13997 0 0 0 820349 0 0 0 BMRU
[root@tldtppod15 ~]#

# 2  
Old 11-04-2014
if your mount options *(tcp/udp-rsize/wsize-nfs/cifs and vers and the other opt) and nic settings are same on the both of them server
then we may check the rx/tx (eg.number of packets which hold by driver) buffer queue sizes.because of there is seem drops in the rx buffer.

if any operations needs high traffic we can increase the driver buffers.
we are facing the slow read operations so you likely pointed the correct value.Smilie

check the your (vm) nic card driver and search for , is there a bug or update or patches and then apply it.
Code:
# ethtool -i eth0

check the current ring buffer settings.
Code:
# ethtool -g eth0

and try to increase the rx value to defined maximum values.(eg..256/512/1024)
Code:
# ethtool -G eth0 rx 512

and test again and check the drops count.

if there is no change after dd tests then you can try to change the virtual nic to avaliable other one in the oracle vm net settings.

good lucks
regards
ygemici
# 3  
Old 11-04-2014
Hi,

Something to check before delving into this too deeply is that the networking is set up properly, if you are running through any intelligent network infrastructure ensure that all the TX/RX settings are the same.

Points worth looking at are is auto negotiate set anywhere. Are the port parameters the same all the way through I.E. 100Mb Full Duplex etc.

Regards

Dave
Login or Register to Ask a Question

Previous Thread | Next Thread

9 More Discussions You Might Find Interesting

1. UNIX for Advanced & Expert Users

How to read a fast written log file at Real time speed?

Hello All, I am building a real time parser for a log file in my application. The log file is continuously written at a very fast pace and gets rolled over every 10 minutes. I have measured the speed and observed that around 1000 lines are written to it every second, each line about 30-40... (7 Replies)
Discussion started by: cool.aquarian
7 Replies

2. Shell Programming and Scripting

Script to mount nas-share using generated credentials (mount EC 13,32)

Heyas At home i have 1 nas with 3 shares, of which i used to mount 2 of them using a script with hardcoded password and username in it. EDIT: Turns out, its not the script, but 'how i access' the nas share.. (-o user=XY,password=... VS. -o credentials=...). Figured about credential files,... (0 Replies)
Discussion started by: sea
0 Replies

3. AIX

I/O speed to CIFS mounted Windows Share

I have an AIX box that mounts a Windows share across subnets. When I try to copy a 100 MB file to it, it copies around 2 MB/s. If I copy to another Windows share on the same subnet it copies around 12 MB/s. All I have is gigabit networks so I would expect it to go well over 12 MB/s, which is the... (8 Replies)
Discussion started by: kah00na
8 Replies

4. Solaris

how to make nas share mounted in zones persistent across reboots?

there are few nas shares that would be mounted on the local zone. should i add an entry into the add an entry in zone.xml file so that it gets mounted automatically when the zone gets rebooted? or whats the correct way to get it mounted automatically when the zone reboots (2 Replies)
Discussion started by: chidori
2 Replies

5. UNIX Desktop Questions & Answers

help with some basic osx terminal commands. fixing permissions on NAS share

I'm hoping someone here can help me. I'm computer literate but by no means an expert! I'm simply trying to recover data from my DLink DNS343 NAS mounted on my X86 iMac using SMB. Somehow, in moving to a new computer, I have lost access to some files on the NAS. Just some files are access denied. ... (0 Replies)
Discussion started by: Quantaa
0 Replies

6. Filesystems, Disks and Memory

Disk read and write speed.

Being a novice user to linux i m little unaware of how would i check disk read write speed. One of my mate is suggesting to create a file using dd command and check how much time it takes to create a 30 gb file . I think this has a little sense however i would also like to take your reviews... (5 Replies)
Discussion started by: pinga123
5 Replies

7. Filesystems, Disks and Memory

data from blktrace: read speed V.S. write speed

I analysed disk performance with blktrace and get some data: read: 8,3 4 2141 2.882115217 3342 Q R 195732187 + 32 8,3 4 2142 2.882116411 3342 G R 195732187 + 32 8,3 4 2144 2.882117647 3342 I R 195732187 + 32 8,3 4 2145 ... (1 Reply)
Discussion started by: W.C.C
1 Replies

8. Solaris

Samba: share subfolder as read only.

Hi, Currently I have a Samba shared configured as follows: comment = Public fileshare path = /u02/pub guest ok = Yes writeable = Yes There is a subfolder under /u02/pub called /u02/pub/expenses/hardware that I need to make read only. How do I do this? I am new to using Samba. ... (2 Replies)
Discussion started by: sparcman
2 Replies

9. Shell Programming and Scripting

read -p "prompt text" foo say "read: bad option(s)" in Bourne-Shell

Hallo, i need a Prompting read in my script: read -p "Enter your command: " command But i always get this Error: -p: is not an identifier When I run these in c-shell i get this error /usr/bin/read: read: bad option(s) How can I use a Prompt in the read command? (9 Replies)
Discussion started by: wiseguy
9 Replies
Login or Register to Ask a Question