Login or Register to Ask a Question and Join Our Community

Sponsored Content
Full Discussion: 10gbe ixgbe slow at 420mbyte/s max, p2p lan cat8 1m, tried ethtool and ifconfig options to no avail
Top Forums UNIX for Beginners Questions & Answers 10gbe ixgbe slow at 420mbyte/s max, p2p lan cat8 1m, tried ethtool and ifconfig options to no avail Post 303045707 by tinfoil3d on Thursday 9th of April 2020 10:52:43 PM
Old 04-09-2020
[SOLVED] 10gbe ixgbe slow at 420mbyte/s max, p2p lan cat8 1m, tried ethtool and ifconfig options
Hey guys, first time dealing with 10gbe.
I have two boxes, one is older with i7 2.8ghz from 2009 generation, pcie 2.0 and I just put the Intel X550T there to make use of absolutely similar but builtin adapter on my newer box with AMD EPYC gen 1.
I'm dling file from tmpfs on either box and never go above 415mbyte/s which is about half of potential bandwidth there, right?
I tried most stuff from kernel . org/doc/ols/2009/ols2009-pages-169-184.pdf with a little improvement from 393mbyte/s to current 415.
that's the result of me setting mtu 9000, txqueuelen 10000.
Also tried this to no improvements over current result: darksideclouds wordpress com/2016/10/10/tuning-10gb-nics-highway-to-hell/
And a few other pages out there on google, most stating same options.
I don't see a 100% load burst on i7 box when I dl file, it's around 10% across the cores. So CPU shouldn't be a bottleneck, cable(it's 1meter cat8, with a nice thick shielding) shouldn't be a bottleneck and ram speed and pcie 2.0 speed shouldn't be.
iperf also reports same speed.
Tried these tests in both directions.
There's gotta be something obvious that I'm missing, right?

Pretty sure it doesn't matter but it's lfs on i7 and debian 10 on epyc, both sharing same sysctl settings and ethtool-controlled options.
lspci -n for it on both computers:
Code:
62:00.0 0200: 8086:1563 (rev 01)

so it's similar device. I bought this particular one for compatibility but didn't expect these issues.

Maybe someone here would suggest something, I'm out of ideas.
TIA
--
solved see my own response
Last edited by tinfoil3d; 04-11-2020 at 08:48 AM.. Reason: solved, it's PCIe lane count, usb3, sata3, 6 disks, one GPU downgraded to x8 and no more space to have x4 on pcie 2.0 mb with max 16 lanes i7 CPU
 

9 More Discussions You Might Find Interesting

1. Solaris

How to configure private LAN and coporate LAN on the same machine-Solaris10

Hi , I am trying to configure a private LAN and corporate LAN on the same machien on Solaris 10. How can I achieve this? Thanks (1 Reply)
Discussion started by: deedee
1 Replies

2. Shell Programming and Scripting

ethtool : command not found

Hi, I am uising Suse linux on my system and i tried : man ethtool and i got the manual for ethtool but when i tried to use the command as: ethtool -a eth0 it says Command not found. also, i tried rpm -qa|grep ethtool i got: ethtool-3-15.2 so,it means my system has ethtool server or... (4 Replies)
Discussion started by: salil2012
4 Replies

3. Programming

ethtool problem

Hi, I'm using ethtool to change network settings: Just for the experiment, i want to change speed to 10, instead of 100, I type: ethtool -s eth0 speed 10 duplex full autoneg off and to view settings i type: ethtool eth0, and get this: Settings for eth0: Supported ports: ... (4 Replies)
Discussion started by: alex889
4 Replies

4. IP Networking

Slow LAN FTP Transfers with FreeBSD...

Hello, I've got a FreeBSD 6 server running on my network that I used as a file server for my main computer. However I've really become frustrated with the slow up/down speeds I'm getting, about 100KB/s, which is about as bad as if I was using a "real" server. My setup is as follows: ISP |... (4 Replies)
Discussion started by: CyberCat
4 Replies

5. IP Networking

Local Lan, no-ip directed DNS forward, surf within lan

Hi, We have a website running on a local centos 5.4 surfer, static IP. The domain.com uses no-ip.com to take care of the DNS, it forwards all to my server. My router receives the port 80 call, routes it to my server and the world can see domain.com perfectly fine. However, we cannot see... (3 Replies)
Discussion started by: lawstudent
3 Replies

6. Shell Programming and Scripting

cut, sed, awk too slow to retrieve line - other options?

Hi, I have a script that, basically, has two input files of this type: file1 key1=value1_1_1 key2=value1_2_1 key4=value1_4_1 ... file2 key2=value2_2_1 key2=value2_2_2 key3=value2_3_1 key4=value2_4_1 ... My files are 10k lines big each (approx). The keys are strings that don't... (7 Replies)
Discussion started by: fzd
7 Replies

7. Red Hat

Ethtool script not running on boot.

Hi, there is an incompatibility between my NIC and my Western Digital Powerline adapters which appears to cause autonegotiation to fail intermittently, most often following a reboot. Running the following Ethtool script will establish a connection immediately: #!/bin/sh # chkconfig: 345 85... (12 Replies)
Discussion started by: torley
12 Replies

8. UNIX and Linux Applications

VSFTPD slow download outside of LAN

Hello all. I have VSFTP up and ruining on ubuntu 10.04. It works great inside LAN, however when it comes to using it outside i have some problems. If i try to connect from filezila i get the listing and if i try to download it shows it will take forever to receive a file which is larger then 1mb,... (2 Replies)
Discussion started by: mantas1
2 Replies

9. UNIX for Beginners Questions & Answers

Ethtool command not working

Hi All, I am trying to find my NIC card speed in centos 5. But i am unable to get the info using ethtool command. # ethtool eth0 Settings for eth0: Link detected: yes and even tried to look for the file # cd /sys/class/net/eth0/speed files which is also not available.... (8 Replies)
Discussion started by: sravani25
8 Replies

LEARN ABOUT REDHAT

ethtool

ETHTOOL(8)						      System Manager's Manual							ETHTOOL(8)

NAME

       ethtool - Display or change ethernet card settings

SYNOPSIS

       ethtool ethX

       ethtool -h

       ethtool -a ethX

       ethtool -A ethX [autoneg on|off] [rx on|off] [tx on|off]

       ethtool -c ethX

       ethtool	-C  ethX [adaptive-rx on|off] [adaptive-tx on|off] [rx-usecs N] [rx-frames N] [rx-usecs-irq N] [rx-frames-irq N] [tx-usecs N] [tx-
       frames N] [tx-usecs-irq N] [tx-frames-irq N] [stats-block-usecs N] [pkt-rate-low N] [rx-usecs-low N]  [rx-frames-low  N]  [tx-usecs-low	N]
       [tx-frames-low N] [pkt-rate-high N] [rx-usecs-high N] [rx-frames-high N] [tx-usecs-high N] [tx-frames-high N] [sample-interval N]

       ethtool -g ethX

       ethtool -G ethX [rx N] [rx-mini N] [rx-jumbo N] [tx N]

       ethtool -i ethX

       ethtool -d ethX

       ethtool -e ethX

       ethtool -k ethX

       ethtool -K ethX [rx on|off] [tx on|off] [sg on|off]

       ethtool -p ethX [N]

       ethtool -r ethX

       ethtool -S ethX

       ethtool -t ethX [offline|online]

       ethtool	 -s   ethX  [speed 10|100|1000]  [duplex half|full]  [port tp|aui|bnc|mii]  [autoneg on|off]  [phyad  N]  [xcvr internal|external]
       [wol p|u|m|b|a|g|s|d...]  [sopass xx:yy:zz:aa:bb:cc] [msglvl N]

DESCRIPTION

       ethtool is used for querying settings of an ethernet device and changing them.

       ethX is the name of the ethernet device to work on.

OPTIONS

       ethtool with a single argument specifying the device name prints current setting of the specified device.

       -h     shows a short help message.

       -a     queries the specified ethernet device for pause parameter information.

       -A     change the pause parameters of the specified ethernet device.

       autoneg on|off
	      Specify if pause autonegotiation is enabled.

       rx on|off
	      Specify if RX pause is enabled.

       tx on|off
	      Specify if TX pause is enabled.

       -c     queries the specified ethernet device for coalescing information.

       -C     change the coalescing settings of the specified ethernet device.

       -g     queries the specified ethernet device for rx/tx ring parameter information.

       -G     change the rx/tx ring parameters of the specified ethernet device.

       rx N   Change number of ring entries for the Rx ring.

       rx-mini N
	      Change number of ring entries for the Rx Mini ring.

       rx-jumbo N
	      Change number of ring entries for the Rx Jumbo ring.

       tx N   Change number of ring entries for the Tx ring.

       -i     queries the specified ethernet device for associated driver information.

       -d     retrieves and prints a register dump for the specified ethernet device.

       -e     retrieves and prints an EEPROM dump for the specified ethernet device.

       -k     queries the specified ethernet device for checksumming information.

       -K     change the checksumming parameters of the specified ethernet device.

       rx on|off
	      Specify if RX checksumming is enabled.

       tx on|off
	      Specify if TX checksumming is enabled.

       sg on|off
	      Specify if scatter-gather is enabled.

       -p     initiates adapter-specific action intended to enable an operator to easily identify the adapter by sight.  typically  this  involves
	      blinking one or more LEDs on the specific ethernet port.

       N      Length of time to perform phys-id, in seconds.

       -r     restarts auto-negotiation on the specified ethernet device, if auto-negotiation is enabled.

       -S     queries the specified ethernet device for NIC- and driver-specific statistics.

       -t     executes adapter selftest on the specified ethernet device. Possible test modes are:

       offline|online
	      defines  test  type:  offline (default) means to perform full set of tests possibly causing normal operation interruption during the
	      tests, online means to perform limited set of tests do not interrupting normal adapter operation.

       -s     option allows changing some or all settings of the specified ethernet device.  All following options only apply if -s was specified.

       speed 10|100|1000
	      Set speed in Mb/s.  ethtool with single argument will show you the supported device speeds.

       duplex half|full
	      Set full or half duplex mode.

       port tp|aui|bnc|mii
	      Select device port.

       autoneg on|off
	      Specify if autonegotiation is enabled. In the usual case it is, but might cause some problems with some network devices, so you  can
	      turn it off.

       phyad N
	      PHY address.

       xcvr internal|external
	      Select transceiver type. Currently only internal and external can be specified, in the future further types might be added.

       wol p|u|m|b|a|g|s|d...
	      Set  Wake-on-LAN	options.   Not	all  devices support this.  The argument to this option is a string of characters specifying which
	      options to enable.
	      p  Wake on phy activity
	      u  Wake on unicast messages
	      m  Wake on multicast messages
	      b  Wake on broadcast messages
	      a  Wake on ARP
	      g  Wake on MagicPacket(tm)
	      s  Enable SecureOn(tm) password for MagicPacket(tm)
	      d  Disable (wake on nothing).  This option clears all previous options.

       sopass xx:yy:zz:aa:bb:cc
	      Set the SecureOn(tm) password.  The argument to this option must be 6 bytes in ethernet MAC hex format (xx:yy:zz:aa:bb:cc).

       msglvl N
	      Set the driver message level. Meanings differ per driver.

BUGS

       Not supported (in part or whole) on all ethernet drivers.

AUTHOR

       ethtool was written by David Miller.

       Modifications by Jeff Garzik, Tim Hockin, Jakub Jelinek, Andre Majorel, Eli Kupermann.

AVAILABILITY

       ethtool is available over the Web on the SourceForge site at http://sourceforge.net/projects/gkernel/

Ethtool version 1.6						     June 2002								ETHTOOL(8)
All times are GMT -4. The time now is 04:39 PM.
Unix & Linux Forums Content Copyright 1993-2022. All Rights Reserved.
Privacy Policy