Vmxnet3 network card speed less than 10G

[juebanlin]

freebas version:11.1-u6
esxi version:6.7
vm network adapter:vmxnet3
speed test:
Freenas (iperf-c), Vmwin10 (iperf-s):
[root@freenas ~]# iperf-c 10.0.0.98-t 20-i 2-F "M"
----------------------------------------------------------------------------------------------------------------------------------------------------------------
Client connection to 10.0.0.98, TCP port 5001
TCP window size: 0.03 MByte (default)
----------------------------------------------------------------------------------------------------------------------------------------------------------------
[3] Local 10.0.0.240 port 62736 connected with 10.0.0.98 port 5001
[ID] Interval Transfer Bandwidth
[3] 0.0-2.0 sec 845 MBytes 423 MBytes/sec
[3] 2.0-4.0 sec 820 MBytes 410 MBytes/sec
[3] 4.0-6.0 sec 821 MBytes 411 MBytes/sec
[3] 6.0-8.0 sec 845 MBytes 422 MBytes/sec
[3] 8.0-10.0 sec 828 MBytes 414 MBytes/sec
[3] 10.0-12.0 sec 1040 MBytes 520 MBytes/sec
[3] 12.0-14.0 sec 809 MBytes 405 MBytes/sec
[3] 14.0-16.0 sec 838 MBytes 419 MBytes/sec
[3] 16.0-18.0 sec 1003 MBytes 502 MBytes/sec
[3] 18.0-20.0 sec 989 MBytes 494 MBytes/sec
[3] 0.0-20.0 sec 8862 MBytes 442 MBytes/sec

Win10 (iperf-c) freenas (iperf-s):
PS C:\Users\admin\Desktop\iperf-2.0.9-win64> .\iperf.exe -c 10.0.0.240 -f "M" -t 20 -i 2
------------------------------------------------------------
Client connecting to 10.0.0.240, TCP port 5001
TCP window size: 0.20 MByte (default)
------------------------------------------------------------
[ 3] local 10.0.0.98 port 64500 connected with 10.0.0.240 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0- 2.0 sec 557 MBytes 278 MBytes/sec
[ 3] 2.0- 4.0 sec 468 MBytes 234 MBytes/sec
[ 3] 4.0- 6.0 sec 451 MBytes 225 MBytes/sec
[ 3] 6.0- 8.0 sec 434 MBytes 217 MBytes/sec
[ 3] 8.0-10.0 sec 414 MBytes 207 MBytes/sec
[ 3] 10.0-12.0 sec 457 MBytes 229 MBytes/sec
[ 3] 12.0-14.0 sec 484 MBytes 242 MBytes/sec
[ 3] 14.0-16.0 sec 481 MBytes 241 MBytes/sec
[ 3] 16.0-18.0 sec 461 MBytes 231 MBytes/sec
[ 3] 18.0-20.0 sec 420 MBytes 210 MBytes/sec
[ 3] 0.0-20.0 sec 4629 MBytes 231 MBytes/sec

10.0.0.0/24 network segment is the network segment between virtual machines. No Wul switch is used to ensure the normal test.
This speed is not up to the standard of vmxnet3, and the test between win10 can reach 10G speed.


How do I set it up? Why read speed can reach 4 G, write speed only 2 G?

 

[kdragon75]

Considering this is all done in memory and CPU we will need the full details of all the hardware and configuration.

 

[shaf]

Couple of things I did that improved speed.

Disabled autotune.
Removed all autotune settings

Enabled Jumbo Frames on my network
Added MTU 9000 option to the interface in freenas

I've still got issues but these improved the speed.