Brezlord
Contributor
- Joined
- Jan 7, 2017
- Messages
- 189
Hi all,
I have been doing some testing with iperf3 and FreeNAS running as a VM in ESXi 6.5 and have found that 10Gbe networking to be poor. I have kept it simple and kept FreeNAS and a CentOS 7 VM on the same host to take any issues with switches and cabling out of the picture.
Everything is set for MTU 1500 and host to host network will hit 9.8GB/s so networking both physical and virtual is working correctly.
The bellow screen shot is CentOS 7 to CentsOS 7 on the same host.
The next test is FreeNAS to CentOS 7 on the same host.
Just to be sure it was not a host issue I migrated all of the above machines to another host and got the same results. I then spun up a napp-it-SAN VM and got the same results and just to be sure I spun up a vanilla FreeBSD 11.1-RELEASE VM and got the same results as the FreeNAS server.
Is this issue to do with FreeBSD and more broadly UNIX systems driver for VMXNET 3. If this is the case is there any way to get 10Gbe out of a FreeNAS VM or is bare metal the only way? Or have I stuffed something up? I'm not sure on what config info you would need so just ask and I will get back to you.
Thanks,
Simon
I have been doing some testing with iperf3 and FreeNAS running as a VM in ESXi 6.5 and have found that 10Gbe networking to be poor. I have kept it simple and kept FreeNAS and a CentOS 7 VM on the same host to take any issues with switches and cabling out of the picture.
Everything is set for MTU 1500 and host to host network will hit 9.8GB/s so networking both physical and virtual is working correctly.
The bellow screen shot is CentOS 7 to CentsOS 7 on the same host.
Code:
[root@localhost ~]# iperf3 -c 192.168.10.58 -R Connecting to host 192.168.10.58, port 5201 Reverse mode, remote host 192.168.10.58 is sending [ 4] local 192.168.10.62 port 59270 connected to 192.168.10.58 port 5201 [ ID] Interval Transfer Bandwidth [ 4] 0.00-1.00 sec 2.62 GBytes 22.5 Gbits/sec [ 4] 1.00-2.00 sec 2.29 GBytes 19.6 Gbits/sec [ 4] 2.00-3.00 sec 2.39 GBytes 20.5 Gbits/sec [ 4] 3.00-4.00 sec 2.40 GBytes 20.6 Gbits/sec [ 4] 4.00-5.00 sec 2.21 GBytes 19.0 Gbits/sec [ 4] 5.00-6.00 sec 2.08 GBytes 17.8 Gbits/sec [ 4] 6.00-7.00 sec 2.10 GBytes 18.1 Gbits/sec [ 4] 7.00-8.00 sec 2.23 GBytes 19.2 Gbits/sec [ 4] 8.00-9.00 sec 2.27 GBytes 19.5 Gbits/sec [ 4] 9.00-10.00 sec 2.18 GBytes 18.7 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [ 4] 0.00-10.00 sec 22.8 GBytes 19.6 Gbits/sec 0 sender [ 4] 0.00-10.00 sec 22.8 GBytes 19.6 Gbits/sec receiver iperf Done. [root@localhost ~]#
The next test is FreeNAS to CentOS 7 on the same host.
Code:
root@nas1:~ # iperf3 -c 192.168.10.58 -R Connecting to host 192.168.10.58, port 5201 Reverse mode, remote host 192.168.10.58 is sending [ 5] local 192.168.10.40 port 60293 connected to 192.168.10.58 port 5201 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 538 MBytes 4.51 Gbits/sec [ 5] 1.00-2.00 sec 591 MBytes 4.96 Gbits/sec [ 5] 2.00-3.00 sec 621 MBytes 5.21 Gbits/sec [ 5] 3.00-4.00 sec 616 MBytes 5.17 Gbits/sec [ 5] 4.00-5.00 sec 558 MBytes 4.68 Gbits/sec [ 5] 5.00-6.00 sec 622 MBytes 5.22 Gbits/sec [ 5] 6.00-7.00 sec 615 MBytes 5.16 Gbits/sec [ 5] 7.00-8.00 sec 586 MBytes 4.91 Gbits/sec [ 5] 8.00-9.00 sec 610 MBytes 5.11 Gbits/sec [ 5] 9.00-10.00 sec 620 MBytes 5.20 Gbits/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 5.84 GBytes 5.02 Gbits/sec 1405 sender [ 5] 0.00-10.00 sec 5.84 GBytes 5.02 Gbits/sec receiver iperf Done. root@nas1:~ #
Just to be sure it was not a host issue I migrated all of the above machines to another host and got the same results. I then spun up a napp-it-SAN VM and got the same results and just to be sure I spun up a vanilla FreeBSD 11.1-RELEASE VM and got the same results as the FreeNAS server.
Is this issue to do with FreeBSD and more broadly UNIX systems driver for VMXNET 3. If this is the case is there any way to get 10Gbe out of a FreeNAS VM or is bare metal the only way? Or have I stuffed something up? I'm not sure on what config info you would need so just ask and I will get back to you.
Thanks,
Simon
Last edited:
