skywise_ca
Dabbler
- Joined
- Jun 22, 2017
- Messages
- 15
TLDR: What speed should a virtIO link between a VM and freenas be? (1.2Gbit/sec seems slow)
I'm looking at combining my current NAS (nas4free) and ESX server into a single FreeNAS11 box hosting VMs and NAS.
I used my current ESX box(Opteron 6378 with 64G ram) as a testbed so I could benchmark FreeNAS, installing a fresh 11.0Release on it.
I installed a ubuntu 16.04 server distro VM (4 core 4G RAM) on it, using virtIO for both disk and network.
Using iperf3, I tested the network speed between the ubuntu VM and the freeNAS host.
The box has a 10G card in it, linking to the nas4free box and iperf3 between those two are:
So, the hardware itself has lots of punch to push the bits.
(I tested the Intel emulation as well, as expected, it was worse)
I also tested the CPU between ESX and bhyve and that came out pretty good.
ESX: https://browser.geekbench.com/v4/cpu/3196655
bhyve: https://browser.geekbench.com/v4/cpu/3195634
I didn't test the disk but since it's ZFS I'd guess it'd be pretty solid.
My only issue is the slow network.
What are others getting between their VMs and the freeNAS host?
I'm looking at combining my current NAS (nas4free) and ESX server into a single FreeNAS11 box hosting VMs and NAS.
I used my current ESX box(Opteron 6378 with 64G ram) as a testbed so I could benchmark FreeNAS, installing a fresh 11.0Release on it.
I installed a ubuntu 16.04 server distro VM (4 core 4G RAM) on it, using virtIO for both disk and network.
Using iperf3, I tested the network speed between the ubuntu VM and the freeNAS host.
Code:
[ ID] Interval Transfer Bandwidth Retr [ 4] 0.00-10.00 sec 1.43 GBytes 1.23 Gbits/sec 0 sender [ 4] 0.00-10.00 sec 1.43 GBytes 1.23 Gbits/sec receiver
The box has a 10G card in it, linking to the nas4free box and iperf3 between those two are:
Code:
- - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bandwidth Retr [ 4] 0.00-10.00 sec 11.5 GBytes 9.89 Gbits/sec 0 sender [ 4] 0.00-10.00 sec 11.5 GBytes 9.89 Gbits/sec receiver
So, the hardware itself has lots of punch to push the bits.
(I tested the Intel emulation as well, as expected, it was worse)
I also tested the CPU between ESX and bhyve and that came out pretty good.
ESX: https://browser.geekbench.com/v4/cpu/3196655
bhyve: https://browser.geekbench.com/v4/cpu/3195634
I didn't test the disk but since it's ZFS I'd guess it'd be pretty solid.
My only issue is the slow network.
What are others getting between their VMs and the freeNAS host?