Hey,
Since the introduction of bhyve into FreeNAS 9.10 and now 9.10.1 I took the opportunity to migrate most of my jails into a VM (FreeBSD 10.3-RELEASE-p7).
I've been checking out the network speed between the host and the guest using iperf and bonnie++ to check the speed of the nfs link between them.
Hardware details:
ASRock C2750d4i, 32GB ECC RAM,
Jails/VMs live on a pair of mirrored 120GB SSDs.
Main pool is 6x3TB WD Reds in RAIDZ2 with a 4TB hot spare.
On the host I'm running:
On the FBSD guest I run:
The results from bonnie++ are largely consistent with the results above. My question is whether these numbers are as good as it gets or is there is there a way to tune the host and guest to get better bandwidth on the connection?
If I've left out any details please free to ask.
Thanks.
Since the introduction of bhyve into FreeNAS 9.10 and now 9.10.1 I took the opportunity to migrate most of my jails into a VM (FreeBSD 10.3-RELEASE-p7).
I've been checking out the network speed between the host and the guest using iperf and bonnie++ to check the speed of the nfs link between them.
Hardware details:
ASRock C2750d4i, 32GB ECC RAM,
Jails/VMs live on a pair of mirrored 120GB SSDs.
Main pool is 6x3TB WD Reds in RAIDZ2 with a 4TB hot spare.
On the host I'm running:
Code:
% iperf -s -B 192.168.1.21 ------------------------------------------------------------ Server listening on TCP port 5001 Binding to local address 192.168.1.21 TCP window size: 64.0 KByte (default) ------------------------------------------------------------ [ 4] local 192.168.1.21 port 5001 connected with 192.168.1.40 port 50063 [ ID] Interval Transfer Bandwidth [ 4] 0.0-10.0 sec 755 MBytes 630 Mbits/sec [ 5] local 192.168.1.21 port 5001 connected with 192.168.1.40 port 41277 [ 5] 0.0-10.0 sec 752 MBytes 631 Mbits/sec [ 4] local 192.168.1.21 port 5001 connected with 192.168.1.40 port 60136 [ 4] 0.0-10.0 sec 751 MBytes 629 Mbits/sec
On the FBSD guest I run:
Code:
$ iperf -c 192.168.1.21 -p 5001 ------------------------------------------------------------ Client connecting to 192.168.1.21, TCP port 5001 TCP window size: 32.5 KByte (default) ------------------------------------------------------------ [ 3] local 192.168.1.40 port 50063 connected with 192.168.1.21 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.0 sec 755 MBytes 631 Mbits/sec [colmconn@lister ~]$ iperf -c 192.168.1.21 -p 5001 -w 64KB ------------------------------------------------------------ Client connecting to 192.168.1.21, TCP port 5001 TCP window size: 65.0 KByte (WARNING: requested 64.0 KByte) ------------------------------------------------------------ [ 3] local 192.168.1.40 port 41277 connected with 192.168.1.21 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.0 sec 752 MBytes 631 Mbits/sec [colmconn@lister ~]$ iperf -c 192.168.1.21 -p 5001 -w 64KB ------------------------------------------------------------ Client connecting to 192.168.1.21, TCP port 5001 TCP window size: 65.0 KByte (WARNING: requested 64.0 KByte) ------------------------------------------------------------ [ 3] local 192.168.1.40 port 60136 connected with 192.168.1.21 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.0 sec 751 MBytes 630 Mbits/sec
The results from bonnie++ are largely consistent with the results above. My question is whether these numbers are as good as it gets or is there is there a way to tune the host and guest to get better bandwidth on the connection?
If I've left out any details please free to ask.
Thanks.
