I installed Freenas on esxi and went straight to an H310 card, which had already brushed the IT firmware.
1. I made four SAS disks into strips.
2. Then the DD command is used to measure the storage pool speed up to 600MB/S.
3. The speed of a single disk is over 120M/S.
But the problem arises:
Other virtual machines on esxi can access freenas SMB at speeds not exceeding 200M/S. The disk monitoring of freenas shows that the write speed of a single disk is about 40MB/S, which is much lower than 120MB/S.
I measured the SMB speed between two windows 10 on esxi, which can reach 1GB/S, thus eliminating the problems of virtual network card and windows system.
My freenas version is 11.1 u6.
I've tried to turn off synchronous writing of zfs, strict sync = no for SMB configuration, and even turn off compression of storage pools at the same time. But still less than half the speed of DD test.
2018.12.12 updae:
My system is esxi6.7, which installs freenas 11.1-u6 and uses vmxnet3.
I think I found the reason, it should be the network card problem. Following is the result of the iperf test. Win10 reads freenas very fast, but writes to freenas very slowly.
Freenas (iperf-c), Vmwin10 (iperf-s):
[root@freenas ~]# iperf-c 10.0.0.98-t 20-i 2-F "M"
----------------------------------------------------------------------------------------------------------------------------------------------------------------
Client connection to 10.0.0.98, TCP port 5001
TCP window size: 0.03 MByte (default)
----------------------------------------------------------------------------------------------------------------------------------------------------------------
[3] Local 10.0.0.240 port 62736 connected with 10.0.0.98 port 5001
[ID] Interval Transfer Bandwidth
[3] 0.0-2.0 sec 845 MBytes 423 MBytes/sec
[3] 2.0-4.0 sec 820 MBytes 410 MBytes/sec
[3] 4.0-6.0 sec 821 MBytes 411 MBytes/sec
[3] 6.0-8.0 sec 845 MBytes 422 MBytes/sec
[3] 8.0-10.0 sec 828 MBytes 414 MBytes/sec
[3] 10.0-12.0 sec 1040 MBytes 520 MBytes/sec
[3] 12.0-14.0 sec 809 MBytes 405 MBytes/sec
[3] 14.0-16.0 sec 838 MBytes 419 MBytes/sec
[3] 16.0-18.0 sec 1003 MBytes 502 MBytes/sec
[3] 18.0-20.0 sec 989 MBytes 494 MBytes/sec
[3] 0.0-20.0 sec 8862 MBytes 442 MBytes/sec
Win10 (iperf-c) freenas (iperf-s):
PS C:\Users\admin\Desktop\iperf-2.0.9-win64> .\iperf.exe -c 10.0.0.240 -f "M" -t 20 -i 2
------------------------------------------------------------
Client connecting to 10.0.0.240, TCP port 5001
TCP window size: 0.20 MByte (default)
------------------------------------------------------------
[ 3] local 10.0.0.98 port 64500 connected with 10.0.0.240 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0- 2.0 sec 557 MBytes 278 MBytes/sec
[ 3] 2.0- 4.0 sec 468 MBytes 234 MBytes/sec
[ 3] 4.0- 6.0 sec 451 MBytes 225 MBytes/sec
[ 3] 6.0- 8.0 sec 434 MBytes 217 MBytes/sec
[ 3] 8.0-10.0 sec 414 MBytes 207 MBytes/sec
[ 3] 10.0-12.0 sec 457 MBytes 229 MBytes/sec
[ 3] 12.0-14.0 sec 484 MBytes 242 MBytes/sec
[ 3] 14.0-16.0 sec 481 MBytes 241 MBytes/sec
[ 3] 16.0-18.0 sec 461 MBytes 231 MBytes/sec
[ 3] 18.0-20.0 sec 420 MBytes 210 MBytes/sec
[ 3] 0.0-20.0 sec 4629 MBytes 231 MBytes/sec
10.0.0.0/24 network segment is the network segment between virtual machines. No Wul switch is used to ensure the normal test.
This speed is not up to the standard of vmxnet3, and the test between win10 can reach 10G speed.
1. I made four SAS disks into strips.
2. Then the DD command is used to measure the storage pool speed up to 600MB/S.
3. The speed of a single disk is over 120M/S.
But the problem arises:
Other virtual machines on esxi can access freenas SMB at speeds not exceeding 200M/S. The disk monitoring of freenas shows that the write speed of a single disk is about 40MB/S, which is much lower than 120MB/S.
I measured the SMB speed between two windows 10 on esxi, which can reach 1GB/S, thus eliminating the problems of virtual network card and windows system.
My freenas version is 11.1 u6.
I've tried to turn off synchronous writing of zfs, strict sync = no for SMB configuration, and even turn off compression of storage pools at the same time. But still less than half the speed of DD test.
2018.12.12 updae:
My system is esxi6.7, which installs freenas 11.1-u6 and uses vmxnet3.
I think I found the reason, it should be the network card problem. Following is the result of the iperf test. Win10 reads freenas very fast, but writes to freenas very slowly.
Freenas (iperf-c), Vmwin10 (iperf-s):
[root@freenas ~]# iperf-c 10.0.0.98-t 20-i 2-F "M"
----------------------------------------------------------------------------------------------------------------------------------------------------------------
Client connection to 10.0.0.98, TCP port 5001
TCP window size: 0.03 MByte (default)
----------------------------------------------------------------------------------------------------------------------------------------------------------------
[3] Local 10.0.0.240 port 62736 connected with 10.0.0.98 port 5001
[ID] Interval Transfer Bandwidth
[3] 0.0-2.0 sec 845 MBytes 423 MBytes/sec
[3] 2.0-4.0 sec 820 MBytes 410 MBytes/sec
[3] 4.0-6.0 sec 821 MBytes 411 MBytes/sec
[3] 6.0-8.0 sec 845 MBytes 422 MBytes/sec
[3] 8.0-10.0 sec 828 MBytes 414 MBytes/sec
[3] 10.0-12.0 sec 1040 MBytes 520 MBytes/sec
[3] 12.0-14.0 sec 809 MBytes 405 MBytes/sec
[3] 14.0-16.0 sec 838 MBytes 419 MBytes/sec
[3] 16.0-18.0 sec 1003 MBytes 502 MBytes/sec
[3] 18.0-20.0 sec 989 MBytes 494 MBytes/sec
[3] 0.0-20.0 sec 8862 MBytes 442 MBytes/sec
Win10 (iperf-c) freenas (iperf-s):
PS C:\Users\admin\Desktop\iperf-2.0.9-win64> .\iperf.exe -c 10.0.0.240 -f "M" -t 20 -i 2
------------------------------------------------------------
Client connecting to 10.0.0.240, TCP port 5001
TCP window size: 0.20 MByte (default)
------------------------------------------------------------
[ 3] local 10.0.0.98 port 64500 connected with 10.0.0.240 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0- 2.0 sec 557 MBytes 278 MBytes/sec
[ 3] 2.0- 4.0 sec 468 MBytes 234 MBytes/sec
[ 3] 4.0- 6.0 sec 451 MBytes 225 MBytes/sec
[ 3] 6.0- 8.0 sec 434 MBytes 217 MBytes/sec
[ 3] 8.0-10.0 sec 414 MBytes 207 MBytes/sec
[ 3] 10.0-12.0 sec 457 MBytes 229 MBytes/sec
[ 3] 12.0-14.0 sec 484 MBytes 242 MBytes/sec
[ 3] 14.0-16.0 sec 481 MBytes 241 MBytes/sec
[ 3] 16.0-18.0 sec 461 MBytes 231 MBytes/sec
[ 3] 18.0-20.0 sec 420 MBytes 210 MBytes/sec
[ 3] 0.0-20.0 sec 4629 MBytes 231 MBytes/sec
10.0.0.0/24 network segment is the network segment between virtual machines. No Wul switch is used to ensure the normal test.
This speed is not up to the standard of vmxnet3, and the test between win10 can reach 10G speed.
Last edited:
