kurtc
Dabbler
- Joined
- Dec 17, 2017
- Messages
- 39
I have been having poor random and especially poor sequential read performance on 7 different FreeNAS systems. I will pick three to give specs/configs on to hopefully figure out what I am doing wrong! On average for sustained sequential reads of single large files 40-80MBps is what I see. If there is zero activity on the array I might see peaks to 90MBps. Writes aren't great either (compared to traditional RAID configurations I was running on these systems) but at least those will hover from 150-190MBps sustained sequential.
All of these systems are are running pools with multiple 64K block size zvols with sync=standard and lz4 compression. These are presented through iSCSI zvol extents to Windows hosts over dual 10Gb NICs. The physical SAS disks are enterprise grade in most cases capable of 200-220MBps sustained throughput.
System-1
11.2-U6
Dual Intel E5-2670 2.6GHz (32 total cores)
224GB ECC RAM
Broadcom NIC for management
Chelsio T520 10Gb NICs for iSCSI
Avago SAS 9300-8i HBA
POOL RAIDZ2 (ashift 12) of Hitachi Ultrastar Helioseal 10TB SAS drives x 8
(tried with and without Intel 900P optane SLOG and L2ARC)
System-2
11.1-U4
Single Intel E5-2630 2.6GHz
192GB ECC RAM
Broadcom NIC for management
Intel X710 10Gb NICs for iSCSI
Avago SAS 9207-8i HBA
POOL 2 x RAIDZ2 (ashift 12) of Seagate Enterprise ST10000NM0206 10TB SAS drives x 9 each (18 total)
(tried with and without NVMe SLOG and L2ARC)
System-3
11.2-U6
Dual Intel E5-2670 2.6GHz (32 total cores)
128GB ECC RAM
Broadcom NIC for management
Intel X540 10Gb NICs for iSCSI
Avago SAS 9300-8i HBA
POOL 3 x MIRROR of Seagate EXOS X12 12TB SAS drives (6 total)
P4800X NVMe SLOG
Any help would be greatly appreciated, thanks!
All of these systems are are running pools with multiple 64K block size zvols with sync=standard and lz4 compression. These are presented through iSCSI zvol extents to Windows hosts over dual 10Gb NICs. The physical SAS disks are enterprise grade in most cases capable of 200-220MBps sustained throughput.
System-1
11.2-U6
Dual Intel E5-2670 2.6GHz (32 total cores)
224GB ECC RAM
Broadcom NIC for management
Chelsio T520 10Gb NICs for iSCSI
Avago SAS 9300-8i HBA
POOL RAIDZ2 (ashift 12) of Hitachi Ultrastar Helioseal 10TB SAS drives x 8
(tried with and without Intel 900P optane SLOG and L2ARC)
System-2
11.1-U4
Single Intel E5-2630 2.6GHz
192GB ECC RAM
Broadcom NIC for management
Intel X710 10Gb NICs for iSCSI
Avago SAS 9207-8i HBA
POOL 2 x RAIDZ2 (ashift 12) of Seagate Enterprise ST10000NM0206 10TB SAS drives x 9 each (18 total)
(tried with and without NVMe SLOG and L2ARC)
System-3
11.2-U6
Dual Intel E5-2670 2.6GHz (32 total cores)
128GB ECC RAM
Broadcom NIC for management
Intel X540 10Gb NICs for iSCSI
Avago SAS 9300-8i HBA
POOL 3 x MIRROR of Seagate EXOS X12 12TB SAS drives (6 total)
P4800X NVMe SLOG
Any help would be greatly appreciated, thanks!