Mac Thompson
Dabbler
- Joined
- May 12, 2016
- Messages
- 16
Hi There,
We have a new FreeNAS implementation (FreeNAS-9.10-STABLE-201606072003) running on the following:
HP DL380 Gen 9.
- 2 x Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz (6 cores) 2xAPNIC disabled and booting to legacy BIOS.
- HP P840 12Gb SAS controller running in HBA mode
- 2 x 32GB Kingston USB3 (internal) in a mirror for the FreeNAS OS
- Onboard intel 1Gbp LAN for GUI access
- 1 x 2 port Chelsio 10Gbps in a VLAN LAGG for storage access
ARC
- 576GB DDR4 ECC RAM
L2ARC
- 2 x 1.2TB Intel 750 PCI Express SSD stripped to give 2.4TB
ZIL
- 2 x 400GB Intel 750 PCI Express SSD mirrored to give 400GB
Storage
12 x 6TB 12Gb SAS 7200rpm Seagate LFF in 6 mirrored vDev to give 36TB useable
Storage pool is a 24TB LUN shared via ISCSI with about 7TB used
LZ4 compression is on, encryption and de-duplication are off.
We are running approximately 50 VMs on it with two Windows 2012R2 Host nodes in a cluster. We are snapshoting hourly during business hours and replicating to a seconds DC over a 10Gb fibre which has a freeNAS backup server running on Hyper-V (actually this backup system runs very well and we achieve 500Mbps when it replicates at night which is rather good considering the backup FreeNAS install has none of the fancy specs of the main unit).
The problem is the main production unit for which I have given the specs above. Disk response time is atrocious when we do anything that involves copying data to or from the LUN. So moving a server on or off bogs its down, replicating at the host level (as opposed to FreeNAS replication which as described above is fine), host level backups, hyper-v snapshots and merges etc. Response times climb to 15 for even a few hundred milliseconds for the disk where as for optimum performance everything should be under 10.
Is there any suggestions for what I should be looking for or tuning to improve performance?
We have a new FreeNAS implementation (FreeNAS-9.10-STABLE-201606072003) running on the following:
HP DL380 Gen 9.
- 2 x Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz (6 cores) 2xAPNIC disabled and booting to legacy BIOS.
- HP P840 12Gb SAS controller running in HBA mode
- 2 x 32GB Kingston USB3 (internal) in a mirror for the FreeNAS OS
- Onboard intel 1Gbp LAN for GUI access
- 1 x 2 port Chelsio 10Gbps in a VLAN LAGG for storage access
ARC
- 576GB DDR4 ECC RAM
L2ARC
- 2 x 1.2TB Intel 750 PCI Express SSD stripped to give 2.4TB
ZIL
- 2 x 400GB Intel 750 PCI Express SSD mirrored to give 400GB
Storage
12 x 6TB 12Gb SAS 7200rpm Seagate LFF in 6 mirrored vDev to give 36TB useable
Storage pool is a 24TB LUN shared via ISCSI with about 7TB used
LZ4 compression is on, encryption and de-duplication are off.
We are running approximately 50 VMs on it with two Windows 2012R2 Host nodes in a cluster. We are snapshoting hourly during business hours and replicating to a seconds DC over a 10Gb fibre which has a freeNAS backup server running on Hyper-V (actually this backup system runs very well and we achieve 500Mbps when it replicates at night which is rather good considering the backup FreeNAS install has none of the fancy specs of the main unit).
The problem is the main production unit for which I have given the specs above. Disk response time is atrocious when we do anything that involves copying data to or from the LUN. So moving a server on or off bogs its down, replicating at the host level (as opposed to FreeNAS replication which as described above is fine), host level backups, hyper-v snapshots and merges etc. Response times climb to 15 for even a few hundred milliseconds for the disk where as for optimum performance everything should be under 10.
Is there any suggestions for what I should be looking for or tuning to improve performance?