Bjarke Emborg Kragelund
Dabbler
- Joined
- Jun 25, 2013
- Messages
- 41
We have built a NAS with the following HW :
Dell PE R715
2 X 8 cores AMD 3.2 GHz
256 GB Memory
2 X 10 Gb ( Storage head )
LSI 9207
SAS-2 JBOD with 24 slots.
One ZFS Pool consisting of 5 mirrored vdevs ( Seagate 10.5K Savvio 600 GB ) + 4 Striped 200 GB MLC ( L2ARC ) + 2 mirrored 100 GB ZIL / Log. All with SAS-2 interface.
We have been trying OpenIndiana ( with napp-it ) and Nexenta, which were pretty similar in performance, but they come with a pricetag, and we just want to "play" with the storage for the moment.
As I have been using FreeNAS since 0.7 - and am pretty fond of it, I would like to take it for a spin on the above HW. ( FreeNAS installed on a internal SD module )
We installed 9.1 ( one of the earliest Alpha's ), and we usually upgrade to the newest nightly build.
We use the NAS as a secondary storage for our vSphere - so we only configure and use it for NFS connectivity.
On the Nexenta we saw hot / accelerated data hit 480K OPS Read & 350K OPS Write and with maximum 20 ms latency ( usually < 5 ms ) over the total period of 30 days - even with a lot of activity.
On the FreeNAS 9.1 we are seeing maximum 16K OPS and our latency peaks at > 35K ms :-(
A little less than expected - and on the same HW :-(
So what could I miss ?
I have tried the following :
- Rebuilt the ZFS pool a number of times on BSD.
- Enabled / disabled autotune.
I suspect a bad behavior on some driver / HW related issue, as the only difference is the OS.
All the HW are updated to the lasted FW - including the spindels and SSDs.
Any hints as to where I should go look for holy grail ?
Brgds.
Jugger
Dell PE R715
2 X 8 cores AMD 3.2 GHz
256 GB Memory
2 X 10 Gb ( Storage head )
LSI 9207
SAS-2 JBOD with 24 slots.
One ZFS Pool consisting of 5 mirrored vdevs ( Seagate 10.5K Savvio 600 GB ) + 4 Striped 200 GB MLC ( L2ARC ) + 2 mirrored 100 GB ZIL / Log. All with SAS-2 interface.
We have been trying OpenIndiana ( with napp-it ) and Nexenta, which were pretty similar in performance, but they come with a pricetag, and we just want to "play" with the storage for the moment.
As I have been using FreeNAS since 0.7 - and am pretty fond of it, I would like to take it for a spin on the above HW. ( FreeNAS installed on a internal SD module )
We installed 9.1 ( one of the earliest Alpha's ), and we usually upgrade to the newest nightly build.
We use the NAS as a secondary storage for our vSphere - so we only configure and use it for NFS connectivity.
On the Nexenta we saw hot / accelerated data hit 480K OPS Read & 350K OPS Write and with maximum 20 ms latency ( usually < 5 ms ) over the total period of 30 days - even with a lot of activity.
On the FreeNAS 9.1 we are seeing maximum 16K OPS and our latency peaks at > 35K ms :-(
A little less than expected - and on the same HW :-(
So what could I miss ?
I have tried the following :
- Rebuilt the ZFS pool a number of times on BSD.
- Enabled / disabled autotune.
I suspect a bad behavior on some driver / HW related issue, as the only difference is the OS.
All the HW are updated to the lasted FW - including the spindels and SSDs.
Any hints as to where I should go look for holy grail ?
Brgds.
Jugger