phillipsnick
Cadet
- Joined
- Aug 18, 2016
- Messages
- 5
I've been losing my mind over this problem for a few days now, although I've had the problem for a while now. I'm throwing the towel in and reaching out to see if anyone else has had similar issues.
I'm basing a lot of my expectations here on the white paper https://static.ixsystems.co/uploads/2020/09/ZFS_Storage_Pool_Layout_White_Paper_2020_WEB.pdf (along with some previous experiences using ZFS).
So down to the problem, I've got a play server for learning:
Hardware
The main problem, when running the 8 drives in RAID-Z2 each drive will only read at 50MB/s (monitored with zpool iostat) and the overall performance measured with fio is between 400-470MiB/s. Somewhat disappointing!
Based on my testing, a single Hitachi 5K3000 drive is good for 110MiB/s. I've also set up each of these as individual drives in TrueNAS and tested them all simultaneously and managed to hit this number for all 8 drives at the same time.
The test
Now I'm only testing sequential reads here because it's the quickest/easiest way to replicate this exact issue. Although it also appears when fio layers the file on the disk, I see maximum 50MB/s writes too.
The Dell H310 Mini has been flashed using fourlynx's method using 9211-8i_Package_P20_IR_IT_FW_BIOS_for_MSDOS_Windows.zip which I believe is still the latest version available for this card.
-----
Now if we take the bootable USB out of the R720 including the 8 drives and move them over to the following setup
Has anyone else had similar issues with the H310 Mini installed in the Dell R720?
I'm basing a lot of my expectations here on the white paper https://static.ixsystems.co/uploads/2020/09/ZFS_Storage_Pool_Layout_White_Paper_2020_WEB.pdf (along with some previous experiences using ZFS).
So down to the problem, I've got a play server for learning:
Hardware
- Dell R720
- Dual Xeon E5 2660
- 4x Kingston 16 GB DDR3 ECC 1600Mhz
- 8x HGST 5K3000 - 3TB / 5400rpm
- H310 Mini (model K09CJ) flashed to IT mode
- TrueNAS-12.0U2.1
- RAID-Z2
- ashift=12
The main problem, when running the 8 drives in RAID-Z2 each drive will only read at 50MB/s (monitored with zpool iostat) and the overall performance measured with fio is between 400-470MiB/s. Somewhat disappointing!
Based on my testing, a single Hitachi 5K3000 drive is good for 110MiB/s. I've also set up each of these as individual drives in TrueNAS and tested them all simultaneously and managed to hit this number for all 8 drives at the same time.
The test
Code:
fio \ --name=test \ --filename=test64g \ --bs=1m \ --iodepth=1 \ --size=64G \ --readwrite=read \ --ramp_time=4 \ --group_reporting
Now I'm only testing sequential reads here because it's the quickest/easiest way to replicate this exact issue. Although it also appears when fio layers the file on the disk, I see maximum 50MB/s writes too.
The Dell H310 Mini has been flashed using fourlynx's method using 9211-8i_Package_P20_IR_IT_FW_BIOS_for_MSDOS_Windows.zip which I believe is still the latest version available for this card.
-----
Now if we take the bootable USB out of the R720 including the 8 drives and move them over to the following setup
- Supermicro X9DRL-F
- Xeon 1620v2
- 4x Kingston 8 GB DDR3 ECC 133Mhz
- 8x HGST 5K3000 - 3TB / 5400rpm
- M1015 flashed to IT mode (assuming R20 too)
Code:
READ: bw=590MiB/s (618MB/s), 590MiB/s-590MiB/s (618MB/s-618MB/s), io=62.9GiB (67.5GB), run=109177-109177msec
Has anyone else had similar issues with the H310 Mini installed in the Dell R720?
Last edited:
