Hi, guys,
I'm messing with FreeNAS 9.10.2 U3 for quite a while so far and I still have 1 unresolvable issue.
I have a Dell PE R720xd.
24x 300GB SAS drives.
1x Intel P3605 1.6TB AiC
2x Intel X520-SR2 (10Gbit)
Dell N4032F switch with LACP support
E5-2640 0 x 2
256GB RAM
LSI 9207-8i HBA
I have a stripped mirror setup. 11 mirrors, totaling 2.9TB, 2x spare drives and the whole SSD dedicated to ZIL.
Here's my issue. Always, no matter how I test, my reads are slower than writes.
Autotune is enabled in FreeNAS.
For example reading the 40-50GB file is averaging at 300 MByte/s, while the same file written is averaging at 800-850 Mbyte/s.
Theoretically my 11 mirror stripe throughput should be around 11x150 Mbyte/s (single drive perf), but I'm not getting even close to that number.
My network is aggregated, 4 uplinks right now (so that I'd not blame network) LACP configured.
On a test PC I have a Dell desktop with Samsung 960 Evo with AiC as a test storage and a single X520-SR2 with both NICs teamed via LACP.
Aggregation is properly configured on the switch side.
Jumbo frames have been tested as well. Not a big change.
Dedup is off, compression is enabled.
iSCSI.
Weird thing, when that aforementioned 40GB file is read the activity LED is hardly flashing, I'd say once in 10 seconds or so, while when writing the same file - pool's all active HDDs show LED activity.
Please share some thoughts as I'm out of ideas.
Thank you!
I'm messing with FreeNAS 9.10.2 U3 for quite a while so far and I still have 1 unresolvable issue.
I have a Dell PE R720xd.
24x 300GB SAS drives.
1x Intel P3605 1.6TB AiC
2x Intel X520-SR2 (10Gbit)
Dell N4032F switch with LACP support
E5-2640 0 x 2
256GB RAM
LSI 9207-8i HBA
I have a stripped mirror setup. 11 mirrors, totaling 2.9TB, 2x spare drives and the whole SSD dedicated to ZIL.
Here's my issue. Always, no matter how I test, my reads are slower than writes.
Autotune is enabled in FreeNAS.
For example reading the 40-50GB file is averaging at 300 MByte/s, while the same file written is averaging at 800-850 Mbyte/s.
Theoretically my 11 mirror stripe throughput should be around 11x150 Mbyte/s (single drive perf), but I'm not getting even close to that number.
My network is aggregated, 4 uplinks right now (so that I'd not blame network) LACP configured.
On a test PC I have a Dell desktop with Samsung 960 Evo with AiC as a test storage and a single X520-SR2 with both NICs teamed via LACP.
Aggregation is properly configured on the switch side.
Jumbo frames have been tested as well. Not a big change.
Dedup is off, compression is enabled.
iSCSI.
Weird thing, when that aforementioned 40GB file is read the activity LED is hardly flashing, I'd say once in 10 seconds or so, while when writing the same file - pool's all active HDDs show LED activity.
Please share some thoughts as I'm out of ideas.
Thank you!