I rebuilt my NAS recently to upgrade the storage array to all SSDs and before I put it into service wanted to do some testing of 12.0-Beta2. I first installed 11.3-U3.2, exposed an iSCSI share and mounted that in an Ubuntu VM hosted on another machine to run some fio tests. I then upgraded to 12.0-Beta2, upgraded the pool, and then re-ran the same tests. The NAS and VM Host are both connected on a 10Gbps network. Sync writes were set to Always.
Test 1 - Test write throughput by performing sequential writes with multiple parallel streams (16+), using an I/O block size of 1 MB and an I/O depth of at least 64
Test 2 - Test write IOPS by performing sequential writes, using an I/O block size of 4 KB and an I/O depth of at least 256
Test 3 - Test read throughput by performing sequential reads with multiple parallel streams (16+), using an I/O block size of 1 MB and an I/O depth of at least 64
Test 4 - Test read IOPS, using an I/O block size of 4 KB and an I/O depth of at least 256
11.3-U3.2
Test 1: 738 MB/s
Test 2: 89 MB/s, 22844 iops avg
Test 3: 290 MB/s
Test 4: 69 MB/s, 16931 iops avg
12.0-Beta2
Test 1: 429 MB/s
Test 2: 50 MB/s, 12232 iops avg
Test 3: 394 MB/s
Test 4: 116 MB/s, 28326 iops avg
Hardware: Supermicro X10SDV-TLN4F, Xeon D-1541, 64GB ECC DDR4, LSI 9207-8i HBA
Data drives: 8x 1TB SATA SSDs (4 Crucial MX500, 3 Samsung EVO 860, 1 Samsung EVO 850), in 4 mirrored vdevs (1 crucial + 1 samsung each).
SLog drive: 100GB Intel Optane 4801X U.2 NVME SSD
Metadata drives: 2x 400GB Intel S3710 SATA SSD (Not used in the test results above)
While I'm happy to see the uptick in read speeds I'm curious if anyone could explain the drop in writes or if anyone else has experienced anything similar.
Test 1 - Test write throughput by performing sequential writes with multiple parallel streams (16+), using an I/O block size of 1 MB and an I/O depth of at least 64
Test 2 - Test write IOPS by performing sequential writes, using an I/O block size of 4 KB and an I/O depth of at least 256
Test 3 - Test read throughput by performing sequential reads with multiple parallel streams (16+), using an I/O block size of 1 MB and an I/O depth of at least 64
Test 4 - Test read IOPS, using an I/O block size of 4 KB and an I/O depth of at least 256
11.3-U3.2
Test 1: 738 MB/s
Test 2: 89 MB/s, 22844 iops avg
Test 3: 290 MB/s
Test 4: 69 MB/s, 16931 iops avg
12.0-Beta2
Test 1: 429 MB/s
Test 2: 50 MB/s, 12232 iops avg
Test 3: 394 MB/s
Test 4: 116 MB/s, 28326 iops avg
Hardware: Supermicro X10SDV-TLN4F, Xeon D-1541, 64GB ECC DDR4, LSI 9207-8i HBA
Data drives: 8x 1TB SATA SSDs (4 Crucial MX500, 3 Samsung EVO 860, 1 Samsung EVO 850), in 4 mirrored vdevs (1 crucial + 1 samsung each).
SLog drive: 100GB Intel Optane 4801X U.2 NVME SSD
Metadata drives: 2x 400GB Intel S3710 SATA SSD (Not used in the test results above)
While I'm happy to see the uptick in read speeds I'm curious if anyone could explain the drop in writes or if anyone else has experienced anything similar.
