IOZone performance test results off?

[Evan Richardson]

I want to try and get a good benchmark of my filesystem to see what my max througput is. After reading this post, I gave IOZONE a try, but first, it took almost a day to run, and second, the results seem way off:

I ran the following command:

Code:

 iozone -i 0 -i 1 -i 2 -s 256G -r 1m -R -f /mnt/sirius/media/testfile -b /mnt/sirius/homes/iozone-SIRIUS-local-size-256g-2.xls

My system is a 24 Drive, RaidZ2 config, made up of 5400rm 8TB drives. I have 128GB of ram, so based on the post, i used a file size of 256GB to rule out memory. If I'm reading the results right, I'm getting somewhere in the vacinity of 10GB/sec throughput? That seems impossible, given that if you take the average drive write speed, say 150MB/s, x 16 drives (24-8 parity drives, is only 2.4GB/sec, so how am I able to get ~10+GB/sec throughput?

I've started a new test, with 1 file size, and already it looks way off, 2GB/sec?

Code:

iozone -i 0 -i 1 -i 2 -s 256G -r 1m -R -f /mnt/sirius/media/testfile2.dat -b /mnt/sirius/homes/iozone-SIRIUS-local-size-256g-2.xls
        Iozone: Performance Test of File I/O
                Version $Revision: 3.487 $
                Compiled for 64 bit mode.
                Build: freebsd

        Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins
                     Al Slater, Scott Rhine, Mike Wisner, Ken Goss
                     Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR,
                     Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner,
                     Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone,
                     Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root,
                     Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer,
                     Vangel Bojaxhi, Ben England, Vikentsi Lapa,
                     Alexey Skidanov, Sudhir Kumar.

        Run began: Mon Feb 28 22:54:35 2022

        File size set to 268435456 kB
        Record Size 1024 kB
        Excel chart generation enabled
        Command line used: iozone -i 0 -i 1 -i 2 -s 256G -r 1m -R -f /mnt/sirius/media/testfile2.dat -b /mnt/sirius/homes/iozone-SIRIUS-local-size-256g-2.xls
        Output is in kBytes/sec
        Time Resolution = 0.000001 seconds.
        Processor cache size set to 1024 kBytes.
        Processor cache line size set to 32 bytes.
        File stride size set to 17 * record size.
                                                              random    random     bkwd    record    stride
              kB  reclen    write  rewrite    read    reread    read     write     read   rewrite      read   fwrite frewrite    fread  freread
       268435456    1024  2183045  2568102

whats going on here?

Edit, after reading this post, seems i needed to add some flags to prevent compressible data. now my Zpool status shows ~1.8+ GB/sec write speeds