zpool iostat -vly numbers don't beat

volff

Dabbler
Joined
Jul 21, 2022
Messages
10
Hello all !
Please help me figure out the counters zpool iostat -vly .
OS Version:TrueNAS 13 CORE U3
Product:ProLiant XL420 Gen9 (HP Apollo 4200 Gen9)
Model:Intel(R) Xeon(R) CPU E5-2643 v3 @ 3.40GHz
Memory: 1 TiB
disk:
pool 1: 8x3.84Tb SATA Intel,Toshoba, raid-z2
Controller HBA: LSI 9300-i16, FW 16.0.12.0 (Recommended iX)

zpool iostat -vly - shows counter data that does conflict with data from other measuring programs.

Before measuring, I turned off the cache:
zfs set primarycache=none SSD-Pool-0
Mode - synchronous
Compression - off
1670585445151.png

Here you can see that the cache is empty:
1670584978900.png

Ran a sequential read test locally on the server:
1670350983854-jpeg.60644

Ran zpool iostat -vly .
I read the numbers and they don't beat. Please explain or provide material to explain:
Why is bandwidth so low with IOPs equal to IOPs fio.
How are these numbers calculated?
10,5k(iops)*128k(bs)=1 344Mib
zpool iostat shows 209Mib
1670351512067-png.60647


Processor not loaded:
1670585736521.png



Server after reboot, cache 100% empty.
After starting FIO, FIO shows a read speed of 1300Mb/s.
iostat shows hard drive load ~ 17Mb/s
Can you please explain how these numbers are correlated? Is he reading from the air?
1670586922487.png
 

Attachments

  • 1670585487299.png
    1670585487299.png
    16.2 KB · Views: 78
  • 1670586602378.png
    1670586602378.png
    17.3 KB · Views: 75
Top