we take P4510 8TB ,6 device ;into one pool with Stripe;but we do the fio test,find the iops is not good,i think it's iops should be 6 times over one device; the fio result is following ;the iops result seems like one disk ‘s iops? help!
OUR PC:
CPU:Intel(R) Xeon(R) CPU E5-2697 v3 @ 2.60GHz *2
MEM:256GB
#Command:fio -direct=1 -iodepth=128 -rw=randwrite -ioengine=libaio -bs=4k -size=1G -numjobs=1 -runtime=1000 -group_reporting -filename=test -name=Rand_Write_Testing
Rand_Write_Testing: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128
fio-3.25
Starting 1 process
Rand_Write_Testing: Laying out IO file (1 file / 1024MiB)
Jobs: 1 (f=1): [w(1)][-.-%][w=386MiB/s][w=98.9k IOPS][eta 00m:00s]
Rand_Write_Testing: (groupid=0, jobs=1): err= 0: pid=1625668: Wed Jun 29 14:09:12 2022
write: IOPS=84.1k, BW=329MiB/s (345MB/s)(1024MiB/3116msec); 0 zone resets
slat (usec): min=3, max=6637, avg=10.50, stdev=26.50
clat (usec): min=2, max=18978, avg=1508.79, stdev=1573.31
lat (usec): min=10, max=19050, avg=1519.40, stdev=1584.99
clat percentiles (usec):
| 1.00th=[ 717], 5.00th=[ 750], 10.00th=[ 783], 20.00th=[ 807],
| 30.00th=[ 832], 40.00th=[ 857], 50.00th=[ 881], 60.00th=[ 930],
| 70.00th=[ 1106], 80.00th=[ 1745], 90.00th=[ 3163], 95.00th=[ 4621],
| 99.00th=[ 9896], 99.50th=[10683], 99.90th=[12387], 99.95th=[15139],
| 99.99th=[18220]
bw ( KiB/s): min=70440, max=485648, per=99.95%, avg=336329.33, stdev=142919.33, samples=6
iops : min=17610, max=121412, avg=84082.33, stdev=35729.83, samples=6
lat (usec) : 4=0.01%, 20=0.01%, 50=0.01%, 100=0.01%, 250=0.01%
lat (usec) : 500=0.02%, 750=5.13%, 1000=60.21%
lat (msec) : 2=16.72%, 4=10.68%, 10=6.28%, 20=0.95%
cpu : usr=14.06%, sys=81.89%, ctx=240, majf=0, minf=179
IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=100.0%
submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1%
issued rwts: total=0,262144,0,0 short=0,0,0,0 dropped=0,0,0,0
latency : target=0, window=0, percentile=100.00%, depth=128
Run status group 0 (all jobs):
WRITE: bw=329MiB/s (345MB/s), 329MiB/s-329MiB/s (345MB/s-345MB/s), io=1024MiB (1074MB), run=3116-3116msec