Hi to all.
I think to get best performance with my hardware, but it seems something slow all the system.
FreeNas Server Specs:
NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
zvol 10.9T 2.61T 8.26T - 12% 24% 1.00x ONLINE /mnt
raidz2 10.9T 2.61T 8.26T - 12% 24%
Some test with compression off:
dd if=/dev/zero of=zerocompoff.dat bs=1024k count=20k
20480+0 records in
20480+0 records out
21474836480 bytes transferred in 46.140274 secs (465424988 bytes/sec)
L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name
0 1147 0 0 0.0 1147 142867 1.8 97.1| da0
1 1044 0 0 0.0 1044 129394 2.0 97.1| da1
1 1057 0 0 0.0 1057 131195 2.0 97.5| da2
0 1068 0 0 0.0 1068 132222 1.9 97.2| da3
0 1151 0 0 0.0 1151 143163 1.8 97.4| da4
1 1049 0 0 0.0 1049 129917 2.0 97.3| da5
dd if=zerocompoff.dat of=/dev/null bs=1024k
20480+0 records in
20480+0 records out
21474836480 bytes transferred in 84.695996 secs (253551968 bytes/sec)
dd if=/dev/random of=randomcompoff.dat bs=1024k count=20k
20480+0 records in
20480+0 records out
21474836480 bytes transferred in 397.257573 secs (54057715 bytes/sec)
L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name
0 197 0 0 0.0 196 15701 0.6 22.1| da0
0 211 0 0 0.0 210 15836 0.5 20.0| da1
0 210 0 0 0.0 208 15802 0.6 25.9| da2
0 206 0 0 0.0 204 15795 0.7 27.2| da3
0 209 0 0 0.0 207 15798 0.5 19.7| da4
0 196 0 0 0.0 194 15682 0.6 25.1| da5
dd if=/dev/random of=randomcompoff.dat bs=4M count=10000
10000+0 records in
10000+0 records out
41943040000 bytes transferred in 773.239792 secs (54243251 bytes/sec)
Some test with compression on:
dd if=/dev/zero of=zero.dat bs=1024k count=10k
10240+0 records in
10240+0 records out
10737418240 bytes transferred in 12.880493 secs (833618566 bytes/sec)
dd if=zero.dat of=/dev/null bs=1024k
10240+0 records in
10240+0 records out
10737418240 bytes transferred in 2.798744 secs (3836513229 bytes/sec)
dd if=/dev/random of=random.dat bs=1024k count=10k
10240+0 records in
10240+0 records out
10737418240 bytes transferred in 196.514067 secs (54639438 bytes/sec)
The disk speed if I write from zero, without compression, is about 465MB/s with a gstat about 97% for all the disk, instead if I write from random is about 54MB/s and a gstat about 25% for all the disk. All the big value (over 500MB/s) are read from cache or are compressed zero so are not important.
Also resilver speed is slow --> scan: resilvered 791G in 7h37m (29,54 MB/s)
What do you think is the problem?
Thank you
I think to get best performance with my hardware, but it seems something slow all the system.
FreeNas Server Specs:
- Chassis: Dell PowerEdge C2100 Server
- Build: FreeNAS-9.10-STABLE-201604181743 (74ef270)
- CPUs: 2 x Intel(R) Xeon(R) CPU Westmere X5650 @2.67GHz, 6 core 12 thread, SSE 4.2, AES
- Memory: 49114MB
- HBA: pci-e cross-flashed lsi-2118it
- Storage Hard Disk(s): 6 - Wester Digital RED 2TB
- 5900RPM 64MB SATAIII (6Gb/s) 3.5"
- Volume: Composed of 2 RAIDZ2 w/6 Disks
NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT
zvol 10.9T 2.61T 8.26T - 12% 24% 1.00x ONLINE /mnt
raidz2 10.9T 2.61T 8.26T - 12% 24%
Some test with compression off:
dd if=/dev/zero of=zerocompoff.dat bs=1024k count=20k
20480+0 records in
20480+0 records out
21474836480 bytes transferred in 46.140274 secs (465424988 bytes/sec)
L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name
0 1147 0 0 0.0 1147 142867 1.8 97.1| da0
1 1044 0 0 0.0 1044 129394 2.0 97.1| da1
1 1057 0 0 0.0 1057 131195 2.0 97.5| da2
0 1068 0 0 0.0 1068 132222 1.9 97.2| da3
0 1151 0 0 0.0 1151 143163 1.8 97.4| da4
1 1049 0 0 0.0 1049 129917 2.0 97.3| da5
dd if=zerocompoff.dat of=/dev/null bs=1024k
20480+0 records in
20480+0 records out
21474836480 bytes transferred in 84.695996 secs (253551968 bytes/sec)
dd if=/dev/random of=randomcompoff.dat bs=1024k count=20k
20480+0 records in
20480+0 records out
21474836480 bytes transferred in 397.257573 secs (54057715 bytes/sec)
L(q) ops/s r/s kBps ms/r w/s kBps ms/w %busy Name
0 197 0 0 0.0 196 15701 0.6 22.1| da0
0 211 0 0 0.0 210 15836 0.5 20.0| da1
0 210 0 0 0.0 208 15802 0.6 25.9| da2
0 206 0 0 0.0 204 15795 0.7 27.2| da3
0 209 0 0 0.0 207 15798 0.5 19.7| da4
0 196 0 0 0.0 194 15682 0.6 25.1| da5
dd if=/dev/random of=randomcompoff.dat bs=4M count=10000
10000+0 records in
10000+0 records out
41943040000 bytes transferred in 773.239792 secs (54243251 bytes/sec)
Some test with compression on:
dd if=/dev/zero of=zero.dat bs=1024k count=10k
10240+0 records in
10240+0 records out
10737418240 bytes transferred in 12.880493 secs (833618566 bytes/sec)
dd if=zero.dat of=/dev/null bs=1024k
10240+0 records in
10240+0 records out
10737418240 bytes transferred in 2.798744 secs (3836513229 bytes/sec)
dd if=/dev/random of=random.dat bs=1024k count=10k
10240+0 records in
10240+0 records out
10737418240 bytes transferred in 196.514067 secs (54639438 bytes/sec)
The disk speed if I write from zero, without compression, is about 465MB/s with a gstat about 97% for all the disk, instead if I write from random is about 54MB/s and a gstat about 25% for all the disk. All the big value (over 500MB/s) are read from cache or are compressed zero so are not important.
Also resilver speed is slow --> scan: resilvered 791G in 7h37m (29,54 MB/s)
What do you think is the problem?
Thank you
Last edited: