Very Low ZFS performance

Status
Not open for further replies.
D

dyzhang

Dabbler
Joined
Sep 26, 2011
Messages
20
My config is as signature. My ZFS performance is very low as ~50M/s while raid5 in freenas7 is ~100M/s

Detais benchmark is as follow, client is using 2*OCZ vertex3 raid 0 (1000M/s).
 
D

dyzhang

Dabbler
Joined
Sep 26, 2011
Messages
20
[root@freenas] ~# zpool iostat 1
capacity operations bandwidth
pool used avail read write read write
---------- ----- ----- ----- ----- ----- -----
vol1 1.09T 4.35T 4 8 523K 730K
vol1 1.09T 4.35T 0 1.84K 0 233M
vol1 1.09T 4.35T 0 1.80K 0 228M
vol1 1.09T 4.35T 0 1.27K 0 149M
vol1 1.09T 4.35T 0 338 0 42.3M
vol1 1.09T 4.35T 0 340 0 42.6M
vol1 1.09T 4.35T 0 337 0 42.1M
vol1 1.09T 4.35T 0 338 0 42.3M
vol1 1.09T 4.35T 0 342 0 42.8M
vol1 1.09T 4.35T 0 335 0 42.0M
vol1 1.09T 4.35T 0 342 0 42.8M
vol1 1.09T 4.35T 0 333 0 41.7M
vol1 1.09T 4.35T 0 331 0 41.5M
vol1 1.09T 4.35T 0 349 0 43.7M
vol1 1.09T 4.34T 0 332 0 41.6M
vol1 1.09T 4.34T 0 333 0 41.6M
vol1 1.09T 4.34T 0 345 0 43.2M
vol1 1.09T 4.34T 0 415 0 51.9M
vol1 1.09T 4.34T 0 316 0 38.8M
vol1 1.09T 4.34T 0 93 0 11.2M
vol1 1.09T 4.34T 0 1.56K 0 197M
vol1 1.09T 4.34T 0 1.69K 0 214M
vol1 1.09T 4.34T 0 1.02K 0 116M
vol1 1.09T 4.34T 0 0 0 0
vol1 1.09T 4.34T 0 0 0 0
vol1 1.09T 4.34T 0 0 0 0
vol1 1.09T 4.34T 0 31 0 3.99M
vol1 1.09T 4.34T 0 63 0 7.98M
vol1 1.09T 4.34T 0 868 0 108M
vol1 1.09T 4.34T 0 1.70K 0 215M
vol1 1.09T 4.34T 0 1.63K 0 206M
vol1 1.09T 4.34T 59 498 7.49M 49.2M
vol1 1.09T 4.34T 0 0 0 0
vol1 1.09T 4.34T 0 0 0 0
vol1 1.09T 4.34T 0 0 0 0
vol1 1.09T 4.34T 0 0 0 0
vol1 1.09T 4.34T 0 2 0 383K
vol1 1.09T 4.34T 0 30 0 3.86M
vol1 1.09T 4.34T 0 664 0 82.4M
vol1 1.09T 4.34T 0 1.61K 0 203M
vol1 1.09T 4.34T 0 1.59K 0 201M
vol1 1.10T 4.34T 0 951 0 101M
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 83 0 10.2M
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 890 0 110M
vol1 1.10T 4.34T 0 1.92K 0 239M
vol1 1.10T 4.34T 0 1.93K 0 244M
vol1 1.10T 4.34T 0 1.24K 0 147M
vol1 1.10T 4.34T 0 338 0 42.3M
vol1 1.10T 4.34T 0 338 128K 42.3M
vol1 1.10T 4.34T 0 341 0 42.7M
vol1 1.10T 4.34T 0 336 0 42.0M
vol1 1.10T 4.34T 0 338 0 42.3M
vol1 1.10T 4.34T 0 339 0 42.5M
vol1 1.10T 4.34T 20 332 2.62M 41.5M
vol1 1.10T 4.34T 216 336 27.1M 42.0M
vol1 1.10T 4.34T 0 335 0 42.0M
vol1 1.10T 4.34T 0 338 0 42.3M
vol1 1.10T 4.34T 0 340 0 42.5M
vol1 1.10T 4.34T 0 324 0 40.5M
vol1 1.10T 4.34T 0 342 0 42.8M
vol1 1.10T 4.34T 0 342 0 42.8M
vol1 1.10T 4.34T 0 333 0 41.7M
vol1 1.10T 4.34T 0 331 0 41.4M
vol1 1.10T 4.34T 12 335 1.62M 41.9M
vol1 1.10T 4.34T 0 330 0 41.3M
vol1 1.10T 4.34T 0 330 0 41.3M
vol1 1.10T 4.34T 0 360 0 45.0M
vol1 1.10T 4.34T 0 418 0 52.2M
vol1 1.10T 4.34T 0 49 0 6.24M
vol1 1.10T 4.34T 0 470 0 58.0M
vol1 1.10T 4.34T 0 1.52K 0 192M
vol1 1.10T 4.34T 0 1.50K 0 189M
vol1 1.10T 4.34T 0 1.26K 0 148M
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 7 0 782K
vol1 1.10T 4.34T 0 212 0 26.2M
vol1 1.10T 4.34T 0 1.13K 0 142M
vol1 1.10T 4.34T 0 1.63K 0 206M
vol1 1.10T 4.34T 0 1.64K 0 206M
vol1 1.10T 4.34T 0 288 0 22.5M
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 45 0 5.73M
vol1 1.10T 4.34T 0 113 0 14.0M
vol1 1.10T 4.34T 0 1.59K 0 201M
vol1 1.10T 4.34T 0 1.69K 0 213M
vol1 1.10T 4.34T 0 1.44K 0 170M
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 84 0 10.6M
vol1 1.10T 4.34T 0 381 0 47.0M
vol1 1.10T 4.34T 28 1.90K 3.60M 241M
vol1 1.10T 4.34T 0 1.97K 0 249M
vol1 1.10T 4.34T 25 1.47K 3.24M 175M
vol1 1.10T 4.34T 0 339 0 42.4M
vol1 1.10T 4.34T 0 337 0 42.2M
vol1 1.10T 4.34T 0 341 0 42.7M
vol1 1.10T 4.34T 0 338 0 42.3M
vol1 1.10T 4.34T 0 334 0 41.8M
vol1 1.10T 4.34T 0 337 0 42.2M
vol1 1.10T 4.34T 0 339 0 42.5M
vol1 1.10T 4.34T 0 337 0 42.2M
vol1 1.10T 4.34T 0 331 0 41.4M
vol1 1.10T 4.34T 0 334 0 41.8M
vol1 1.10T 4.34T 0 330 0 41.3M
vol1 1.10T 4.34T 0 333 0 41.6M
vol1 1.10T 4.34T 0 331 0 41.4M
vol1 1.10T 4.34T 0 334 0 41.8M
vol1 1.10T 4.34T 0 337 0 42.2M
vol1 1.10T 4.34T 0 335 0 41.9M
vol1 1.10T 4.34T 0 338 0 42.3M
vol1 1.10T 4.34T 0 748 0 92.6M
vol1 1.10T 4.34T 0 305 0 37.7M
vol1 1.10T 4.34T 0 674 0 83.6M
vol1 1.10T 4.34T 0 1.58K 0 200M
vol1 1.10T 4.34T 0 1.71K 0 215M
vol1 1.10T 4.34T 0 317 0 26.4M
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 234 0 29.3M 0
vol1 1.10T 4.34T 0 33 0 4.25M
vol1 1.10T 4.34T 0 1.53K 3.99K 195M
vol1 1.10T 4.34T 0 1.58K 0 199M
vol1 1.10T 4.34T 0 1.55K 0 192M
vol1 1.10T 4.34T 0 486 0 46.2M
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 215 0 27.0M
vol1 1.10T 4.34T 0 94 0 11.9M
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 0 0 0
vol1 1.10T 4.34T 0 31 0 3.99M
vol1 1.10T 4.34T 19 323 2.50M 26.2M
 
D

dyzhang

Dabbler
Joined
Sep 26, 2011
Messages
20
[root@freenas] ~# zpool iostat 1
capacity operations bandwidth
pool used avail read write read write
---------- ----- ----- ----- ----- ----- -----
vol1 1.10T 4.34T 4 8 525K 813K
vol1 1.10T 4.34T 452 0 56.1M 0
vol1 1.10T 4.34T 423 0 52.5M 0
vol1 1.10T 4.34T 454 0 56.3M 128K
vol1 1.10T 4.34T 421 0 52.4M 0
vol1 1.10T 4.34T 580 0 72.1M 0
vol1 1.10T 4.34T 398 0 49.4M 0
vol1 1.10T 4.34T 646 0 80.2M 0
vol1 1.10T 4.34T 385 0 47.8M 0
vol1 1.09T 4.35T 269 237 33.4M 10.1M
vol1 1.09T 4.35T 500 0 62.2M 0
vol1 1.09T 4.35T 515 0 64.0M 0
vol1 1.09T 4.35T 477 0 59.2M 0
vol1 1.09T 4.35T 532 0 66.2M 0
vol1 1.09T 4.35T 343 0 42.6M 0
vol1 1.09T 4.35T 617 0 76.6M 0
vol1 1.09T 4.35T 329 0 40.9M 0
vol1 1.09T 4.35T 546 0 67.8M 0
vol1 1.09T 4.35T 408 0 50.7M 0
vol1 1.09T 4.35T 466 0 58.0M 0
vol1 1.09T 4.35T 453 0 56.2M 0
vol1 1.09T 4.35T 588 0 73.1M 0
vol1 1.09T 4.35T 527 0 65.3M 0
vol1 1.09T 4.35T 440 0 54.7M 0
vol1 1.09T 4.35T 617 0 76.6M 0
vol1 1.09T 4.35T 258 0 32.1M 0
vol1 1.09T 4.35T 617 0 76.6M 0
vol1 1.09T 4.35T 453 0 56.3M 0
vol1 1.09T 4.35T 421 0 52.4M 0
vol1 1.09T 4.35T 611 0 75.8M 0
vol1 1.09T 4.35T 524 0 65.0M 0
vol1 1.09T 4.35T 617 0 76.6M 0
vol1 1.09T 4.35T 381 0 47.3M 0
vol1 1.09T 4.35T 494 0 61.3M 0
vol1 1.09T 4.35T 453 0 56.3M 0
vol1 1.09T 4.35T 422 0 52.4M 0
vol1 1.09T 4.35T 453 0 56.3M 0
vol1 1.09T 4.35T 554 0 68.9M 0
vol1 1.09T 4.35T 367 0 45.6M 0
vol1 1.09T 4.35T 529 0 65.7M 0
vol1 1.09T 4.35T 553 0 68.7M 0
vol1 1.09T 4.35T 475 0 58.9M 0
vol1 1.09T 4.35T 555 0 69.0M 0
vol1 1.09T 4.35T 319 0 39.6M 0
vol1 1.09T 4.35T 618 0 76.7M 0
vol1 1.09T 4.35T 258 0 32.1M 0
vol1 1.09T 4.35T 616 0 76.6M 0
vol1 1.09T 4.35T 458 0 56.9M 0
 
D

dyzhang

Dabbler
Joined
Sep 26, 2011
Messages
20
[root@freenas] ~# zpool status
pool: vol1
state: ONLINE
scrub: none requested
config:

NAME STATE READ WRITE CKSUM
vol1 ONLINE 0 0 0
raidz1 ONLINE 0 0 0
gptid/801ff3da-e77a-11e0-a718-00e04c1fe34f ONLINE 0 0 0
gptid/80c9a39c-e77a-11e0-a718-00e04c1fe34f ONLINE 0 0 0
gptid/815fe062-e77a-11e0-a718-00e04c1fe34f ONLINE 0 0 0
logs
mirror ONLINE 0 0 0
gptid/81cccf3e-e77a-11e0-a718-00e04c1fe34f ONLINE 0 0 0
gptid/8221b7ff-e77a-11e0-a718-00e04c1fe34f ONLINE 0 0 0
cache
gptid/818895a7-e77a-11e0-a718-00e04c1fe34f ONLINE 0 0 0

errors: No known data errors
 
Status
Not open for further replies.

Important Announcement for the TrueNAS Community.

The TrueNAS Community has now been moved. This forum will now become READ-ONLY for historical purposes. Please feel free to join us on the new TrueNAS Community Forums.

Related topics on forums.truenas.com for thread: "Very Low ZFS performance"

Similar threads

E
  • Locked
Upgraded drives and 4K performance took a dump?
Replies
2
Views
967
eroji
E
scurrier
Why would prefetch efficiency be so low during an SMB large file transfer?
Replies
4
Views
1K
MikeyG
MikeyG
J
  • Locked
Zil performance
Replies
1
Views
1K
cyberjock
C
Eds89
  • Locked
SLOG not changing disk performance of volume during testing
2 3
Replies
42
Views
9K
kdragon75
kdragon75
E
  • Locked
Missing performance on sequential read operations and sync writes
Replies
3
Views
2K
Eagleman
E
Top