Greetings,
About 5 years ago I got to build my dream FreeNAS system and its been wonderful. After the initial churn its run well with little interaction required. I've used FreeNAS for other things including virtualization storage and storage virtualization, but my main NAS has been simple and effective. Recently I've been having some performance issues and I'm hoping for some feedback in troubleshooting.
Thanks for any feedback.
Some notes:
-In hindsight I know the pool should have been 4 vdevs mirrored, but raidz3 is what I've got
-MEM is 32GB ECC unbuffered and effectively maxed
-Disk upgrade about 3 years ago where each 6TB drive was replaced with a 10 TB drive. The pool remained intact.
-System was recently upgraded from 11.3 to 13
-System is using legacy geli encryption
-Some deduplication on one dataset used for desktop image backups
-iperf tests show reasoable thoughput (~600Mbps)
-disk write speeds < 1M during performance impact (I suspect this might improve after rebooting, any ideas what could cause a temporary slowdown that was cleared by a reboot?)
-have an nvme drive to use as zil/slog and L2ARC, but wanted to see if there was anything I should check before adding that in
About 5 years ago I got to build my dream FreeNAS system and its been wonderful. After the initial churn its run well with little interaction required. I've used FreeNAS for other things including virtualization storage and storage virtualization, but my main NAS has been simple and effective. Recently I've been having some performance issues and I'm hoping for some feedback in troubleshooting.
Thanks for any feedback.
Some notes:
-In hindsight I know the pool should have been 4 vdevs mirrored, but raidz3 is what I've got
-MEM is 32GB ECC unbuffered and effectively maxed
-Disk upgrade about 3 years ago where each 6TB drive was replaced with a 10 TB drive. The pool remained intact.
-System was recently upgraded from 11.3 to 13
-System is using legacy geli encryption
-Some deduplication on one dataset used for desktop image backups
-iperf tests show reasoable thoughput (~600Mbps)
-disk write speeds < 1M during performance impact (I suspect this might improve after rebooting, any ideas what could cause a temporary slowdown that was cleared by a reboot?)
-have an nvme drive to use as zil/slog and L2ARC, but wanted to see if there was anything I should check before adding that in
Code:
# zpool iostat -v tank capacity operations bandwidth pool alloc free read write read write -------------------------------------------------- ----- ----- ----- ----- ----- ----- tank 40.0T 32.5T 852 356 152M 5.26M raidz3-0 40.0T 32.5T 852 356 152M 5.26M gptid/1a578bfe-fdc3-11e9-a688-001b21cda10c.eli - - 115 46 19.1M 689K gptid/381b2e6f-fcd5-11e9-a688-001b21cda10c.eli - - 108 45 18.9M 674K gptid/51925046-fbdb-11e9-b117-001b21cda10c.eli - - 101 44 18.9M 666K gptid/9e20beb7-fabb-11e9-8673-001b21cda10c.eli - - 125 42 19.2M 662K gptid/a1feedb9-f9c8-11e9-820f-001b21cda10c.eli - - 93 46 19.1M 689K gptid/16fa399d-f8cb-11e9-820f-001b21cda10c.eli - - 93 45 18.9M 676K gptid/303846be-f7b1-11e9-a2c5-001b21cda10c.eli - - 102 44 18.9M 667K gptid/5e2ebacd-f6a6-11e9-9cee-001b21cda10c.eli - - 112 42 19.3M 664K -------------------------------------------------- ----- ----- ----- ----- ----- ----- # zpool list NAME SIZE ALLOC FREE CKPOINT EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT freenas-boot 14.9G 9.47G 5.41G - - - 63% 1.00x ONLINE - tank 72.5T 40.0T 32.5T - - 29% 55% 1.65x ONLINE /mnt Iperf results: [ 5] 0.00-10.01 sec 764 MBytes 641 Mbits/sec receiver
Motherboard make and model:
ASROCK RACK E3C224D4I-14S
CPU make and model:
Intel(R) Xeon(R) CPU E3-1230L v3 @ 1.80GHz
RAM quantity:
32GB ECC
hw.physmem: 34263973888
hw.usermem: 3492909056
hw.realmem: 34359738368
Hard drives, quantity, model numbers, and RAID configuration, including boot drives:
Pool in question:
Raidz3
8 x 10 TB Western digital
Mediasize: 10000831348736 (9.1T)
descr: ATA WDC WD100EMAZ-00
Boot drives 2 x 16 GB Sandisk USB
Hard disk controllers:
LSI 2308
Network cards:
Intel® Ethernet Controller I210-AT
Intel® Ethernet Converged Network Adapter X520-DA2
ASROCK RACK E3C224D4I-14S
CPU make and model:
Intel(R) Xeon(R) CPU E3-1230L v3 @ 1.80GHz
RAM quantity:
32GB ECC
hw.physmem: 34263973888
hw.usermem: 3492909056
hw.realmem: 34359738368
Hard drives, quantity, model numbers, and RAID configuration, including boot drives:
Pool in question:
Raidz3
8 x 10 TB Western digital
Mediasize: 10000831348736 (9.1T)
descr: ATA WDC WD100EMAZ-00
Boot drives 2 x 16 GB Sandisk USB
Hard disk controllers:
LSI 2308
Network cards:
Intel® Ethernet Controller I210-AT
Intel® Ethernet Converged Network Adapter X520-DA2