Hello all, long time user, first time poster. We've been running FreeNAS on a production system successfully for many years We're currently running 11.1 and upgraded late last year. In the last couple of week's the GUI performance has tanked. I can log in and get the main page but some tabs time out completely or are terribly slow. For example I clicked on the 'Control Services' button about 10 minutes ago and its still trying to load. I've tried Chrome, Edge and IE with similar results. The CLI seems to work normally and the processor is bored. I tried restarting the Django and Nginx services but the result is the same. Our CIFS share seems to work fine and the VM's hosted through iSCSI also seem to be unaffected. Assuming the GUI is updating, I have the green 'Ok' light. I plan to do a full reboot at the next maintenance window but thought I would post here in case others have a better idea.
Here are some log outputs to help start off.
Here are some log outputs to help start off.
Code:
root@freenas:~ # zpool status pool: FifteenPlusSpare state: ONLINE scan: scrub repaired 0 in 1 days 04:11:43 with 0 errors on Mon Apr 9 16:11:58 2018 config: NAME STATE READ WRITE CKSUM FifteenPlusSpare ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 gptid/03847c41-e17e-11e6-b597-002590d303d5 ONLINE 0 0 0 gptid/1f0ff78e-3bc3-11e5-b32a-002590d303d5 ONLINE 0 0 0 gptid/8ea3a2b1-56b7-11e7-b597-002590d303d5 ONLINE 0 0 0 gptid/f23ed20a-3ad5-11e5-b32a-002590d303d5 ONLINE 0 0 0 gptid/d20347f5-c7bb-11e6-b597-002590d303d5 ONLINE 0 0 0 raidz1-1 ONLINE 0 0 0 gptid/e96bb4fe-ed1d-11e4-94a8-002590d303d5 ONLINE 0 0 0 gptid/a4bc50e0-09af-11e3-a865-002590d303d5 ONLINE 0 0 0 gptid/a5391d13-09af-11e3-a865-002590d303d5 ONLINE 0 0 0 gptid/a5b06638-09af-11e3-a865-002590d303d5 ONLINE 0 0 0 gptid/a62af437-09af-11e3-a865-002590d303d5 ONLINE 0 0 0 raidz1-2 ONLINE 0 0 0 gptid/a6a61418-09af-11e3-a865-002590d303d5 ONLINE 0 0 0 gptid/23f5d396-61ae-11e7-b597-002590d303d5 ONLINE 0 0 0 gptid/56aec46a-ecaa-11e6-b597-002590d303d5 ONLINE 0 0 0 gptid/756c1e74-b8c7-11e6-a030-002590d303d5 ONLINE 0 0 0 gptid/b83a9cb8-379d-11e5-9e72-002590d303d5 ONLINE 0 0 0 errors: No known data errors pool: freenas-boot state: ONLINE scan: scrub repaired 0 in 0 days 00:02:49 with 0 errors on Mon Apr 9 03:48:03 2018 config: NAME STATE READ WRITE CKSUM freenas-boot ONLINE 0 0 0 da16p2 ONLINE 0 0 0 errors: No known data errors root@freenas:~ # root@freenas:~ # zfs list NAME USED AVAIL REFER MOUNTPOINT FifteenPlusSpare 9.73T 11.3T 5.73T /mnt/FifteenPlusSpare FifteenPlusSpare/.system 441M 11.3T 256K legacy FifteenPlusSpare/.system/configs-5728ac67cc72462f84d2bde5a422c037 287M 11.3T 287M legacy FifteenPlusSpare/.system/cores 90.6M 11.3T 90.6M legacy FifteenPlusSpare/.system/rrd-5728ac67cc72462f84d2bde5a422c037 230K 11.3T 230K legacy FifteenPlusSpare/.system/samba4 6.67M 11.3T 6.67M legacy FifteenPlusSpare/.system/syslog-5728ac67cc72462f84d2bde5a422c037 55.8M 11.3T 55.8M legacy FifteenPlusSpare/jails 204K 11.3T 204K /mnt/FifteenPlusSpare/jails freenas-boot 2.74G 4.46G 31K none freenas-boot/ROOT 2.71G 4.46G 25K none freenas-boot/ROOT/11.1-RELEASE 2.61G 4.46G 870M / freenas-boot/ROOT/9.10-STABLE-201604181743 24.9M 4.46G 482M / freenas-boot/ROOT/9.10-STABLE-201605021851 33.7M 4.46G 515M / freenas-boot/ROOT/9.10.1-U4 38.7M 4.46G 661M / freenas-boot/ROOT/Initial-Install 1K 4.46G 496M legacy freenas-boot/ROOT/default 2.74M 4.46G 497M legacy freenas-boot/grub 25.8M 4.46G 6.83M legacy root@freenas:~ # last pid: 14515; load averages: 0.98, 0.84, 0.83 up 97+23:17:05 15:31:34 65 processes: 2 running, 63 sleeping CPU: 1.9% user, 0.0% nice, 5.3% system, 0.2% interrupt, 92.6% idle Mem: 94M Active, 43M Inact, 42M Laundry, 30G Wired, 497M Free ARC: 4325M Total, 1851M MFU, 2243M MRU, 55M Anon, 88M Header, 88M Other 3943M Compressed, 7124M Uncompressed, 1.81:1 Ratio Swap: 10G Total, 1253M Used, 8986M Free, 12% Inuse, 1372K In PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 14513 root 1 31 0 59288K 26164K uwait 1 0:00 5.30% dtrace 245 root 20 20 0 318M 22132K swread 0 416:13 0.61% python3.6 3569 root 13 42 0 59864K 15452K uwait 0 312:43 0.32% consul 2767 root 5 23 0 51136K 13336K select 1 23.4H 0.30% python3.6 3668 root 12 20 0 1222M 9180K nanslp 1 286:44 0.22% collectd 14512 root 1 21 0 7112K 3720K wait 0 0:00 0.20% ksh93 14488 root 1 20 0 7948K 3544K CPU3 3 0:00 0.14% top 2041 root 1 -52 r0 3520K 3584K nanslp 3 24:36 0.08% watchdogd 65519 root 2 20 0 40132K 5748K select 0 4:53 0.03% python3.6 14508 root 1 22 0 59288K 26164K uwait 0 0:00 0.02% dtrace 2763 root 1 20 0 19608K 6404K select 3 22:29 0.01% snmpd 13386 root 1 20 0 13216K 4848K select 3 0:00 0.01% sshd 436 root 1 20 0 152M 6632K kqread 2 0:08 0.00% uwsgi 2356 root 1 20 0 12512K 12620K select 2 5:21 0.00% ntpd 3522 root 1122 20 0 373M 41120K usem 1 101:47 0.00% python3.6 3564 root 14 20 0 37688K 6048K uwait 3 19:20 0.00% consul-alerts 5116 root 11 20 0 32912K 3164K uwait 2 6:31 0.00% consul 2503 root 1 20 0 12096K 4620K select 3 4:45 0.00% proftpd 5117 root 11 34 0 32912K 4676K uwait 3 3:26 0.00% consul 2557 root 1 20 0 37092K 4920K select 3 2:24 0.00% nmbd 2566 root 1 20 0 85324K 4924K select 2 2:23 0.00% winbindd 35720 root 2 20 0 23360K 2632K kqread 3 1:48 0.00% syslog-ng 3471 nobody 1 20 0 7144K 2192K select 2 1:04 0.00% mdnsd 2561 root 1 20 0 170M 4376K select 2 1:01 0.00% smbd 2573 root 1 20 0 44664K 5936K select 1 0:47 0.00% winbindd 4629 root 1 48 0 6496K 648K nanslp 2 0:35 0.00% cron 3238 root 1 20 0 10680K 0K nanslp 3 0:34 0.00% <smartd> 3272 root 1 21 0 7096K 0K wait 1 0:19 0.00% <sh> 5504 root 1 20 0 87108K 4592K select 0 0:16 0.00% winbindd 2572 root 1 20 0 129M 4420K select 2 0:10 0.00% smbd 2571 root 1 20 0 128M 4464K select 2 0:10 0.00% smbd 1687 root 1 20 0 9172K 116K select 1 0:09 0.00% devd 2740 root 1 20 0 12904K 4348K select 2 0:06 0.00% sshd 589 root 19 20 0 201M 6984K umtxn 0 0:05 0.00% uwsgi 5049 root 1 52 0 79628K 4964K ttyin 2 0:03 0.00% python3.6 93964 root 1 20 0 176M 5480K select 2 0:01 0.00% smbd 4619 root 1 20 0 9000K 2236K select 0 0:01 0.00% zfsd 198 www 1 20 0 12920K 928K kqread 3 0:00 0.00% nginx 3568 root 1 20 0 6344K 1836K piperd 3 0:00 0.00% daemon 95224 root 1 20 0 176M 5520K select 0 0:00 0.00% smbd 94939 root 1 20 0 176M 5396K select 0 0:00 0.00% smbd 9183 root 1 20 0 13216K 4768K select 1 0:00 0.00% sshd 13394 root 1 20 0 7480K 2652K pause 0 0:00 0.00% csh 14515 root 1 27 0 59288K 25868K CPU1 1 0:00 0.00% dtrace 9203 root 1 20 0 7480K 1852K ttyin 3 0:00 0.00% csh 14507 root 1 21 0 7112K 3720K wait 0 0:00 0.00% ksh93 14514 root 1 21 0 7112K 3720K wait 1 0:00 0.00% ksh93 1912 root 1 20 0 13532K 0K wait 2 0:00 0.00% <syslog-ng> 3267 root 1 20 0 8004K 1768K select 3 0:00 0.00% rsync 2081 root 1 20 0 7068K 1924K select 3 0:00 0.00% ctld 5053 root 1 52 0 6364K 1820K ttyin 1 0:00 0.00% getty 5050 root 1 52 0 6364K 1820K ttyin 0 0:00 0.00% getty 5055 root 1 52 0 6364K 1820K ttyin 0 0:00 0.00% getty 5054 root 1 52 0 6364K 1820K ttyin 1 0:00 0.00% getty 5052 root 1 52 0 6364K 1820K ttyin 0 0:00 0.00% getty 5051 root 1 52 0 6364K 1820K ttyin 2 0:00 0.00% getty 5056 root 1 52 0 6364K 1820K ttyin 1 0:00 0.00% getty 243 root 1 20 0 6344K 1020K piperd 3 0:00 0.00% daemon