- Joined
- Dec 21, 2012
- Messages
- 126
I tried to VNC into the single virtual machine I have running on FreeNAS and was unable to do anything. Once that occurred I figured the virtual machine locked up as I have been seeing weird issues with it. However I then tried to login to the WEBUI for FreeNAS and was also unable to do that. Finally I was able to get in via SSH and saw my load average was 13, 20, 21.
The main processes that were running were Python 3.6 which you can see below these process seem to correspond to middleware. I was able to check netdata and all of this seems to have started at 7:25pm on 12/19 is there anyway I can track what is happening, what occured at 7:25 etc?
Thanks!
Netdata
)
TOP
After all this I was also seeing errors, which I think might be from Netdata trying to collect stats but not sure.
Dec 20 08:26:51 Vault collectd[66204]: statvfs(/mnt/DeepEnd/VMBackups/Ludicrous) failed: No such file or directory
Dec 20 08:27:01 Vault collectd[66204]: statvfs(/mnt/DeepEnd/VMBackups/Ludicrous) failed: No such file or directory
Newest Load AVG..
The main processes that were running were Python 3.6 which you can see below these process seem to correspond to middleware. I was able to check netdata and all of this seems to have started at 7:25pm on 12/19 is there anyway I can track what is happening, what occured at 7:25 etc?
Thanks!
Code:
last pid: 73053; load averages: 1.79, 3.48, 9.66 up 4+22:02:09 08:15:58 106 processes: 1 running, 104 sleeping, 1 zombie CPU: 4.5% user, 0.1% nice, 15.7% system, 0.1% interrupt, 79.6% idle Mem: 290M Active, 117M Inact, 60M Laundry, 15G Wired, 158M Free ARC: 1580M Total, 808M MFU, 464M MRU, 6176K Anon, 24M Header, 278M Other 976M Compressed, 2427M Uncompressed, 2.49:1 Ratio Swap: 8192M Total, 4189M Used, 4003M Free, 51% Inuse, 4140K In, 5196K Out PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 245 root 946 20 0 1053M 78096K uwait 3 340:49 108.97% python3.6 84344 root 38 20 0 2121M 39020K kqread 0 37.2H 43.74% bhyve 54029 netdata 16 52 19 474M 17604K pause 3 25:07 0.66% netdata
Code:
ps -ax |grep "[p]ython" 245 - S 341:17.81 python3.6: middlewared (python3.6) 2883 - S 94:45.80 /usr/local/bin/python /usr/local/bin/snmp-agent.py (python3.6) 3537 - S 4:30.83 python: alertd (python3.6) 5610 - SJ 0:31.62 /usr/pbi/plexmediaserver-amd64/bin/python2.7 /usr/pbi/plexmediaserver-amd64/control.py start 192.168.1.181 12346 80975 - S 1:13.30 python: webshelld (python3.6) 6776 v0 IWs 0:00.00 /usr/local/bin/python /etc/netcli (python3.6)
Netdata
TOP
After all this I was also seeing errors, which I think might be from Netdata trying to collect stats but not sure.
Dec 20 08:26:51 Vault collectd[66204]: statvfs(/mnt/DeepEnd/VMBackups/Ludicrous) failed: No such file or directory
Dec 20 08:27:01 Vault collectd[66204]: statvfs(/mnt/DeepEnd/VMBackups/Ludicrous) failed: No such file or directory
Newest Load AVG..
Code:
last pid: 97303; load averages: 44.43, 30.93, 24.60 up 4+22:33:10 08:46:59 105 processes: 1 running, 103 sleeping, 1 zombie CPU: 5.1% user, 0.1% nice, 18.7% system, 0.0% interrupt, 76.1% idle Mem: 189M Active, 219M Inact, 77M Laundry, 15G Wired, 139M Free ARC: 1582M Total, 791M MFU, 488M MRU, 740K Anon, 24M Header, 278M Other 976M Compressed, 2451M Uncompressed, 2.51:1 Ratio Swap: 8192M Total, 4242M Used, 3950M Free, 51% Inuse, 5456K In, 23M Out PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 245 root 946 20 0 1053M 56308K uwait 7 372:02 148.96% python3.6 84344 root 38 20 0 2121M 34592K kqread 4 37.4H 17.37% bhyve 54029 netdata 16 52 19 474M 17616K pause 3 25:20 0.69% netdata 2394 root 4 20 0 6252K 1796K rpcsvc 4 19:50 0.40% nfsd 51900 netdata 1 39 19 8844K 3016K nanslp 6 0:33 0.28% apps.plugin 2883 root 5 22 0 53492K 14944K select 5 95:10 0.26% python3.6 3608 root 16 44 0 56660K 12332K uwait 7 11:21 0.14% consul 4828 root 24 20 0 264M 30548K kqread 4 3:53 0.13% uwsgi 52150 netdata 1 52 19 8100K 2944K piperd 7 0:16 0.12% bash 97206 root 1 20 0 7948K 4156K CPU4 4 0:00 0.10% top 3488 nobody 1 20 0 7144K 2360K select 5 0:12 0.07% mdnsd 80975 root 2 20 0 40132K 6584K select 6 1:14 0.02% python3.6
Code:
l last pid: 3232; load averages: 17.99, 34.68, 35.82 up 5+02:56:33 13:10:22 117 processes: 1 running, 115 sleeping, 1 zombie CPU: 6.1% user, 0.0% nice, 20.5% system, 0.2% interrupt, 73.1% idle Mem: 154M Active, 3112K Inact, 18M Laundry, 15G Wired, 177M Free ARC: 1530M Total, 774M MFU, 450M MRU, 3588K Anon, 22M Header, 280M Other 931M Compressed, 2422M Uncompressed, 2.60:1 Ratio Swap: 8192M Total, 4355M Used, 3836M Free, 53% Inuse, 7004K In, 2420K Out PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 245 root 1075 20 0 1070M 35540K uwait 5 717:32 146.66% python3.6 84344 root 38 20 0 2121M 20500K kqread 0 38.4H 13.38% bhyve 2879 root 1 20 0 675M 10792K swread 3 8:19 3.56% snmpd 66204 root 12 20 0 97912K 7428K nanslp 1 8:19 1.01% collectd 54029 netdata 11 52 19 477M 17352K pause 3 27:10 0.73% netdata 6843 root 5 20 0 31976K 2352K kqread 1 1:08 0.72% syslog-ng 4828 root 28 20 0 269M 12204K uwait 1 4:21 0.37% uwsgi 42654 netdata 1 39 19 8844K 3032K swread 4 0:40 0.32% apps.plugin 2394 root 4 20 0 6252K 1796K zio->i 5 20:47 0.26% nfsd 2883 root 5 24 0 53492K 14024K select 5 98:57 0.26% python3.6 3608 root 16 43 0 56660K 8132K uwait 1 12:20 0.20% consul 2142 root 1 -52 r0 3520K 3584K nanslp 3 4:06 0.15% watchdogd 42821 netdata 1 52 19 8100K 2924K wait 3 0:17 0.11% bash 2574 root 1 20 0 7948K 3304K CPU6 6 0:00 0.07% top 3488 nobody 1 20 0 7144K 2216K swread 1 0:14 0.05% mdnsd 3537 root 7 20 0 119M 9308K swread 2 4:42 0.03% python3.6 483 root 1 20 0 172M 7816K swread 2 0:00 0.03% smbd 80975 root 2 20 0 40132K 6536K select 3 1:18 0.03% python3.6 3196 root 1 21 0 59324K 26148K uwait 6 0:00 0.03% dtrace 1777 root 1 20 0 9172K 96K select 7 0:01 0.03% devd 72969 root 1 20 0 13216K 4756K select 4 0:00 0.02% sshd 3209 root 1 22 0 59324K 26148K uwait 6 0:00 0.01% dtrace 5610 root 6 20 0 149M 1000K select 1 0:33 0.01% python2.7 2475 root 1 20 0 6340K 1888K select 2 0:42 0.01% powerd 2578 uucp 1 20 0 18896K 2168K select 3 0:38 0.01% upsd 72957 root 1 20 0 13216K 4784K select 6 0:01 0.01% sshd
Last edited:
