FreeNAS box becomes unresponsive

Status
Not open for further replies.

intelligence

Explorer
Joined
Jun 2, 2015
Messages
62
Hey!

Just like topic title, I've noticed that my newly built FreeNAS box becomes unresponsive. Last night I had troubles around 2 am, and tonight I'm seeing same issue around 12 am.

I'm tunneling into my box via:
ssh -D 15443 -p 52739 me@xxx.duckdns.org

What I noticed both times is that when I enable the proxy connection in my browser I immediately get tons of:
channel 4: open failed: administratively prohibited: open failed spam, with different channel numbers.

If I try to access any jails or the dashboard I simply get ERR_SOCKS_CONNECTION_FAILED.

I also noticed that the Transmission web ui becomes unresponsive when the proxy tunnel is enabled, but when I turn it off I can access it again via my duckdns subdomain.

Doing a ps aux reveals
Code:
USER         PID  %CPU %MEM    VSZ    RSS TT  STAT STARTED       TIME COMMAND
root          11 796.8  0.0      0    128 ??  RL    5:55PM 2965:55.26 [idle]
921        10707  10.6  0.2 174088  57208 ??  SsJ   5:56PM   32:24.07 /usr/pbi/transmission-amd64/bin/transmission-daemon -g /var/db/transmission -x /var/run/transmission/d
root          12   2.7  0.0      0    480 ??  WL    5:55PM   17:33.26 [intr]
root         814   0.5  0.0      0     16 ??  DL    5:55PM    3:43.10 [ipmi0: kcs]
root           0   0.4  0.0      0  12288 ??  DLs   5:55PM   25:48.81 [kernel]
root           1   0.0  0.0   6276    584 ??  ILs   5:55PM    0:00.02 /sbin/init --
root           2   0.0  0.0      0     16 ??  DL    5:55PM    0:00.00 [crypto]
root           3   0.0  0.0      0     16 ??  DL    5:55PM    0:00.00 [crypto returns]
root           4   0.0  0.0      0     64 ??  DL    5:55PM    0:00.00 [ctl]
root           5   0.0  0.0      0    224 ??  DL    5:55PM    1:03.58 [zfskern]
root           6   0.0  0.0      0     16 ??  DL    5:55PM    0:00.00 [xpt_thrd]
root           7   0.0  0.0      0     16 ??  DL    5:55PM    0:00.01 [pagedaemon]
root           8   0.0  0.0      0     16 ??  DL    5:55PM    0:00.00 [vmdaemon]
root           9   0.0  0.0      0     16 ??  DL    5:55PM    0:00.00 [pagezero]
root          10   0.0  0.0      0     16 ??  DL    5:55PM    0:00.00 [audit]
root          13   0.0  0.0      0    128 ??  DL    5:55PM    0:00.00 [ng_queue]
root          14   0.0  0.0      0     48 ??  DL    5:55PM    1:58.73 [geom]
root          15   0.0  0.0      0     16 ??  DL    5:55PM    0:21.23 [yarrow]
root          16   0.0  0.0      0    128 ??  DL    5:55PM    0:00.78 [usb]
root          17   0.0  0.0      0     16 ??  DL    5:55PM    0:00.03 [bufdaemon]
root          18   0.0  0.0      0     16 ??  DL    5:55PM    0:11.00 [syncer]
root          19   0.0  0.0      0     16 ??  DL    5:55PM    0:00.05 [vnlru]
root          20   0.0  0.0      0     16 ??  DL    5:55PM    0:00.13 [softdepflush]
root         215   0.0  0.0      0     16 ??  DL    5:55PM    0:00.00 [g_mp_kt]
root         746   0.0  0.0      0     16 ??  DL    5:55PM    0:00.00 [ftcleanup]
root         965   0.0  0.0  12048   1852 ??  Is    5:55PM    0:00.00 dhclient: igb0 [priv] (dhclient)
_dhcp       1014   0.0  0.0  12048   1888 ??  Is    5:55PM    0:00.01 dhclient: igb0 (dhclient)
root        1188   0.0  0.0  14228   1740 ??  Is    5:56PM    0:00.00 /usr/sbin/moused -p /dev/ums0 -t auto -I /var/run/moused.ums0.pid
root        1494   0.0  0.0   6276   1276 ??  Is    5:56PM    0:00.01 /sbin/devd
root        1868   0.0  0.0  33744   3168 ??  I     5:56PM    0:00.00 /usr/local/sbin/syslog-ng -p /var/run/syslog.pid
root        1869   0.0  0.0 116696  11020 ??  Is    5:56PM    0:00.40 /usr/local/sbin/syslog-ng -p /var/run/syslog.pid
root        1872   0.0  0.0  12048   8024 ??  Ss    5:56PM    0:00.07 /usr/sbin/watchdogd
root        1901   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[0] ada3p1]
root        1902   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[1] ada3p1]
root        1903   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[2] ada3p1]
root        1904   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[3] ada3p1]
root        1905   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[4] ada3p1]
root        1906   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[5] ada3p1]
root        1907   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[6] ada3p1]
root        1908   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[7] ada3p1]
root        1910   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[0] ada0p1]
root        1911   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[1] ada0p1]
root        1912   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[2] ada0p1]
root        1913   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[3] ada0p1]
root        1914   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[4] ada0p1]
root        1915   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[5] ada0p1]
root        1916   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[6] ada0p1]
root        1917   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[7] ada0p1]
root        1919   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[0] ada1p1]
root        1920   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[1] ada1p1]
root        1921   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[2] ada1p1]
root        1922   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[3] ada1p1]
root        1923   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[4] ada1p1]
root        1924   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[5] ada1p1]
root        1925   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[6] ada1p1]
root        1926   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[7] ada1p1]
root        1928   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[0] ada2p1]
root        1929   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[1] ada2p1]
root        1930   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[2] ada2p1]
root        1931   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[3] ada2p1]
root        1932   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[4] ada2p1]
root        1933   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[5] ada2p1]
root        1934   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[6] ada2p1]
root        1935   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[7] ada2p1]
root        1937   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[0] da0p1]
root        1938   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[1] da0p1]
root        1939   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[2] da0p1]
root        1940   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[3] da0p1]
root        1941   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[4] da0p1]
root        1942   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[5] da0p1]
root        1943   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[6] da0p1]
root        1944   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[7] da0p1]
root        1946   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[0] da1p1]
root        1947   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[1] da1p1]
root        1948   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[2] da1p1]
root        1949   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[3] da1p1]
root        1950   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[4] da1p1]
root        1951   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[5] da1p1]
root        1952   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[6] da1p1]
root        1953   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[7] da1p1]
root        1955   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[0] da2p1]
root        1956   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[1] da2p1]
root        1957   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[2] da2p1]
root        1958   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[3] da2p1]
root        1959   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[4] da2p1]
root        1960   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[5] da2p1]
root        1961   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[6] da2p1]
root        1962   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [g_eli[7] da2p1]
root        2063   0.0  0.0      0     16 ??  DL    5:56PM    0:00.00 [Timer]
root        2422   0.0  0.0  22224   4008 ??  Ss    5:56PM    0:00.39 /usr/sbin/ntpd -g -c /etc/ntp.conf -p /var/run/ntpd.pid -f /var/db/ntpd.drift
root        2689   0.0  0.0  28096   4416 ??  I     5:56PM    0:00.11 /usr/local/sbin/smartd -i 1800 -c /usr/local/etc/smartd.conf -p /var/run/smartd.pid
root        2896   0.0  0.0  26348   5224 ??  Is    5:56PM    0:00.00 nginx: master process /usr/local/sbin/nginx
nobody      2916   0.0  0.0   9912   2248 ??  Is    5:56PM    0:00.02 /usr/local/sbin/mdnsd
root        2920   0.0  0.0  39408   5084 ??  I     5:56PM    0:00.32 /usr/local/sbin/netatalk
root        2935   0.0  0.0  91828   9632 ??  I     5:56PM    0:00.23 /usr/local/sbin/afpd -d -F /usr/local/etc/afp.conf
root        2936   0.0  0.0  34884   4876 ??  I     5:56PM    0:00.00 /usr/local/sbin/cnid_metad -d -F /usr/local/etc/afp.conf
root        2987   0.0  0.4 303764 147416 ??  I     5:56PM    0:02.00 /usr/local/bin/python -R /usr/local/www/freenasUI/manage.py runfcgi method=threaded host=127.0.0.1 por
root        2991   0.0  0.3 215000  85644 ??  I     5:56PM    0:21.61 python: alertd (python2.7)
messagebus  2999   0.0  0.0  14308   2328 ??  Is    5:56PM    0:00.00 /usr/local/bin/dbus-daemon --system
root        3034   0.0  0.1 182720  30444 ??  Ss    5:56PM    0:31.87 /usr/local/sbin/collectd
root        3191   0.0  0.0  49220   5544 ??  Is    5:56PM    0:00.00 /usr/sbin/sshd
root        3283   0.0  0.0  12048   1680 ??  Is    5:56PM    0:00.00 daemon: /usr/local/libexec/nas/register_mdns.py[3284] (daemon)
root        3284   0.0  0.2 179892  61616 ??  I     5:56PM    0:00.69 /usr/local/bin/python /usr/local/libexec/nas/register_mdns.py (python2.7)
root        4829   0.0  0.0  12080   1868 ??  SsJ   5:56PM    0:00.02 /usr/sbin/syslogd -s
816         4885   0.0  0.4 362208 122792 ??  SJ    5:56PM    0:45.03 /usr/pbi/couchpotato-amd64/bin/python2.7 /usr/pbi/couchpotato-amd64/share/couchpotato/CouchPotatoServe
root        4892   0.0  0.0  14184   1860 ??  IsJ   5:56PM    0:00.02 /usr/sbin/cron -s
root        5132   0.0  0.1 133376  41752 ??  IJ    5:56PM    0:02.68 /usr/pbi/couchpotato-amd64/bin/python2.7 /usr/pbi/couchpotato-amd64/control.py start 192.168.1.4 12348
root        5997   0.0  0.0  12080   1868 ??  SsJ   5:56PM    0:00.02 /usr/sbin/syslogd -s
972         6047   0.0  0.4 333804 137500 ??  IsJ   5:56PM    0:07.91 /usr/pbi/plexmediaserver-amd64/share/plexmediaserver/Plex_Media_Server (Plex Media Server)
root        6055   0.0  0.0  14184   1860 ??  IsJ   5:56PM    0:00.02 /usr/sbin/cron -s
root        6295   0.0  0.1 133032  41252 ??  IJ    5:56PM    0:02.80 /usr/pbi/plexmediaserver-amd64/bin/python2.7 /usr/pbi/plexmediaserver-amd64/control.py start 192.168.1
972         6720   0.0  0.6 431500 196560 ??  SNJ   5:56PM    0:20.93 Plex Plug-in [com.plexapp.system] /usr/pbi/plexmediaserver-amd64/share/plexmediaserver/Resources/Plug-
root        7175   0.0  0.0  12080   1868 ??  SsJ   5:56PM    0:00.02 /usr/sbin/syslogd -s
root        7228   0.0  0.0  14184   1860 ??  IsJ   5:56PM    0:00.02 /usr/sbin/cron -s
root        7469   0.0  0.1 133312  41352 ??  IJ    5:56PM    0:02.82 /usr/pbi/sickbeard-amd64/bin/python2.7 /usr/pbi/sickbeard-amd64/control.py start 192.168.1.5 12349
root        8334   0.0  0.0  12080   1868 ??  SsJ   5:56PM    0:00.02 /usr/sbin/syslogd -s
816         8392   0.0  0.6 447376 209504 ??  SJ    5:56PM    2:26.27 /usr/pbi/sickrage-amd64/bin/python2.7 /usr/pbi/sickrage-amd64/share/sickrage/SickRage/SickBeard.py --d
root        8400   0.0  0.0  14184   1868 ??  IsJ   5:56PM    0:00.02 /usr/sbin/cron -s
root        8640   0.0  0.1 133376  42096 ??  IJ    5:56PM    0:02.75 /usr/pbi/sickrage-amd64/bin/python2.7 /usr/pbi/sickrage-amd64/control.py start 192.168.1.7 12351
root        9499   0.0  0.0  12080   1868 ??  IsJ   5:56PM    0:00.02 /usr/sbin/syslogd -s
816         9549   0.0  0.4 256524 126616 ??  SsJ   5:56PM    3:44.17 /usr/pbi/sonarr-amd64/bin/mono /usr/pbi/sonarr-amd64/share/sonarr/NzbDrone/NzbDrone.exe --data=/var/db
root        9557   0.0  0.0  14184   1860 ??  IsJ   5:56PM    0:00.02 /usr/sbin/cron -s
root        9797   0.0  0.1 139964  40860 ??  IJ    5:56PM    0:02.80 /usr/pbi/sonarr-amd64/bin/python2.7 /usr/pbi/sonarr-amd64/control.py start 192.168.1.6 12350
root       10672   0.0  0.0  12080   1868 ??  IsJ   5:56PM    0:00.03 /usr/sbin/syslogd -s
root       10736   0.0  0.0  14184   1860 ??  IsJ   5:56PM    0:00.02 /usr/sbin/cron -s
root       10976   0.0  0.1 133032  41304 ??  IJ    5:56PM    0:04.16 /usr/pbi/transmission-amd64/bin/python2.7 /usr/pbi/transmission-amd64/control.py start 192.168.1.2 123
root       12505   0.0  0.0  14140   1920 ??  Is    5:56PM    0:00.02 /usr/sbin/cron -s
root       12692   0.0  0.0  45000   4436 ??  I     5:57PM    0:00.01 /sbin/zfsd -d zfsd
www        22164   0.0  0.0  26348   5644 ??  I    12:00AM    0:00.00 nginx: worker process (nginx)
root       22271   0.0  0.0  71916   6140 ??  Is   12:02AM    0:00.01 sshd: int [priv] (sshd)
int        22273   0.0  0.0  71916   6140 ??  S    12:02AM    0:00.05 sshd: int@pts/0 (sshd)
root       22633   0.0  0.0   3776   1540 ??  IN   12:16AM    0:00.00 sleep 300
root        2708   0.0  0.0  18596   3284 v0- IN    5:56PM    0:00.04 /bin/sh /usr/local/sbin/pbid
root       12684   0.0  0.2 171316  62436 v0  Is+   5:57PM    0:00.70 python /etc/netcli (python2.7)
root       12685   0.0  0.0  12048   1732 v1  Is+   5:57PM    0:00.00 /usr/libexec/getty Pc ttyv1
root       12686   0.0  0.0  12048   1732 v2  Is+   5:57PM    0:00.00 /usr/libexec/getty Pc ttyv2
root       12687   0.0  0.0  12048   1732 v3  Is+   5:57PM    0:00.00 /usr/libexec/getty Pc ttyv3
root       12688   0.0  0.0  12048   1732 v4  Is+   5:57PM    0:00.00 /usr/libexec/getty Pc ttyv4
root       12689   0.0  0.0  12048   1732 v5  Is+   5:57PM    0:00.00 /usr/libexec/getty Pc ttyv5
root       12690   0.0  0.0  12048   1732 v6  Is+   5:57PM    0:00.00 /usr/libexec/getty Pc ttyv6
root       12691   0.0  0.0  12048   1732 v7  Is+   5:57PM    0:00.00 /usr/libexec/getty Pc ttyv7
int        22274   0.0  0.0  12296   2968  0  Is   12:02AM    0:00.01 -bash (bash)
root       22461   0.0  0.0  68180   5668  0  I    12:09AM    0:00.01 sudo su
root       22476   0.0  0.0  45280   2388  0  I    12:10AM    0:00.00 su
root       22477   0.0  0.0  17524   3868  0  S    12:10AM    0:00.02 _su (csh)
root       22652   0.0  0.0  16256   2040  0  R+   12:17AM    0:00.00 ps aux


Not sure about the top one, but cpu usage seems crazy?
Doing a "w" tells me
Code:
12:17AM  up  6:23, 1 user, load averages: 0.05, 0.16, 0.21


Here's the content of /var/log/messages:
http://pastie.org/private/rrlcclal30qt1eboeproa

Last night it just started working again, it has yet to happen this time around..
 
D

dlavigne

Guest
AllowTCPForwarding was set to no again, so something must've overwritten it. What could've caused it?

Did you set that from the GUI or shell? Anything not set in the GUI is lost when the system reboots.
 
Status
Not open for further replies.
Top