Truenas ui crash

[tbaror]

Hello ,
I recently upgraded to latest Truenas CORE 12.0-U2.1 , the server worked for a while and suddenly i have crash UI no further acces to it ,
in addition to any of my jails (URBACKUP) ,in console i see following error ,shown below
Please advice
Thanks

Code:

Traceback (most recent call last):
  File "/usr/local/sbin/hactl", line 171, in <module>
    main(args.command, args.q)
  File "/usr/local/sbin/hactl", line 17, in main
    client = Client()
  File "/usr/local/lib/python3.8/site-packages/middlewared/client/client.py", li                                                                                                               ne 281, in __init__
    self._ws.connect()
  File "/usr/local/lib/python3.8/site-packages/middlewared/client/client.py", li                                                                                                               ne 124, in connect
    rv = super(WSClient, self).connect()
  File "/usr/local/lib/python3.8/site-packages/ws4py/client/__init__.py", line 2                                                                                                               16, in connect
    self.sock.connect(self.bind_addr)
ConnectionRefusedError: [Errno 61] Connection refused

 

[sretalla]

It looks like you have a middleware crash.

You should be able to get it to work again with service middlewared restart at the console.

 

[Gianni_Pitto]

same problem for me. I've opened another thread (no answer there). Anyway, since the nas is in a remote location I cannot access it, I have to ask to someone's to reboot it manually. It will stay up for 25min circa, and then crash again. different version of UI 12.0-U1.1 ... S No other access is possible : neither ssh will work.
It's a pity , because we are a big company and I was testing truenas, but now I'm going to withdraw the truenas and cancel the testing and the project.


Mar 6 03:33:13 nas File "/usr/local/lib/collectd_pyplugins/disktemp.py", line 62, in read
Mar 6 03:33:13 nas with Client() as c:
Mar 6 03:33:13 nas File "/usr/local/lib/python3.8/site-packages/middlewared/client/client.py", line 281, in __init__
Mar 6 03:33:13 nas self._ws.connect()
Mar 6 03:33:13 nas File "/usr/local/lib/python3.8/site-packages/middlewared/client/client.py", line 124, in connect
Mar 6 03:33:13 nas rv = super(WSClient, self).connect()
Mar 6 03:33:13 nas File "/usr/local/lib/python3.8/site-packages/ws4py/client/__init__.py", line 223, in connect
Mar 6 03:33:13 nas bytes = self.sock.recv(128)
Mar 6 03:33:13 nas socket.timeout: timed out
Mar 7 03:33:13 nas 1 2021-03-07T03:33:13.365478+01:00 nas.domain.local collectd 20390 - - Traceback (most recent call last):
Mar 7 03:33:13 nas File "/usr/local/lib/collectd_pyplugins/disktemp.py", line 62, in read
Mar 7 03:33:13 nas with Client() as c:
Mar 7 03:33:13 nas File "/usr/local/lib/python3.8/site-packages/middlewared/client/client.py", line 281, in __init__
Mar 7 03:33:13 nas self._ws.connect()
Mar 7 03:33:13 nas File "/usr/local/lib/python3.8/site-packages/middlewared/client/client.py", line 124, in connect
Mar 7 03:33:13 nas rv = super(WSClient, self).connect()
Mar 7 03:33:13 nas File "/usr/local/lib/python3.8/site-packages/ws4py/client/__init__.py", line 223, in connect
Mar 7 03:33:13 nas bytes = self.sock.recv(128)
Mar 7 03:33:13 nas socket.timeout: timed out

 

[tbaror]

It looks like you have a middleware crash.

You should be able to get it to work again with service middlewared restart at the console.

Thanks for the tip , but unfortunately its not solve the problem , like Gianni_Pitto mention its a major issue for us.

 

[sretalla]

different version of UI 12.0-U1.1

I would expect some crashing of the middleware under that version... upgrade.

its not solve the problem

Does it come back and crash again? or doesn't come back at all?

 

[dfalke]

I am seeing the same issue on 12.0-U2.1...

Mar 26 00:09:38 nas 1 2021-03-26T00:09:38.930470-07:00 nas.sgcof.local collectd 1935 - - Traceback (most recent call last):
Mar 26 00:09:39 nas File "/usr/local/lib/collectd_pyplugins/disktemp.py", line 62, in read
Mar 26 00:09:39 nas with Client() as c:
Mar 26 00:09:39 nas File "/usr/local/lib/python3.8/site-packages/middlewared/client/client.py", line 281, in __init__
Mar 26 00:09:39 nas self._ws.connect()
Mar 26 00:09:39 nas File "/usr/local/lib/python3.8/site-packages/middlewared/client/client.py", line 124, in connect
Mar 26 00:09:39 nas rv = super(WSClient, self).connect()
Mar 26 00:09:39 nas File "/usr/local/lib/python3.8/site-packages/ws4py/client/__init__.py", line 216, in connect
Mar 26 00:09:39 nas self.sock.connect(self.bind_addr)
Mar 26 00:09:39 nas ConnectionRefusedError: [Errno 61] Connection refused


Any resolution?

 

[revenghost]

Same problem! Version: TrueNAS-12.0-U2.1

The logs had that, but only that, even though it went up and down for the past 30 minutes, no logs any of the times of going up and down. system doesn't respond then comes up, then back down. I rebooted it and so far staying up. But its been going up and down since I upgraded... how do I downgrade?



Mar 31 13:10:50 truenas 1 2021-03-31T13:10:48.362600-07:00 truenas.local collectd 1780 - - Traceback (most recent call last):
File "/usr/local/lib/collectd_pyplugins/disktemp.py", line 62, in read
with Client() as c:
File "/usr/local/lib/python3.8/site-packages/middlewared/client/client.py", line 284, in __init__
raise ClientException('Failed connection handshake')
middlewared.client.client.ClientException: Failed connection handshake

I have a ping monitor on it:

 

[revengineer]

Problem still exists in 12.0-U3.1. I filed a ticket here.