TueNAS Scale 22.02.4 - Dashboard blank/empty after crash (power failure)

[BSAfH]

Hi,

after a main power failure my TrueNAS Scale system does come up again and seems to work fine - but the Web-UI only works partially.

It's the same in Chrome and Firefox. And the same in a new "private tab" in Firefox.

System info: see signature

Anything that has to do with storage or disks does not show up:

Netwok does not show up as well:

Other parts do work:

This https://www.truenas.com/community/threads/suddenly-dashboard-show-empty-page.85269/post-598543 does not help, as that screen does not show up:

This might help https://www.truenas.com/community/threads/upgraded-11-2-to-11-3-dashboard-empty.82373/post-570390 - but which config? and where to reset it? Surely only the UI config, not the whole system inluding all pools and shares???


This shown in the error console:

Code:

Jan  5 14:25:58 truenas wsdd.py[142303]: ERROR: error in main loop
Jan  5 14:25:58 truenas wsdd.py[142303]: Traceback (most recent call last):
Jan  5 14:25:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 1732, in main
Jan  5 14:25:58 truenas wsdd.py[142303]:     key.data.handle_request(key)
Jan  5 14:25:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 213, in handle_request
Jan  5 14:25:58 truenas wsdd.py[142303]:     handler.handle_request(msg, address)
Jan  5 14:25:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 728, in handle_request
Jan  5 14:25:58 truenas wsdd.py[142303]:     reply = self.handle_message(msg, self.mch, address)
Jan  5 14:25:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 373, in handle_message
Jan  5 14:25:58 truenas wsdd.py[142303]:     tree = ElementTree.fromstring(msg)
Jan  5 14:25:58 truenas wsdd.py[142303]:   File "/usr/lib/python3.9/xml/etree/ElementTree.py", line 1347, in XML
Jan  5 14:25:58 truenas wsdd.py[142303]:     parser.feed(text)
Jan  5 14:25:58 truenas wsdd.py[142303]: xml.etree.ElementTree.ParseError: not well-formed (invalid token): line 1, column 99
Jan  5 14:26:58 truenas wsdd.py[142303]: ERROR: error in main loop
Jan  5 14:26:58 truenas wsdd.py[142303]: Traceback (most recent call last):
Jan  5 14:26:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 1732, in main
Jan  5 14:26:58 truenas wsdd.py[142303]:     key.data.handle_request(key)
Jan  5 14:26:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 213, in handle_request
Jan  5 14:26:58 truenas wsdd.py[142303]:     handler.handle_request(msg, address)
Jan  5 14:26:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 728, in handle_request
Jan  5 14:26:58 truenas wsdd.py[142303]:     reply = self.handle_message(msg, self.mch, address)
Jan  5 14:26:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 373, in handle_message
Jan  5 14:26:58 truenas wsdd.py[142303]:     tree = ElementTree.fromstring(msg)
Jan  5 14:26:58 truenas wsdd.py[142303]:   File "/usr/lib/python3.9/xml/etree/ElementTree.py", line 1347, in XML
Jan  5 14:26:58 truenas wsdd.py[142303]:     parser.feed(text)
Jan  5 14:26:58 truenas wsdd.py[142303]: xml.etree.ElementTree.ParseError: not well-formed (invalid token): line 1, column 99
Jan  5 14:27:58 truenas wsdd.py[142303]: ERROR: error in main loop
Jan  5 14:27:58 truenas wsdd.py[142303]: Traceback (most recent call last):
Jan  5 14:27:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 1732, in main
Jan  5 14:27:58 truenas wsdd.py[142303]:     key.data.handle_request(key)
Jan  5 14:27:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 213, in handle_request
Jan  5 14:27:58 truenas wsdd.py[142303]:     handler.handle_request(msg, address)
Jan  5 14:27:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 728, in handle_request
Jan  5 14:27:58 truenas wsdd.py[142303]:     reply = self.handle_message(msg, self.mch, address)
Jan  5 14:27:58 truenas wsdd.py[142303]:   File "/usr/bin/wsdd.py", line 373, in handle_message
Jan  5 14:27:58 truenas wsdd.py[142303]:     tree = ElementTree.fromstring(msg)
Jan  5 14:27:58 truenas wsdd.py[142303]:   File "/usr/lib/python3.9/xml/etree/ElementTree.py", line 1347, in XML
Jan  5 14:27:58 truenas wsdd.py[142303]:     parser.feed(text)
Jan  5 14:27:58 truenas wsdd.py[142303]: xml.etree.ElementTree.ParseError: not well-formed (invalid token): line 1, column 99

The error sees to be:

Code:

not well-formed (invalid token): line 1, column 99

As it's in private tabs as well - must be some token on the server itself?

Unfortunately I have no idea what I could do to make this error go away.

Any help welcome!

 

[BSAfH]

after several reboot - still no dashboard :

the error is still:

Code:

Jan  8 11:08:03 truenas wsdd.py[110088]: ERROR: error in main loop
Jan  8 11:08:03 truenas wsdd.py[110088]: Traceback (most recent call last):
Jan  8 11:08:03 truenas wsdd.py[110088]:   File "/usr/bin/wsdd.py", line 1732, in main
Jan  8 11:08:03 truenas wsdd.py[110088]:     key.data.handle_request(key)
Jan  8 11:08:03 truenas wsdd.py[110088]:   File "/usr/bin/wsdd.py", line 213, in handle_request
Jan  8 11:08:03 truenas wsdd.py[110088]:     handler.handle_request(msg, address)
Jan  8 11:08:03 truenas wsdd.py[110088]:   File "/usr/bin/wsdd.py", line 728, in handle_request
Jan  8 11:08:03 truenas wsdd.py[110088]:     reply = self.handle_message(msg, self.mch, address)
Jan  8 11:08:03 truenas wsdd.py[110088]:   File "/usr/bin/wsdd.py", line 373, in handle_message
Jan  8 11:08:03 truenas wsdd.py[110088]:     tree = ElementTree.fromstring(msg)
Jan  8 11:08:03 truenas wsdd.py[110088]:   File "/usr/lib/python3.9/xml/etree/ElementTree.py", line 1347, in XML
Jan  8 11:08:03 truenas wsdd.py[110088]:     parser.feed(text)
Jan  8 11:08:03 truenas wsdd.py[110088]: xml.etree.ElementTree.ParseError: not well-formed (invalid token): line 1, column 99

what token?

 

[BSAfH]

The error must be in an XML document that is given to wsdd.py for interpretation.

Since the whole thing appears in all browsers, it cannot be in the client cache or something.

The crash must have created an invalid XML somewhere (template?) or everything that has to do with storage delivers invalid results to the template to be displayed.

And now???

 

[mikdima]

Hello, same here, after an unscheduled reboot.
In my case the web interface stop working, the only thing I can do is login via SSH and run
service middlewared restart

Code:

service middlewared restart

The error I can see in /var/log/messages is

Code:

2024-01-31 08:00:57,894:wsdd ERROR(pid 1899): error in main loop
Traceback (most recent call last):
  File "/usr/local/bin/wsdd.py", line 1732, in main
    key.data.handle_request(key)
  File "/usr/local/bin/wsdd.py", line 213, in handle_request
    handler.handle_request(msg, address)
  File "/usr/local/bin/wsdd.py", line 728, in handle_request
    reply = self.handle_message(msg, self.mch, address)
  File "/usr/local/bin/wsdd.py", line 373, in handle_message
    tree = ElementTree.fromstring(msg)
  File "/usr/local/lib/python3.9/xml/etree/ElementTree.py", line 1342, in XML
    parser.feed(text)
xml.etree.ElementTree.ParseError: not well-formed (invalid token): line 1, column 99

Does anyone can help?

Thanks,
Michele