Webinterface stopps working. Loads a blank black screen.

D

Daniel Claesson

Dabbler
Joined
May 31, 2016
Messages
35
Hi,

Webinterface on my testsystem has stopped working, a reboot do not solve the problem.
No clue how to diagnose this. This is the second time this happens. Last time i gave up and just reinstalled.

What logfiles are interesting for diagnosis?

Here is "middlewared.log" since last reboot.
Code:
[2021/02/09 12:02:42] (DEBUG) UsageService.start():66 - Scheduled next run in 61361 seconds
[2021/02/09 12:52:58] (DEBUG) middlewared.status():386 - Failed to retrieve VM status for 'UbuntuTest'
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vms.py", line 384, in status
    return self._status(vm['name'])
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vm_supervisor.py", line 77, in _status
    self._check_setup_connection()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/connection.py", line 43, in _check_setup_connection
    self.middleware.call_sync('vm.setup_libvirt_connection', 10)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1293, in call_sync
    return methodobj(*prepared_call.args)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 49, in setup_libvirt_connection
    self.middleware.call_sync('vm.wait_for_libvirtd', timeout)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1282, in call_sync
    return self.run_coroutine(methodobj(*prepared_call.args))
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1322, in run_coroutine
    return fut.result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
    return self.__get_result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 39, in wait_for_libvirtd
    await asyncio.wait_for(libvirtd_started(self.middleware), timeout=timeout)
  File "/usr/lib/python3.9/asyncio/tasks.py", line 481, in wait_for
    return fut.result()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 33, in libvirtd_started
    await middleware.call('service.start', 'libvirtd')
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1266, in call
    return await self._call(
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1223, in _call
    return await methodobj(*prepared_call.args)
  File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 999, in nf
    return await f(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service.py", line 123, in start
    await service_object.start()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base.py", line 76, in start
    return await self._start_linux()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 47, in _start_linux
    await self._unit_action("Start")
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 67, in _unit_action
    return await self.middleware.run_in_thread(self._unit_action_sync, action, wait, timeout)
  File "/usr/lib/python3/dist-packages/middlewared/utils/run_in_thread.py", line 10, in run_in_thread
    return await self.loop.run_in_executor(self.run_in_thread_executor, functools.partial(method, *args, **kwargs))
  File "/usr/lib/python3/dist-packages/middlewared/utils/io_thread_pool_executor.py", line 25, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 71, in _unit_action_sync
    job = getattr(unit.Unit, action)(b"replace")
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 191, in _call
    return func(self, name, *args)
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 161, in _call_method
    return self._auto_call_dbus_method(method_name, in_args, *args)
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 180, in _auto_call_dbus_method
    return bus.call_method(
  File "pystemd/dbuslib.pyx", line 442, in pystemd.dbuslib.DBus.call_method
pystemd.dbusexc.DBusBaseError: b'org.freedesktop.systemd1.TransactionIsDestructive'[err -35]: b"Transaction for libvirtd.service/start is destructive (systemd-sysctl.service has 'stop' job queued, but 'start' is included in transaction)."
This is DBusBaseError, a base error for DBus (i bet you did not see that coming) if you need a special error, enhance pystemd.sysdexc module!.
[2021/02/09 12:52:58] (DEBUG) middlewared.__event_system_ready():169 - VM(s) stopped successfully
[2021/02/09 12:52:59] (INFO) middlewared.terminate():1536 - Terminating
[2021/02/09 12:52:59] (DEBUG) middlewared.status():386 - Failed to retrieve VM status for 'UbuntuTest'
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vms.py", line 384, in status
    return self._status(vm['name'])
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vm_supervisor.py", line 77, in _status
    self._check_setup_connection()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/connection.py", line 43, in _check_setup_connection
    self.middleware.call_sync('vm.setup_libvirt_connection', 10)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1293, in call_sync
    return methodobj(*prepared_call.args)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 49, in setup_libvirt_connection
    self.middleware.call_sync('vm.wait_for_libvirtd', timeout)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1282, in call_sync
    return self.run_coroutine(methodobj(*prepared_call.args))
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1322, in run_coroutine
    return fut.result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
    return self.__get_result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 39, in wait_for_libvirtd
    await asyncio.wait_for(libvirtd_started(self.middleware), timeout=timeout)
  File "/usr/lib/python3.9/asyncio/tasks.py", line 481, in wait_for
    return fut.result()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 33, in libvirtd_started
    await middleware.call('service.start', 'libvirtd')
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1266, in call
    return await self._call(
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1223, in _call
    return await methodobj(*prepared_call.args)
  File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 999, in nf
    return await f(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service.py", line 123, in start
    await service_object.start()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base.py", line 76, in start
    return await self._start_linux()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 47, in _start_linux
    await self._unit_action("Start")
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 67, in _unit_action
    return await self.middleware.run_in_thread(self._unit_action_sync, action, wait, timeout)
  File "/usr/lib/python3/dist-packages/middlewared/utils/run_in_thread.py", line 10, in run_in_thread
    return await self.loop.run_in_executor(self.run_in_thread_executor, functools.partial(method, *args, **kwargs))
  File "/usr/lib/python3/dist-packages/middlewared/utils/io_thread_pool_executor.py", line 25, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 71, in _unit_action_sync
    job = getattr(unit.Unit, action)(b"replace")
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 191, in _call
    return func(self, name, *args)
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 161, in _call_method
    return self._auto_call_dbus_method(method_name, in_args, *args)
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 180, in _auto_call_dbus_method
    return bus.call_method(
  File "pystemd/dbuslib.pyx", line 442, in pystemd.dbuslib.DBus.call_method
pystemd.dbusexc.DBusBaseError: b'org.freedesktop.systemd1.TransactionIsDestructive'[err -35]: b"Transaction for libvirtd.service/start is destructive (virtlogd.socket has 'stop' job queued, but 'start' is included in transaction)."
This is DBusBaseError, a base error for DBus (i bet you did not see that coming) if you need a special error, enhance pystemd.sysdexc module!.
[2021/02/09 12:54:29] (INFO) middlewared.__init__():818 - Starting TrueNAS-SCALE-21.02-MASTER-20210206-092917 middleware
[2021/02/09 12:54:37] (DEBUG) middlewared.utils.plugins.load_modules():29 - Registering new module path '/usr/local/lib/middlewared_truenas'
[2021/02/09 12:54:39] (DEBUG) middlewared.setup():1759 - Timezone set to Europe/Stockholm
[2021/02/09 12:54:42] (DEBUG) middlewared.setup():2843 - Certificate setup for System complete
[2021/02/09 12:54:50] (DEBUG) middlewared.__plugins_setup():935 - All plugins loaded
[2021/02/09 12:54:50] (DEBUG) middlewared.__initialize():1530 - Accepting connections
[2021/02/09 12:54:51] (INFO) DiskService.sync_all():94 - Found disks: {'sda': {'name': 'sda', 'ident': 'S301DQC7', 'lunid': '5000c50080a0a1e7', 'serial': 'S301DQC7'}, 'sdb': {'name': 'sdb', 'ident': 'ZDH06MPF', 'lunid': '5000c50092d754a4', 'serial': 'ZDH06MPF'}, 'sdc': {'name': 'sdc', 'ident': 'WD-WCC133YHCD2L', 'lunid': '50014ee262443d23', 'serial': 'WD-WCC133YHCD2L'}, 'sdd': {'name': 'sdd', 'ident': 'WD-WCC133YHC5AR', 'lunid': '50014ee2b79a029a', 'serial': 'WD-WCC133YHC5AR'}, 'sde': {'name': 'sde', 'ident': 'PHDV652101C4150MGN', 'lunid': '55cd2e414d5c664e', 'serial': 'PHDV652101C4150MGN'}, 'sdf': {'name': 'sdf', 'ident': 'S21PNSBG115811J', 'lunid': '5002538da0154075', 'serial': 'S21PNSBG115811J'}}
[2021/02/09 12:54:51] (INFO) InterfaceService.sync():1941 - Interfaces in database: NONE
[2021/02/09 12:54:54] (DEBUG) EtcService.generate():437 - No new changes for /etc/smbusername.map
[2021/02/09 12:54:56] (DEBUG) EtcService.generate():437 - No new changes for /etc/group
[2021/02/09 12:54:56] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/passwd
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/shadow
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/fstab
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/krb5.conf
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/keyboard
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/openldap/ldap.conf
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/nfs-common
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/nsswitch.conf
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/nslcd.conf
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/common-session-noninteractive
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/common-password
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/common-account
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/common-session
[2021/02/09 12:54:58] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:54:58] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/proftpd/proftpd.conf
[2021/02/09 12:54:58] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:54:59] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/kdump-tools
[2021/02/09 12:55:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/apache2/apache2.conf
[2021/02/09 12:55:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/keepalived/keepalived.conf
[2021/02/09 12:55:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/motd
[2021/02/09 12:55:01] (DEBUG) middlewared.render_body():34 - UPSMON: monpwd field empty, upsmon will fail to start.
[2021/02/09 12:55:07] (DEBUG) EtcService.generate():437 - No new changes for /etc/smb4.conf
[2021/02/09 12:55:07] (DEBUG) EtcService.generate():437 - No new changes for /etc/snmp/snmpd.conf
[2021/02/09 12:55:08] (DEBUG) EtcService.generate():437 - No new changes for /etc/sudoers
[2021/02/09 12:55:08] (DEBUG) EtcService.generate():437 - No new changes for /etc/hosts
[2021/02/09 12:55:09] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/sshd
[2021/02/09 12:55:09] (DEBUG) EtcService.generate():386 - mako:local/users.oath file removed.
[2021/02/09 12:55:09] (DEBUG) EtcService.generate():437 - No new changes for /etc/ntp.conf
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/inadyn.conf
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/aliases
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():386 - mako:local/openvpn/server/server.conf file removed.
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():386 - mako:local/openvpn/client/client.conf file removed.
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/pykmip/pykmip.conf
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():386 - mako:wireguard/wg0.conf file removed.
[2021/02/09 12:55:22] (INFO) RouteService.sync():2151 - Changing IPv4 default route from 192.168.10.1 to 192.168.5.1
[2021/02/09 12:55:22] (DEBUG) EtcService.generate():437 - No new changes for /etc/nginx/nginx.conf
[2021/02/09 12:55:22] (DEBUG) EtcService.generate():437 - No new changes for /etc/avahi/avahi-daemon.conf
[2021/02/09 12:55:33] (DEBUG) middlewared.plugins.disk_.zfs_guid.sync_zfs_guid():44 - Setting disk '{serial_lunid}WD-WCC133YHC5AR_50014ee2b79a029a' zfs_guid '5305080093683576321'
[2021/02/09 12:55:34] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:55:34] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:55:34] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:55:35] (DEBUG) EtcService.generate():437 - No new changes for /etc/ssh/sshd_config
[2021/02/09 12:55:48] (DEBUG) EtcService.generate():437 - No new changes for /etc/glusterfs/glusterd.vol
[2021/02/09 12:55:51] (DEBUG) EtcService.generate():437 - No new changes for /etc/smb4.conf
[2021/02/09 12:55:51] (DEBUG) EtcService.generate():437 - No new changes for /etc/security/pam_winbind.conf
[2021/02/09 12:55:52] (DEBUG) EtcService.generate():437 - No new changes for /etc/smbusername.map
[2021/02/09 12:55:54] (DEBUG) EtcService.generate():437 - No new changes for /etc/group
[2021/02/09 12:55:55] (DEBUG) EtcService.generate():437 - No new changes for /etc/passwd
[2021/02/09 12:55:55] (DEBUG) EtcService.generate():437 - No new changes for /etc/shadow
[2021/02/09 12:55:57] (DEBUG) EtcService.generate():386 - mako:ganesha/ganesha.conf file removed.
[2021/02/09 12:55:59] (DEBUG) EtcService.generate():437 - No new changes for /etc/scst.conf
[2021/02/09 12:56:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/apache2/Includes/webdav.conf
[2021/02/09 12:56:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/glusterfs/glusterd.vol
[2021/02/09 12:56:01] (DEBUG) EtcService.generate():437 - No new changes for /etc/collectd/collectd.conf
[2021/02/09 12:56:02] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/rrdcached
[2021/02/09 12:56:03] (DEBUG) EtcService.generate():437 - No new changes for /etc/rsyncd.conf
[2021/02/09 12:56:03] (DEBUG) EtcService.generate():437 - No new changes for /etc/security/pam_winbind.conf
[2021/02/09 12:56:08] (DEBUG) EtcService.generate():437 - No new changes for /etc/ctdb/ctdb.conf
[2021/02/09 12:56:09] (DEBUG) EtcService.generate():437 - No new changes for /etc/apache2/apache2.conf
[2021/02/09 12:56:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/proftpd/proftpd.conf
[2021/02/09 12:56:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/nfs-common
[2021/02/09 12:56:11] (DEBUG) EtcService.generate():437 - No new changes for /etc/apache2/Includes/webdav.conf
[2021/02/09 12:56:12] (DEBUG) EtcService.generate():386 - mako:ganesha/ganesha.conf file removed.
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task alert.flush_alerts to run every 3600 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task alert.process_alerts to run every 60 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task certificate.renew_certs to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task certificateauthority.crl_generation to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task chart.release.periodic_chart_releases_update_checks to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task kerberos.keytab.check_updated_keytab to run every 3600 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task kmip.sync_keys to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task mail.send_mail_queue to run every 600 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task pool.dataset.sync_db_keys to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task smb.sharesec.check_share_info_tdb to run every 3600 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task truecommand.health_check to run every 1800 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task zettarepl.flush_state to run every 3600 seconds
[2021/02/09 12:56:17] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec74e5b0>
[2021/02/09 12:56:18] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec4eae80>
[2021/02/09 12:56:19] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec742700>
[2021/02/09 12:56:19] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dd4437040>
[2021/02/09 12:56:19] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec40d880>
[2021/02/09 12:56:20] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec19ab50>
[2021/02/09 12:57:05] (ERROR) ServiceService._restart():204 - Failed before stop action for 'kubernetes' service
[2021/02/09 12:57:05] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec477340>
[2021/02/09 12:57:05] (ERROR) asyncio.default_exception_handler():1738 - Unclosed connector
connections: ['[(<aiohttp.client_proto.ResponseHandler object at 0x7f2dec149e80>, 176.368299567)]']
connector: <aiohttp.connector.TCPConnector object at 0x7f2dd43f0970>
[2021/02/09 12:57:14] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec4bfb80>
[2021/02/09 12:57:49] (ERROR) DockerImagesService.check_update():29 - [EFAULT] Failed to retrieve digest: [EFAULT] Unable to retrieve latest image digest for 'k8scsi/csi-snapshotter:v2.0.1': Unable to parse response: 0, message='Attempt to decode JSON with unexpected mimetype: application/vnd.docker.distribution.manifest.v1+prettyjws', url=URL('https://quay.io/v2/k8scsi/csi-snapshotter/manifests/v2.0.1')
[2021/02/09 12:57:49] (ERROR) DockerImagesService.check_update():29 - [EFAULT] Failed to retrieve digest: [EFAULT] Unable to retrieve latest image digest for 'k8scsi/snapshot-controller:v2.0.1': Unable to parse response: 0, message='Attempt to decode JSON with unexpected mimetype: application/vnd.docker.distribution.manifest.v1+prettyjws', url=URL('https://quay.io/v2/k8scsi/snapshot-controller/manifests/v2.0.1')
[2021/02/09 12:57:50] (ERROR) DockerImagesService.check_update():29 - [EFAULT] Failed to retrieve digest: [EFAULT] Unable to retrieve latest image digest for 'k8scsi/csi-resizer:v0.4.0': Unable to parse response: 0, message='Attempt to decode JSON with unexpected mimetype: application/vnd.docker.distribution.manifest.v1+prettyjws', url=URL('https://quay.io/v2/k8scsi/csi-resizer/manifests/v0.4.0')


[mod note- edited for code tags -jg]
 
Last edited by a moderator:
D

Daniel Claesson

Dabbler
Joined
May 31, 2016
Messages
35
Here are the "messages" since last reboot.

Code:
[2021/02/09 12:02:42] (DEBUG) UsageService.start():66 - Scheduled next run in 61361 seconds
[2021/02/09 12:52:58] (DEBUG) middlewared.status():386 - Failed to retrieve VM status for 'UbuntuTest'
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vms.py", line 384, in status
    return self._status(vm['name'])
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vm_supervisor.py", line 77, in _status
    self._check_setup_connection()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/connection.py", line 43, in _check_setup_connection
    self.middleware.call_sync('vm.setup_libvirt_connection', 10)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1293, in call_sync
    return methodobj(*prepared_call.args)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 49, in setup_libvirt_connection
    self.middleware.call_sync('vm.wait_for_libvirtd', timeout)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1282, in call_sync
    return self.run_coroutine(methodobj(*prepared_call.args))
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1322, in run_coroutine
    return fut.result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
    return self.__get_result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 39, in wait_for_libvirtd
    await asyncio.wait_for(libvirtd_started(self.middleware), timeout=timeout)
  File "/usr/lib/python3.9/asyncio/tasks.py", line 481, in wait_for
    return fut.result()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 33, in libvirtd_started
    await middleware.call('service.start', 'libvirtd')
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1266, in call
    return await self._call(
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1223, in _call
    return await methodobj(*prepared_call.args)
  File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 999, in nf
    return await f(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service.py", line 123, in start
    await service_object.start()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base.py", line 76, in start
    return await self._start_linux()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 47, in _start_linux
    await self._unit_action("Start")
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 67, in _unit_action
    return await self.middleware.run_in_thread(self._unit_action_sync, action, wait, timeout)
  File "/usr/lib/python3/dist-packages/middlewared/utils/run_in_thread.py", line 10, in run_in_thread
    return await self.loop.run_in_executor(self.run_in_thread_executor, functools.partial(method, *args, **kwargs))
  File "/usr/lib/python3/dist-packages/middlewared/utils/io_thread_pool_executor.py", line 25, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 71, in _unit_action_sync
    job = getattr(unit.Unit, action)(b"replace")
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 191, in _call
    return func(self, name, *args)
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 161, in _call_method
    return self._auto_call_dbus_method(method_name, in_args, *args)
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 180, in _auto_call_dbus_method
    return bus.call_method(
  File "pystemd/dbuslib.pyx", line 442, in pystemd.dbuslib.DBus.call_method
pystemd.dbusexc.DBusBaseError: b'org.freedesktop.systemd1.TransactionIsDestructive'[err -35]: b"Transaction for libvirtd.service/start is destructive (systemd-sysctl.service has 'stop' job queued, but 'start' is included in transaction)."
This is DBusBaseError, a base error for DBus (i bet you did not see that coming) if you need a special error, enhance pystemd.sysdexc module!.
[2021/02/09 12:52:58] (DEBUG) middlewared.__event_system_ready():169 - VM(s) stopped successfully
[2021/02/09 12:52:59] (INFO) middlewared.terminate():1536 - Terminating
[2021/02/09 12:52:59] (DEBUG) middlewared.status():386 - Failed to retrieve VM status for 'UbuntuTest'
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vms.py", line 384, in status
    return self._status(vm['name'])
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/vm_supervisor.py", line 77, in _status
    self._check_setup_connection()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/connection.py", line 43, in _check_setup_connection
    self.middleware.call_sync('vm.setup_libvirt_connection', 10)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1293, in call_sync
    return methodobj(*prepared_call.args)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 49, in setup_libvirt_connection
    self.middleware.call_sync('vm.wait_for_libvirtd', timeout)
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1282, in call_sync
    return self.run_coroutine(methodobj(*prepared_call.args))
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1322, in run_coroutine
    return fut.result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 433, in result
    return self.__get_result()
  File "/usr/lib/python3.9/concurrent/futures/_base.py", line 389, in __get_result
    raise self._exception
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 39, in wait_for_libvirtd
    await asyncio.wait_for(libvirtd_started(self.middleware), timeout=timeout)
  File "/usr/lib/python3.9/asyncio/tasks.py", line 481, in wait_for
    return fut.result()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/vm/lifecycle.py", line 33, in libvirtd_started
    await middleware.call('service.start', 'libvirtd')
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1266, in call
    return await self._call(
  File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1223, in _call
    return await methodobj(*prepared_call.args)
  File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 999, in nf
    return await f(*args, **kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service.py", line 123, in start
    await service_object.start()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base.py", line 76, in start
    return await self._start_linux()
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 47, in _start_linux
    await self._unit_action("Start")
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 67, in _unit_action
    return await self.middleware.run_in_thread(self._unit_action_sync, action, wait, timeout)
  File "/usr/lib/python3/dist-packages/middlewared/utils/run_in_thread.py", line 10, in run_in_thread
    return await self.loop.run_in_executor(self.run_in_thread_executor, functools.partial(method, *args, **kwargs))
  File "/usr/lib/python3/dist-packages/middlewared/utils/io_thread_pool_executor.py", line 25, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/lib/python3/dist-packages/middlewared/plugins/service_/services/base_linux.py", line 71, in _unit_action_sync
    job = getattr(unit.Unit, action)(b"replace")
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 191, in _call
    return func(self, name, *args)
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 161, in _call_method
    return self._auto_call_dbus_method(method_name, in_args, *args)
  File "/usr/lib/python3/dist-packages/pystemd/base.py", line 180, in _auto_call_dbus_method
    return bus.call_method(
  File "pystemd/dbuslib.pyx", line 442, in pystemd.dbuslib.DBus.call_method
pystemd.dbusexc.DBusBaseError: b'org.freedesktop.systemd1.TransactionIsDestructive'[err -35]: b"Transaction for libvirtd.service/start is destructive (virtlogd.socket has 'stop' job queued, but 'start' is included in transaction)."
This is DBusBaseError, a base error for DBus (i bet you did not see that coming) if you need a special error, enhance pystemd.sysdexc module!.
[2021/02/09 12:54:29] (INFO) middlewared.__init__():818 - Starting TrueNAS-SCALE-21.02-MASTER-20210206-092917 middleware
[2021/02/09 12:54:37] (DEBUG) middlewared.utils.plugins.load_modules():29 - Registering new module path '/usr/local/lib/middlewared_truenas'
[2021/02/09 12:54:39] (DEBUG) middlewared.setup():1759 - Timezone set to Europe/Stockholm
[2021/02/09 12:54:42] (DEBUG) middlewared.setup():2843 - Certificate setup for System complete
[2021/02/09 12:54:50] (DEBUG) middlewared.__plugins_setup():935 - All plugins loaded
[2021/02/09 12:54:50] (DEBUG) middlewared.__initialize():1530 - Accepting connections
[2021/02/09 12:54:51] (INFO) DiskService.sync_all():94 - Found disks: {'sda': {'name': 'sda', 'ident': 'S301DQC7', 'lunid': '5000c50080a0a1e7', 'serial': 'S301DQC7'}, 'sdb': {'name': 'sdb', 'ident': 'ZDH06MPF', 'lunid': '5000c50092d754a4', 'serial': 'ZDH06MPF'}, 'sdc': {'name': 'sdc', 'ident': 'WD-WCC133YHCD2L', 'lunid': '50014ee262443d23', 'serial': 'WD-WCC133YHCD2L'}, 'sdd': {'name': 'sdd', 'ident': 'WD-WCC133YHC5AR', 'lunid': '50014ee2b79a029a', 'serial': 'WD-WCC133YHC5AR'}, 'sde': {'name': 'sde', 'ident': 'PHDV652101C4150MGN', 'lunid': '55cd2e414d5c664e', 'serial': 'PHDV652101C4150MGN'}, 'sdf': {'name': 'sdf', 'ident': 'S21PNSBG115811J', 'lunid': '5002538da0154075', 'serial': 'S21PNSBG115811J'}}
[2021/02/09 12:54:51] (INFO) InterfaceService.sync():1941 - Interfaces in database: NONE
[2021/02/09 12:54:54] (DEBUG) EtcService.generate():437 - No new changes for /etc/smbusername.map
[2021/02/09 12:54:56] (DEBUG) EtcService.generate():437 - No new changes for /etc/group
[2021/02/09 12:54:56] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/passwd
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/shadow
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/fstab
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/krb5.conf
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/keyboard
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/openldap/ldap.conf
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/nfs-common
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/nsswitch.conf
[2021/02/09 12:54:57] (DEBUG) EtcService.generate():437 - No new changes for /etc/nslcd.conf
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/common-session-noninteractive
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/common-password
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/common-account
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/common-session
[2021/02/09 12:54:58] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:54:58] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:54:58] (DEBUG) EtcService.generate():437 - No new changes for /etc/proftpd/proftpd.conf
[2021/02/09 12:54:58] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:54:59] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/kdump-tools
[2021/02/09 12:55:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/apache2/apache2.conf
[2021/02/09 12:55:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/keepalived/keepalived.conf
[2021/02/09 12:55:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/motd
[2021/02/09 12:55:01] (DEBUG) middlewared.render_body():34 - UPSMON: monpwd field empty, upsmon will fail to start.
[2021/02/09 12:55:07] (DEBUG) EtcService.generate():437 - No new changes for /etc/smb4.conf
[2021/02/09 12:55:07] (DEBUG) EtcService.generate():437 - No new changes for /etc/snmp/snmpd.conf
[2021/02/09 12:55:08] (DEBUG) EtcService.generate():437 - No new changes for /etc/sudoers
[2021/02/09 12:55:08] (DEBUG) EtcService.generate():437 - No new changes for /etc/hosts
[2021/02/09 12:55:09] (DEBUG) EtcService.generate():437 - No new changes for /etc/pam.d/sshd
[2021/02/09 12:55:09] (DEBUG) EtcService.generate():386 - mako:local/users.oath file removed.
[2021/02/09 12:55:09] (DEBUG) EtcService.generate():437 - No new changes for /etc/ntp.conf
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/inadyn.conf
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/aliases
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():386 - mako:local/openvpn/server/server.conf file removed.
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():386 - mako:local/openvpn/client/client.conf file removed.
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/pykmip/pykmip.conf
[2021/02/09 12:55:10] (DEBUG) EtcService.generate():386 - mako:wireguard/wg0.conf file removed.
[2021/02/09 12:55:22] (INFO) RouteService.sync():2151 - Changing IPv4 default route from 192.168.10.1 to 192.168.5.1
[2021/02/09 12:55:22] (DEBUG) EtcService.generate():437 - No new changes for /etc/nginx/nginx.conf
[2021/02/09 12:55:22] (DEBUG) EtcService.generate():437 - No new changes for /etc/avahi/avahi-daemon.conf
[2021/02/09 12:55:33] (DEBUG) middlewared.plugins.disk_.zfs_guid.sync_zfs_guid():44 - Setting disk '{serial_lunid}WD-WCC133YHC5AR_50014ee2b79a029a' zfs_guid '5305080093683576321'
[2021/02/09 12:55:34] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:55:34] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:55:34] (DEBUG) EnclosureService.sync_zpool():240 - Enclosure not found, skipping enclosure sync
[2021/02/09 12:55:35] (DEBUG) EtcService.generate():437 - No new changes for /etc/ssh/sshd_config
[2021/02/09 12:55:48] (DEBUG) EtcService.generate():437 - No new changes for /etc/glusterfs/glusterd.vol
[2021/02/09 12:55:51] (DEBUG) EtcService.generate():437 - No new changes for /etc/smb4.conf
[2021/02/09 12:55:51] (DEBUG) EtcService.generate():437 - No new changes for /etc/security/pam_winbind.conf
[2021/02/09 12:55:52] (DEBUG) EtcService.generate():437 - No new changes for /etc/smbusername.map
[2021/02/09 12:55:54] (DEBUG) EtcService.generate():437 - No new changes for /etc/group
[2021/02/09 12:55:55] (DEBUG) EtcService.generate():437 - No new changes for /etc/passwd
[2021/02/09 12:55:55] (DEBUG) EtcService.generate():437 - No new changes for /etc/shadow
[2021/02/09 12:55:57] (DEBUG) EtcService.generate():386 - mako:ganesha/ganesha.conf file removed.
[2021/02/09 12:55:59] (DEBUG) EtcService.generate():437 - No new changes for /etc/scst.conf
[2021/02/09 12:56:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/apache2/Includes/webdav.conf
[2021/02/09 12:56:00] (DEBUG) EtcService.generate():437 - No new changes for /etc/glusterfs/glusterd.vol
[2021/02/09 12:56:01] (DEBUG) EtcService.generate():437 - No new changes for /etc/collectd/collectd.conf
[2021/02/09 12:56:02] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/rrdcached
[2021/02/09 12:56:03] (DEBUG) EtcService.generate():437 - No new changes for /etc/rsyncd.conf
[2021/02/09 12:56:03] (DEBUG) EtcService.generate():437 - No new changes for /etc/security/pam_winbind.conf
[2021/02/09 12:56:08] (DEBUG) EtcService.generate():437 - No new changes for /etc/ctdb/ctdb.conf
[2021/02/09 12:56:09] (DEBUG) EtcService.generate():437 - No new changes for /etc/apache2/apache2.conf
[2021/02/09 12:56:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/proftpd/proftpd.conf
[2021/02/09 12:56:10] (DEBUG) EtcService.generate():437 - No new changes for /etc/default/nfs-common
[2021/02/09 12:56:11] (DEBUG) EtcService.generate():437 - No new changes for /etc/apache2/Includes/webdav.conf
[2021/02/09 12:56:12] (DEBUG) EtcService.generate():386 - mako:ganesha/ganesha.conf file removed.
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task alert.flush_alerts to run every 3600 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task alert.process_alerts to run every 60 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task certificate.renew_certs to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task certificateauthority.crl_generation to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task chart.release.periodic_chart_releases_update_checks to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task kerberos.keytab.check_updated_keytab to run every 3600 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task kmip.sync_keys to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task mail.send_mail_queue to run every 600 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task pool.dataset.sync_db_keys to run every 86400 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task smb.sharesec.check_share_info_tdb to run every 3600 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task truecommand.health_check to run every 1800 seconds
[2021/02/09 12:56:14] (DEBUG) middlewared._setup_periodic_tasks():948 - Setting up periodic task zettarepl.flush_state to run every 3600 seconds
[2021/02/09 12:56:17] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec74e5b0>
[2021/02/09 12:56:18] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec4eae80>
[2021/02/09 12:56:19] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec742700>
[2021/02/09 12:56:19] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dd4437040>
[2021/02/09 12:56:19] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec40d880>
[2021/02/09 12:56:20] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec19ab50>
[2021/02/09 12:57:05] (ERROR) ServiceService._restart():204 - Failed before stop action for 'kubernetes' service
[2021/02/09 12:57:05] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec477340>
[2021/02/09 12:57:05] (ERROR) asyncio.default_exception_handler():1738 - Unclosed connector
connections: ['[(<aiohttp.client_proto.ResponseHandler object at 0x7f2dec149e80>, 176.368299567)]']
connector: <aiohttp.connector.TCPConnector object at 0x7f2dd43f0970>
[2021/02/09 12:57:14] (ERROR) asyncio.default_exception_handler():1738 - Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f2dec4bfb80>
[2021/02/09 12:57:49] (ERROR) DockerImagesService.check_update():29 - [EFAULT] Failed to retrieve digest: [EFAULT] Unable to retrieve latest image digest for 'k8scsi/csi-snapshotter:v2.0.1': Unable to parse response: 0, message='Attempt to decode JSON with unexpected mimetype: application/vnd.docker.distribution.manifest.v1+prettyjws', url=URL('https://quay.io/v2/k8scsi/csi-snapshotter/manifests/v2.0.1')
[2021/02/09 12:57:49] (ERROR) DockerImagesService.check_update():29 - [EFAULT] Failed to retrieve digest: [EFAULT] Unable to retrieve latest image digest for 'k8scsi/snapshot-controller:v2.0.1': Unable to parse response: 0, message='Attempt to decode JSON with unexpected mimetype: application/vnd.docker.distribution.manifest.v1+prettyjws', url=URL('https://quay.io/v2/k8scsi/snapshot-controller/manifests/v2.0.1')
[2021/02/09 12:57:50] (ERROR) DockerImagesService.check_update():29 - [EFAULT] Failed to retrieve digest: [EFAULT] Unable to retrieve latest image digest for 'k8scsi/csi-resizer:v0.4.0': Unable to parse response: 0, message='Attempt to decode JSON with unexpected mimetype: application/vnd.docker.distribution.manifest.v1+prettyjws', url=URL('https://quay.io/v2/k8scsi/csi-resizer/manifests/v0.4.0')


[mod note - edited for code tags -jg]
 
Last edited by a moderator:
D

Daniel Claesson

Dabbler
Joined
May 31, 2016
Messages
35
ornias

ornias

Wizard
Joined
Mar 6, 2020
Messages
1,458
@Daniel Claesson
Anyway:
The error seems to be due to a VM you're running.
Maybe try removing/disabling said VM and try restarting middlewared afterwards.

That being said:
It's worth fileing a bugreport on Jira about it.
 
D

Daniel Claesson

Dabbler
Joined
May 31, 2016
Messages
35
ornias said:
@Daniel Claesson
Anyway:
The error seems to be due to a VM you're running.
Maybe try removing/disabling said VM and try restarting middlewared afterwards.

That being said:
It's worth fileing a bugreport on Jira about it.
Click to expand...

Removed VM and rebooted. Worked for about 2- 3 days then stopped working again.
Will do a fresh install as i have done to much "shootgun fixing" on the install.

Best Regards
Daniel
 
You must log in or register to reply here.

Similar threads

O
Main drive pool no access
Replies
12
Views
1K
oumpa31
O
M
22.02-RC.1 fresh install not working (middleware doesn't start)
Replies
3
Views
3K
marmoset
M
impovich
Telegram notifications
Replies
0
Views
2K
impovich
impovich
W
Middleware Fails to Start, Synchronizing Plugins Account Groups - 22.02-RC.1
Replies
1
Views
1K
Samuel Tai
Samuel Tai
B
Failed to start kubernetes cluster for Applications: 7
Replies
2
Views
2K
Bryon Brinkmann
B
Top