BoostedIS300
Cadet
- Joined
- Feb 16, 2023
- Messages
- 5
Hello,
Yesterday I started noticing an issue with one of my apps (uptime-kuma) not starting after a system reboot. It would go through the loading screen of starting, reaching 100% but then never deploy. I attempted this multiple times to no avail. I rebooted my system in an attempt to get a clean start and try again, same out come.
When clicking on the app where it shows "app events" the below error was listed:
Decided to just try and delete the app and reinstall, but it would get stuck at 50% and not pass the "scaling down to 0 pods", or what ever message. Waited for a good while then rebooted again (full power down). The app is gone but will not let me install.
After this reboot, another app (thelounge) is doing the same thing (same MountVolume error). Doing the above steps again for thelounge, but now attempting to reinstall thelounge gives me the below error. It says something about it being terminated but the app is already gone from the apps page and will not let me install it.
Thanks for any help in advance.
OS Version: TrueNAS-SCALE-22.12.4.2
Product :X9DRi-LN4+/X9DR3-LN4+
Model: Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Memory: 126 GiB
Yesterday I started noticing an issue with one of my apps (uptime-kuma) not starting after a system reboot. It would go through the loading screen of starting, reaching 100% but then never deploy. I attempted this multiple times to no avail. I rebooted my system in an attempt to get a clean start and try again, same out come.
When clicking on the app where it shows "app events" the below error was listed:
MountVolume.MountDevice failed for volume "pvc-d46767f6-b96b-4608-91cd-6739b1eac12b" : kubernetes.io/csi: attacher.MountDevice failed to create newCsiDriverClient: driver name zfs.csi.openebs.io not found in the list of registered CSI drivers
Decided to just try and delete the app and reinstall, but it would get stuck at 50% and not pass the "scaling down to 0 pods", or what ever message. Waited for a good while then rebooted again (full power down). The app is gone but will not let me install.
After this reboot, another app (thelounge) is doing the same thing (same MountVolume error). Doing the above steps again for thelounge, but now attempting to reinstall thelounge gives me the below error. It says something about it being terminated but the app is already gone from the apps page and will not let me install it.
[EFAULT] Failed to install chart release: Error: INSTALLATION FAILED: create: failed to create: secrets "sh.helm.release.v1.thelounge.v1" is forbidden: unable to create new content in namespace ix-thelounge because it is being terminated
More info...
Not sure if it is related, but I did update to TrueNAS-SCALE-22.12.4.2 about a week ago from (I believe) 22.12.3Error: Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/middlewared/job.py", line 427, in run
await self.future
File "/usr/lib/python3/dist-packages/middlewared/job.py", line 465, in __run_body
rv = await self.method(*([self] + args))
File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 1247, in nf
res = await f(*args, **kwargs)
File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 1379, in nf
return await func(*args, **kwargs)
File "/usr/lib/python3/dist-packages/middlewared/plugins/chart_releases_linux/chart_release.py", line 486, in do_create
await self.middleware.call(
File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1368, in call
return await self._call(
File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1328, in _call
return await self.run_in_executor(prepared_call.executor, methodobj, *prepared_call.args)
File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1231, in run_in_executor
return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
File "/usr/lib/python3.9/concurrent/futures/thread.py", line 52, in run
result = self.fn(*self.args, **self.kwargs)
File "/usr/lib/python3/dist-packages/middlewared/plugins/chart_releases_linux/helm.py", line 44, in helm_action
raise CallError(f'Failed to {tn_action} chart release: {stderr.decode()}')
middlewared.service_exception.CallError: [EFAULT] Failed to install chart release: Error: INSTALLATION FAILED: create: failed to create: secrets "sh.helm.release.v1.thelounge.v1" is forbidden: unable to create new content in namespace ix-thelounge because it is being terminated
Thanks for any help in advance.
OS Version: TrueNAS-SCALE-22.12.4.2
Product :X9DRi-LN4+/X9DR3-LN4+
Model: Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz
Memory: 126 GiB