Kubernetes mount command error when restarting on TrueNAS-SCALE-22.02.0.1

Caroxide

Cadet
Joined
Sep 6, 2022
Messages
1
Hello there,

After restarting my TrueNAS-SCALE-22.02.0.1, my applications disappeared, and I cannot install any more apps I get this error:

Error: Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/middlewared/job.py", line 423, in run
await self.future
File "/usr/lib/python3/dist-packages/middlewared/job.py", line 459, in __run_body
rv = await self.method(*([self] + args))
File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 1129, in nf
res = await f(*args, **kwargs)
File "/usr/lib/python3/dist-packages/middlewared/schema.py", line 1261, in nf
return await func(*args, **kwargs)
File "/usr/lib/python3/dist-packages/middlewared/plugins/chart_releases_linux/chart_release.py", line 378, in do_create
await self.middleware.call('kubernetes.validate_k8s_setup')
File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1318, in call
return await self._call(
File "/usr/lib/python3/dist-packages/middlewared/main.py", line 1275, in _call
return await methodobj(*prepared_call.args)
File "/usr/lib/python3/dist-packages/middlewared/plugins/kubernetes_linux/update.py", line 335, in validate_k8s_setup
raise CallError(error)
middlewared.service_exception.CallError: [EFAULT] Kubernetes service is not running.

I tried restoring backup configuration but the problem persist.

Then I tried restarting Kubernetes with the help of this thread (unset Pool, choose Pool)
and another error appeared each tume i unset/choose pool:
Error: [EFAULT] Command mount -t zfs dignac/ix-applications/k3s/kubelet /var/lib/kubelet failed (code 1): filesystem 'dignac/ix-applications/k3s/kubelet' cannot be mounted using 'mount'. Use 'zfs set mountpoint=legacy' or 'zfs mount dignac/ix-applications/k3s/kubelet'. See zfs(8) for more information.
We see in the log the error appearing after restart. I put the debug in attached.
I also tried thoses 2 commands in SSH
root@truenas[/mnt]# zfs mount dignac/ix-applications/k3s/kubelet
cannot mount 'dignac/ix-applications/k3s/kubelet': filesystem already mounted
root@truenas[/mnt]# zfs set mountpoint=legacy dignac
cannot unmount '/mnt/dignac/ix-applications/docker': pool or dataset is busy
I think docker is used everywhere in truenas Scale so i'm a little lost.
Don't really know how to solve my problem.

my config:
OS Version:TrueNAS-SCALE-22.02.0.1
Motherboard: Asrock H61iCAFE
CPU:Intel(R) Core(TM) i5-3570 CPU @ 3.40GHz
Memory: 4x4GB 1R8 PC3-12800U
HDD: 2x 4TB SATA 3.5'' Seagate IronWolf red
 

Attachments

  • 1662466630200.png
    1662466630200.png
    196.5 KB · Views: 108
  • debug-truenas-20220906133826.tgz
    14.6 MB · Views: 92
  • debug-truenas-20220906133826.tgz
    14.6 MB · Views: 91
  • debug-truenas-20220906133826.tgz
    14.6 MB · Views: 84
  • debug-truenas-20220906133826.tgz
    14.6 MB · Views: 88
Top