Kubernetes not starting after update RC2->Release

[wittycoder]

After an update from RC2 to RELEASE yesterday, I haven't been able to get apps running, and the kubernetes cluster isn't starting.

I have an alert on the alerts drop-down:

Code:

CRITICAL
Failed to start kubernetes cluster for Applications: [EFAULT] Unable to configure node:
2022-02-24 00:41:56 (America/Los_Angeles)

I also checked in K3S log:

Code:

Feb 24 14:36:37 truenas k3s[351759]: time="2022-02-24T14:36:37.892642420-08:00" level=info msg="Waiting for control-plane node agent startup"
Feb 24 14:36:38 truenas k3s[351759]: time="2022-02-24T14:36:38.750946093-08:00" level=error msg="failed to get CA certs: Get \"https://127.0.0.1:6443/cacerts\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"

I don't know much about kubernetes or internals of certs on TrueNas, I did try to reload certs and look in the standard linux location I had certs:

Code:

sudo update-ca-certificates

root@truenas[/var/log]# ls /usr/local/share/ca-certificates
root@truenas[/var/log]#

 

[wittycoder]

Forgot to mention that after reading other threads, I have tried reboot/wait as well as restarting the middleware and neither has solved the problem for me.

 

[Kris Moore]

Couple of things to check:

1. Make sure you can reach out to public internet, I.E. DNS, gateways, all that works.
2. Ensure that the system time is set properly, if its off that will make https calls fail.

 

[wittycoder]

Thanks! It was the timezone that was off. On the date command, I noticed it was PST and I am MST. Made the change in the UI, restarted middleware, and still no apps. Did a reboot and it's working again.