[RESOLVED] Can't start k3s after replacing disk

[b4bblefish]

UPDATE
Exporting / importing pool resolved the issue apps are starting up now

Hi All,

I'm in the process of replacing all the drives in my pool to expand storage, however I am now completely unable to start k3s even though I've imported my pool with the ix-systems dataset. No amount of restarting / shutting down fixes this. Any help would be greatly appreciated. I can see in docker all my old app containers still exist, but k3s won't start so my apps page just shows "Applications are not running" I'm fine recreating my apps, but I can't even get that far.

Code:

Jul  9 13:20:38 truenas k3s[914418]: I0709 13:20:38.591120  914418 resource_quota_monitor.go:233] QuotaMonitor created object count evaluator for ingressrouteudps.traefik.containo.us
Jul  9 13:20:38 truenas k3s[914418]: I0709 13:20:38.591138  914418 controllermanager.go:605] Started "resourcequota"
Jul  9 13:20:38 truenas k3s[914418]: I0709 13:20:38.591407  914418 resource_quota_controller.go:273] Starting resource quota controller
Jul  9 13:20:38 truenas k3s[914418]: I0709 13:20:38.591421  914418 shared_informer.go:240] Waiting for caches to sync for resource quota
Jul  9 13:20:38 truenas k3s[914418]: I0709 13:20:38.591440  914418 resource_quota_monitor.go:308] QuotaMonitor running
Jul  9 13:20:38 truenas k3s[914418]: I0709 13:20:38.591551  914418 memory_manager.go:168] "Starting memorymanager" policy="None"
Jul  9 13:20:38 truenas k3s[914418]: I0709 13:20:38.591574  914418 state_mem.go:35] "Initializing new in-memory state store"
Jul  9 13:20:38 truenas k3s[914418]: I0709 13:20:38.591742  914418 state_mem.go:75] "Updated machine memory state"
Jul  9 13:20:38 truenas k3s[914418]: E0709 13:20:38.593005  914418 kubelet.go:1431] "Failed to start ContainerManager" err="invalid kernel flag: vm/overcommit_memory, expected value: 1, actual value: 0"
Jul  9 13:20:44 truenas k3s[924292]: time="2022-07-09T13:20:44-04:00" level=info msg="Starting k3s v1.23.5+k3s-fbfa51e5-dirty (fbfa51e5)"

 

[indivision]

I think the steps in this thread might work for you:

Possible to "reset" Kubernetes?

I seem to have broken my Kubernetes by deleting snapshots. Explained here: https://www.truenas.com/community/threads/how-to-get-rid-of-12000-snapshots.101048/ So, now I have a new question: Is there a way to restore Kubernetes functionality? Perhaps by removing all apps and snapshots and...

www.truenas.com