Upgrade from Bluefin->Cobia : Plex Stuck in Deploying

[Austinbru]

Any help appreciated on the below. I've searched far and wide

Bluefin (Release) -> Cobia (Release)
Plex was working perfectly -> now stuck in deploying

System:
TrueNAS-SCALE-23.10.1
i3-9100

Application: plex
App Version: 1.32.8.7639
Chart Version: 1.7.59

Related Kubernetes: 2024-01-02 21:06:11 Startup probe failed: dial tcp 172.16.0.29:32400: connect: connection refused
2024-01-02 21:05:57 Created container plex
2024-01-02 21:05:57 Started container plex
2024-01-02 21:05:56 Scaled up replica set plex-9cd64f6fc to 1
2024-01-02 21:05:56 Created pod: plex-9cd64f6fc-8qj42
2024-01-02 21:05:56 Successfully assigned ix-plex/plex-9cd64f6fc-8qj42 to ix-truenas
2024-01-02 21:05:56 Add eth0 [172.16.0.29/16] from ix-net
2024-01-02 21:05:56 Container image "plexinc/pms-docker:plexpass" already present on machine
2024-01-02 21:05:15 Scaled down replica set plex-5df88dc6c9 to 0 from 1
2024-01-02 21:05:15 Deleted pod: plex-5df88dc6c9-wcvxm

I have waited overnight as well with no notable changes

 

[Austinbru]

Any thoughts? See below output:

Code:

sudo k3s kubectl get pods,svc -A       
NAMESPACE     NAME                                         READY   STATUS                     RESTARTS   AGE
kube-system   pod/csi-smb-node-hdwt5                       3/3     Running                    0          7m42s
kube-system   pod/csi-nfs-node-588dq                       3/3     Running                    0          7m43s
kube-system   pod/snapshot-controller-546868dfb4-mq8xb     1/1     Running                    0          7m49s
kube-system   pod/snapshot-controller-546868dfb4-gtztc     1/1     Running                    0          7m47s
kube-system   pod/openebs-zfs-node-65q7t                   2/2     Running                    0          2m37s
ix-plex       pod/plex-9cd64f6fc-tlrcq                     0/1     UnexpectedAdmissionError   0          2m9s
kube-system   pod/csi-smb-controller-7fbbb8fb6f-j54x4      3/3     Running                    0          7m47s
kube-system   pod/coredns-59b4f5bbd5-kqhgl                 1/1     Running                    0          7m47s
ix-plex       pod/plex-9cd64f6fc-4ppj6                     0/1     UnexpectedAdmissionError   0          2m8s
ix-plex       pod/plex-9cd64f6fc-pb6qj                     0/1     UnexpectedAdmissionError   0          2m7s
ix-plex       pod/plex-9cd64f6fc-r5q5n                     0/1     UnexpectedAdmissionError   0          2m7s
kube-system   pod/intel-gpu-plugin-wn9zk                   1/1     Running                    0          2m37s
kube-system   pod/csi-nfs-controller-7b74694749-qbf5k      4/4     Running                    0          7m46s
ix-immich     pod/immich-redis-787794c96c-j5cw5            1/1     Running                    0          7m51s
ix-plex       pod/plex-9cd64f6fc-pqks2                     0/1     UnexpectedAdmissionError   0          2m6s
kube-system   pod/openebs-zfs-controller-0                 5/5     Running                    0          7m44s
ix-plex       pod/plex-9cd64f6fc-fpz4k                     0/1     Running                    0          2m4s
ix-immich     pod/immich-postgres-7f6b96444d-vpgsc         1/1     Running                    0          7m45s
ix-immich     pod/immich-56fc6868-8lx6d                    1/1     Running                    0          7m42s
ix-immich     pod/immich-machinelearning-5864fb754-q6q9x   0/1     Running                    0          7m50s
ix-immich     pod/immich-microservices-67f8445997-rxj88    1/1     Running                    0          7m41s

NAMESPACE     NAME                             TYPE        CLUSTER-IP       EXTERNAL-IP   PORT(S)                                                     AGE
default       service/kubernetes               ClusterIP   172.17.0.1       <none>        443/TCP                                                     3d4h
kube-system   service/kube-dns                 ClusterIP   172.17.0.10      <none>        53/UDP,53/TCP,9153/TCP                                      3d4h
ix-immich     service/immich-machinelearning   ClusterIP   172.17.251.223   <none>        32002/TCP                                                   2d1h
ix-immich     service/immich-postgres          ClusterIP   172.17.208.107   <none>        5432/TCP                                                    2d1h
ix-immich     service/immich-redis             ClusterIP   172.17.202.203   <none>        6379/TCP                                                    2d1h
ix-immich     service/immich                   NodePort    172.17.14.57     <none>        30041:30041/TCP                                             2d1h
ix-immich     service/immich-microservices     ClusterIP   172.17.2.8       <none>        32003/TCP                                                   2d1h
ix-plex       service/plex-tcp                 NodePort    172.17.134.70    <none>        32400:32400/TCP,80:36216/TCP,443:63367/TCP,1900:15726/TCP   20h
ix-plex       service/plex-udp                 ClusterIP   172.17.191.207   <none>        1900/UDP,32410/UDP,32412/UDP,32413/UDP,32414/UDP            20h

 

[Austinbru]

I also tried:

-unsetting/reseting the pool to no avail.
-disabling GPU on app settings -> advanced (even though Plex app is set to allocate 0)

 

[LarsR]

There's a GUI caching Bug in Cobia for the apps page. Have you tries force refeshing the Page to see if only the page Shows the deploying state when in reality the app started fine.

 

[Austinbru]

There's a GUI caching Bug in Cobia for the apps page. Have you tries force refeshing the Page to see if only the page Shows the deploying state when in reality the app started fine.

Thank you for actually trying

But yes. I am aware of that bug. I cleared the cache to be sure. But also, I can not access the Web Portal, and the Plex service is unreachable (it was working perfectly fine on Bluefin). Also clearly, the System Shell also sees an issue.

 

[Austinbru]

Anyone having any issues with this? I tried a fresh install as well, still nothing.

Anecdotally, I fired up the TrueCharts version as a back-up, and it is working fine ... but I would prefer to use the official app.

 

[hungarianhc]

I had this same issue. I just had to restart, and then it didn't hang anymore. So far I'm not loving the apps experience w/ Scale, though.

 

[Danielcrex]

i'm having the same issue. Plex and syncthing are stuck in deploying and i'm unable to access web portal.
I tried rebooting, disabling SMB (reported in the past as a solution), disabling GPU. none worked so far.

 

[Austinbru]

@Danielcrex I'm sorry that you're dealing with the same issues. I have not yet been able to resolve this. I've tried everything. Once a fresh install didn't work, I gave up until I hear of an update.

Disabling SMB should have nothing to do with it if you're on Cobia, since they deprecated the Host Path Validation check

 

[mytie13]

I am having the same issue. I have to stop and restart over and over until it goes through.
Just recently updated to

TrueNAS-SCALE-23.10.1.1 and now having even worse of a time.

 

[Austinbru]

@mytie13 Welcome to the party, sorry to hear it. I am still running a TrueCharts version at the moment... not my preference.