pool.import_on_boot stuck at 80%

[kabtron]

Hi All - looking for help with my Truenas Scale server. I'm primarily using this machine - an old desktop pc that I "recycled" - as a Plex server and am on TrueNAS-SCALE-22.12.0. I've had an ongoing issue for a while where I'm unable to access any files/apps on the server.

I'm admittedly a novice with servers and followed this guide to set up my machine. There's one pool with two folders/datasets that I've set up - one is a backup folder where I added a set of old files and the other is the media folder that is connected to the Plex app.

With a monitor connected to the server, upon startup/reboot, the normal processes run but I end up having to sit through a 15m 17s Import ZFS Pool job. I'm unsure if this job ever really completes. Startup had never taken this long before, I had been able to get to the web interface right after startup.

After everything's started up and I log into the web interface, I'm not seeing the pool, shares, and apps I've set up... When I check the jobs in progress, it appears I'm stuck on pool.import_on_boot job which is sitting at 80%.

I'm able to ssh in as my admin user, but when I attempt "sudo zpool status" (as well as other zpool commands) and enter my password, nothing happens.
I'm happy to add any further supporting information needed. Hoping to learn more about this little project of mine and hopefully gain access back to my files. Any help is appreciated, Thanks!

Build:

• Boot Drive: Kingston 120GB A400 SATA 3 2.5" Internal SSD SA400S37/120G
• Storage Drives: 3x Western Digital 4TB WD Red Plus NAS Internal Hard Drive HDD - 5400 RPM, SATA 6 Gb/s, CMR, 256 MB Cache, 3.5" -WD40EFPX
• Motherboard: ASUS Prime X370-Pro AMD Ryzen AM4 DDR4 DP HDMI M.2 USB 3.1 ATX X370 Motherboard
• CPU: AMD Ryzen 7 1700X Processor (YD170XBCAEWOF)
• Memory: 2x Corsair Vengeance LPX 16GB (2x8GB) DDR4 DRAM 3000MHz C15 Desktop Memory Kit - Black (CMK16GX4M2B3000C15)

 

[NugentS]

I had a similar issue a while back (mid 2022). It was something to do with the version of TrueNAS that I built the pool on (I think, maybe)

https://ixsystems.atlassian.net/browse/NAS-116688 - but there isn't a resolution. From my PoV - the issue eventually went away, I suspect with an upgrade. However unless you are using an old version whatever the issue was should have been fixed by now. The issue duplicated another issue though.

 

[kabtron]

Just to update the thread, I think I've got a solution to get my files back. I learned quite a bit along the way and wanted to share.

It looks like some data in my single pool had been corrupted. I'm thinking this was due to an abrupt power outage/system shutdown.

As mentioned in the first post, pool.import_on_boot was stuck and I couldn't access any files through my Windows SMB share. I was very concerned about this for a long time as I thought I lost years of data and media.

I took NugentS' (thanks!) advice and attempted to update the Truenas Scale version via the GUI, but it stalled out and failed each attempt. I ended up updating the version manually via USB without issue. Now in the updated version, I attempted to import my config backup but it still had issues importing my pool. I reinstalled the OS again and attempted to import the pool on its own - no luck. I reinstalled the OS once more and attempted to import the pool via ssh commands - no luck either. I reinstalled the OS again and was finally able to import the pool via ssh as read only.

I'm now able to access the read only pool via WinSCP and move/copy my stuff to other storage devices. Once I have everything backed up, I think I will kill the bad pool and start anew.