Disk Devices Changing on Boot with trying to replace failed Disk

[RodSweet]

My TrueNAS is TrueNAS-SCALE-22.12.0, it is installed on an Intel 1U with 4 12GB Seagate Disks. One of these disks failed (/dev/sdb). I set the disk to offline and shut down the server to swap out the disk (I don't have hot swap capability). I pull the bad disk, plug in the new disk, start system and the ZVOL is gone, even checked if I could import it, doesn't show up. The disks are also no longer in the proper order. The new disk sometimes comes back as /dev/sdd or /dev/sde, etc.

I have looked through the forums, and searched using google.com and cannot find anything like this. Any help would be appreciated. The system right now is running RAID-1Z right now, thinking of dumping everything and rebuild with another parity disk. But that doesn't fix this problem when disks fail.

 

[sretalla]

Disk identifiers are not important.

ZFS uses partition UUIDs (gptids) to identify pool members, so you don't need to care about sda/sdb/sdx...

 

[sretalla]

I pull the bad disk, plug in the new disk, start system and the ZVOL is gone

That's a completely different issue than the one about identifiers...
What is zpool status teling you?

 

[RodSweet]

The First Output is with the defective drive still in place, the second is after powering off the system, removing the defective disk and installing a new disk, and powering on.

pool: boot-pool
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 00:11:01 with 0 errors on Mon Jan 16 03:56:03 2023
config:

NAME STATE READ WRITE CKSUM
boot-pool ONLINE 0 0 0
sde3 ONLINE 0 0 0

errors: No known data errors

pool: storage
state: DEGRADED
status: One or more devices has been taken offline by the administrator.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Online the device using 'zpool online' or replace the device with
'zpool replace'.
scan: resilvered 0B in 06:16:38 with 0 errors on Mon Jan 16 21:59:07 2023
config:

NAME STATE READ WRITE CKSUM
storage DEGRADED 0 0 0
raidz1-0 DEGRADED 0 0 0
f59e8315-9a28-436a-83c9-a02418e2449b OFFLINE 0 0 0
5765dd4f-23b4-4e84-9ed7-a1c6761ea417 ONLINE 0 0 0
2aeff12f-5b2f-4fa9-b9be-11c5d46ec558 ONLINE 0 0 0
035e2182-5baa-4155-b4e1-03ce6afc7912 ONLINE 0 0 0
logs
17674a8f-583b-4057-9321-f8a56d4e8190 ONLINE 0 0 0

New Disk in pool disappears:

pool: boot-pool
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 00:11:01 with 0 errors on Mon Jan 16 03:56:03 2023
config:

NAME STATE READ WRITE CKSUM
boot-pool ONLINE 0 0 0
sde3 ONLINE 0 0 0

errors: No known data errors

 

[RodSweet]

Does anyone have any suggestions for my issue? The help would be greatly appreciated.

 

[sretalla]

With the new disk in place, can you find the pool in the GUI at all?

 

[RodSweet]

No, it just isn't there. Says there are no pools