SOLVED pool missing after swapping out mobo

digity

Contributor
Joined
Apr 24, 2016
Messages
156
I did a mini hardware upgrade of my TrueNAS 12 installation where I swapped out the mobo + CPU (XEON, 1 generation newer), added a new NIC and and an external HBA SAS card. The internal/original HBA card (LSI 9211-8i and Intel SAS Expander), backplane (Norco RPC-4224) and HDDs stayed the same. I brought over the same TrueNAS 12 installation (boot media is mirrored SSDs) and it booted successfully, but one of my pools has a status of offline. I rebooted several times, but still it says offline. All 16 disks are detected by TrueNAS, yet the pool is still showing as offline. Any idea how to troubleshoot or resolve?
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
Output from
zpool status -v
zpool import
dmesg
 

digity

Contributor
Joined
Apr 24, 2016
Messages
156
Output from
zpool status -v
zpool import
dmesg

F me! I thought I removed the log SSD for each pool a while ago, but apparently not. I didn't put them back in for the upgrade and I already reformatted the SSDs for future use (via gparted to NTFS). Please tell me it's still possible to recover this pool?


zpool import

Code:
   pool: coldburn
     id: 7510535709689862774
  state: UNAVAIL
status: One or more devices are missing from the system.
 action: The pool cannot be imported. Attach the missing
        devices and try again.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-6X
 config:

        coldburn                                        UNAVAIL  missing device
          raidz1-0                                      ONLINE
            gptid/9166c7b8-901d-11ea-aab9-00074306af61  ONLINE
            gptid/91c2b1a9-901d-11ea-aab9-00074306af61  ONLINE
            gptid/91b0e63c-901d-11ea-aab9-00074306af61  ONLINE
            gptid/9592855f-901d-11ea-aab9-00074306af61  ONLINE
          raidz1-1                                      ONLINE
            gptid/54656fd0-901f-11ea-aab9-00074306af61  ONLINE
            gptid/57e14110-901f-11ea-aab9-00074306af61  ONLINE
            gptid/5b634b55-901f-11ea-aab9-00074306af61  ONLINE
            gptid/5c88affb-901f-11ea-aab9-00074306af61  ONLINE
          raidz1-2                                      ONLINE
            gptid/8e7e492a-901f-11ea-aab9-00074306af61  ONLINE
            gptid/923a35d7-901f-11ea-aab9-00074306af61  ONLINE
            gptid/964f1767-901f-11ea-aab9-00074306af61  ONLINE
            gptid/9a63cbfc-ac6a-11ea-af36-00074306af61  ONLINE
          raidz1-3                                      ONLINE
            gptid/e1909698-901f-11ea-aab9-00074306af61  ONLINE
            gptid/ecdcac2c-901f-11ea-aab9-00074306af61  ONLINE
            gptid/f5928fee-901f-11ea-aab9-00074306af61  ONLINE
            gptid/f5a29445-901f-11ea-aab9-00074306af61  ONLINE
        logs
          gptid/4c8fefc1-93ba-11ea-aab9-00074306af61    UNAVAIL  cannot open

        Additional devices are known to be part of this pool, though their
        exact configuration cannot be determined.
 

digity

Contributor
Joined
Apr 24, 2016
Messages
156
F me! I thought I removed the log SSD for each pool a while ago, but apparently not. I didn't put them back in for the upgrade and I already reformatted the SSDs for future use (via gparted to NTFS). Please tell me it's still possible to recover this pool?


zpool import

Code:
   pool: coldburn
     id: 7510535709689862774
  state: UNAVAIL
status: One or more devices are missing from the system.
action: The pool cannot be imported. Attach the missing
        devices and try again.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-6X
config:

        coldburn                                        UNAVAIL  missing device
          raidz1-0                                      ONLINE
            gptid/9166c7b8-901d-11ea-aab9-00074306af61  ONLINE
            gptid/91c2b1a9-901d-11ea-aab9-00074306af61  ONLINE
            gptid/91b0e63c-901d-11ea-aab9-00074306af61  ONLINE
            gptid/9592855f-901d-11ea-aab9-00074306af61  ONLINE
          raidz1-1                                      ONLINE
            gptid/54656fd0-901f-11ea-aab9-00074306af61  ONLINE
            gptid/57e14110-901f-11ea-aab9-00074306af61  ONLINE
            gptid/5b634b55-901f-11ea-aab9-00074306af61  ONLINE
            gptid/5c88affb-901f-11ea-aab9-00074306af61  ONLINE
          raidz1-2                                      ONLINE
            gptid/8e7e492a-901f-11ea-aab9-00074306af61  ONLINE
            gptid/923a35d7-901f-11ea-aab9-00074306af61  ONLINE
            gptid/964f1767-901f-11ea-aab9-00074306af61  ONLINE
            gptid/9a63cbfc-ac6a-11ea-af36-00074306af61  ONLINE
          raidz1-3                                      ONLINE
            gptid/e1909698-901f-11ea-aab9-00074306af61  ONLINE
            gptid/ecdcac2c-901f-11ea-aab9-00074306af61  ONLINE
            gptid/f5928fee-901f-11ea-aab9-00074306af61  ONLINE
            gptid/f5a29445-901f-11ea-aab9-00074306af61  ONLINE
        logs
          gptid/4c8fefc1-93ba-11ea-aab9-00074306af61    UNAVAIL  cannot open

        Additional devices are known to be part of this pool, though their
        exact configuration cannot be determined.


SOLVED! I performed the commands below to remove the missing SSD/log device and got the pool back online.


Code:
force import even if a device is missing:
zpool import -m coldburn

check the current status of the pool, note missing device's ID (pool status should now be DEGRADED):
zpool status coldburn

clear error(s) in the pool:
zpool clear coldburn

remove missing device from the pool:
zpool remove coldburn 10376463589963531515

check the current status (should now say ONLINE):
zpool status coldburn
 
Top