Raidz1 4 disk array with 1 failed disk not showing degraded

[Nyxxon]

Hi all, thanks in advance for reading this post and for trying to help.

(Details of full hardware hardware at the bottom of post)

I have a storage configuration of 4 pools of 1 Vdev in each containing 4 drives. Three of these pools are healthy but I have lost a drive in one of them. After a restart instead of a degraded pool, the whole pool is offline. It is recognized in the early "boot" message but the GUI just shows it as offline with no information, unsurprisingly the pool is also not listed when I do a zpool status from the command line.

When I look in the GUI 3 of the 4 drives in the missing pool are showing as "disks" but with no but with a pool of "N/A", and its showing 2 partitions on each of them available when I go to import disk.

I did a search of the forum but count not find anything relevant, Just after some advice on what to do next, I have seen way too many posts where incorrect actions were taken that could not be reversed.

Server Details
Supermicro X11SAE with Intel(R) Xeon(R) CPU E3-1225 v6 @ 3.30GHz
32gb Ram
Syba SI-PEX40137 HBA
96 TB Raw storage over 4 pools with 4 disks each in RaidZ1
Mirrored 120gb SSD for boot

 

[sretalla]

when I go to import disk

Don't do that... it's for importing non-ZFS disk contents.

You want to look at importing the pool if anything, but we will want to look at zpool status -v first to see what we have.

 

[Nyxxon]

Don't do that... it's for importing non-ZFS disk contents.

You want to look at importing the pool if anything, but we will want to look at zpool status -v first to see what we have.

Sorry I just realized I didn't tell you my version: TrueNAS-12.0-U1.1

Thank you Sretalla, I do apricate the community support, and exactly why I came here :)

Below is the output from zpool status -v, there should be a Raid6Root but there is no trace of it. The only point I see it is in the very early boot messages where it says something like "ZFS found Raid6Root Raid1Root Raid4Root Raid5Root..." (Its a bit quick to see and not in the boot or console log)

=========================================================
pool: Raid1Root
state: ONLINE
config:
NAME STATE READ WRITE CKSUM
Raid1Root ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
gptid/bf69219a-6439-11eb-b90c-3cecef6ec7fb ONLINE 0 0 0
gptid/bfe843f9-6439-11eb-b90c-3cecef6ec7fb ONLINE 0 0 0
gptid/c004614a-6439-11eb-b90c-3cecef6ec7fb ONLINE 0 0 0
gptid/bff7e7d7-6439-11eb-b90c-3cecef6ec7fb ONLINE 0 0 0

errors: No known data errors

pool: Raid4Root
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(5) for details.
scan: scrub repaired 44K in 23:43:45 with 0 errors on Sun Feb 28 23:43:45 2021
config:

NAME STATE READ WRITE CKSUM
Raid4Root ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
gptid/0396b076-3790-11ea-a566-6805ca443bbe ONLINE 0 0 0
gptid/bcad5a15-3545-11ea-9e30-6805ca443bbe ONLINE 0 0 0
gptid/7903d4d2-34e5-11ea-8121-6805ca443bbe ONLINE 0 0 0
gptid/6c08d3e7-13f9-11ea-a608-6805ca443bbe ONLINE 0 0 0

errors: No known data errors

pool: Raid5Root
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(5) for details.
scan: scrub repaired 0B in 01:56:43 with 0 errors on Sun Feb 28 01:56:43 2021
config:

NAME STATE READ WRITE CKSUM
Raid5Root ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
gptid/22b1d32b-1f80-11e8-b1e6-6805ca443bbe ONLINE 0 0 0
gptid/23683efb-1f80-11e8-b1e6-6805ca443bbe ONLINE 0 0 0
gptid/241ea881-1f80-11e8-b1e6-6805ca443bbe ONLINE 0 0 0
gptid/6c8225c7-aa07-11e9-9c58-6805ca443bbe ONLINE 0 0 0

errors: No known data errors

pool: boot-pool
state: ONLINE
scan: scrub repaired 0B in 00:00:03 with 0 errors on Mon Mar 8 03:45:03 2021
config:

NAME STATE READ WRITE CKSUM
boot-pool ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
gptid/6bdd3d75-64ab-11eb-9a99-3cecef6ec7fb ONLINE 0 0 0
gptid/6bec2003-64ab-11eb-9a99-3cecef6ec7fb ONLINE 0 0 0
=========================================================

 

[sretalla]

OK, so we can switch to zpool import to see what we can see about a disconnected pool.

 

[Nyxxon]

hmmmmm, and there appears to be the problem, the missing disk and "corrupted data"

<code>
pool: Raid6Root
id: 7144238306026881436
state: FAULTED
status: One or more devices are missing from the system.
action: The pool cannot be imported. Attach the missing
devices and try again.
The pool may be active on another system, but can be imported using
the '-f' flag.
see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-3C
config:

Raid6Root FAULTED corrupted data
raidz1-0 FAULTED corrupted data
gptid/adcbf427-168d-11e8-acaa-6805ca443bbe UNAVAIL cannot open
gptid/ae825407-168d-11e8-acaa-6805ca443bbe ONLINE
gptid/af4f574e-168d-11e8-acaa-6805ca443bbe ONLINE
gptid/b00f03ec-168d-11e8-acaa-6805ca443bbe ONLINE
</code>

 

[Nyxxon]

Thank you so much sretalla, your guidance put me on the right track, and I can now report that the pool is back online and resilvering :)

If anybody finds this post my solution was to run a

• zpool import -F {pool name}

(After a bit of googling https://serverfault.com/questions/1006855/recover-from-faulted-zfs-pool-f-option-seems-to-be-ignored helped)

I lost 12 seconds of data, but I'm an extremely happy bunny