Pool state is DEGRADED (cannot fix it)

[BGGR]

Hi guys,

I'm new to Freenas.

I had a pool with 2 HDD, and one of them has many failures with the SATA BUS. (HDD2)

I have buy a third disk to replace the faulty, make the replace through the pool status (GUI). But now the Pool have 3 devices the 1st HDD and the 2&3 in replacing move. I cannot send the HDD2 to Offline or any other mode .

when I'm disconnecting the 2HDD the Pool is always DEGRADED (missing the HDD2). I have all my data to the remain HDD 1&3, how can remove the HDD2 from the Pool and have a healthy Pool. (detach not working also)

below a print out:

#####################################################################################
ast login: Sat Nov 28 11:52:04 on pts/1
FreeBSD 11.3-RELEASE-p14 (FreeNAS.amd64) #0 r325575+c936002dbe2(HEAD): Mon Sep 28 10:46:56 EDT 2020

FreeNAS (c) 2009-2020, The FreeNAS Development Team
All rights reserved.
FreeNAS is released under the modified BSD license.

For more information, documentation, help or support, go here:
http://freenas.org
Welcome to FreeNAS

Warning: settings changed through the CLI are not written to
the configuration database and will be reset on reboot.

root@freenas[~]# zpool status -v
pool: Pool1
state: DEGRADED
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://illumos.org/msg/ZFS-8000-8A
scan: resilvered 0 in 0 days 01:39:22 with 2 errors on Sat Nov 28 13:39:05 2020
config:

NAME STATE READ WRITE CKSUM
Pool1 DEGRADED 5 0 0
gptid/54ac3f0e-808a-11ea-8ec2-001e8cd570a8 ONLINE 0 0 0
replacing-1 DEGRADED 10 0 0
2648282656417847195 UNAVAIL 0 0 0 was /dev/gptid/54f031f1-808a-11ea-8ec2-001e8cd570a8
gptid/66f77ff8-2c8f-11eb-9b39-001e8cd570a8 ONLINE 0 010

errors: Permanent errors have been detected in the following files:

/var/db/system/syslog-8f51756b761f415c89e94b71aae947bd/log/middlewared.log
/var/db/system/syslog-8f51756b761f415c89e94b71aae947bd/log/messages

pool: freenas-boot
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
ada0p2 ONLINE 0 0 0

errors: No known data errors
root@freenas[~]# zpool clear Pool1 2648282656417847195
root@freenas[~]# zpool status -v
pool: Pool1
state: DEGRADED
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://illumos.org/msg/ZFS-8000-8A
scan: resilvered 0 in 0 days 01:39:22 with 2 errors on Sat Nov 28 13:39:05 2020
config:

NAME STATE READ WRITE CKSUM
Pool1 DEGRADED 5 0 0
gptid/54ac3f0e-808a-11ea-8ec2-001e8cd570a8 ONLINE 0 0 0
replacing-1 DEGRADED 10 0 0
2648282656417847195 UNAVAIL 0 0 0 was /dev/gptid/54f031f1-808a-11ea-8ec2-001e8cd570a8
gptid/66f77ff8-2c8f-11eb-9b39-001e8cd570a8 ONLINE 0 010

errors: Permanent errors have been detected in the following files:

/var/db/system/syslog-8f51756b761f415c89e94b71aae947bd/log/middlewared.log
/var/db/system/syslog-8f51756b761f415c89e94b71aae947bd/log/messages

pool: freenas-boot
state: ONLINE
scan: none requested
config:


################################################################################################

also update to Truenas always is crushing when is importing the disks.

Thanks

 

[n-buck]

Hello BGGR

I'm also quite new to FreeNas, but I am expiriencing an simular issue.
As I understand it, the two files:

Code:

/var/db/system/syslog-8f51756b761f415c89e94b71aae947bd/log/middlewared.log
/var/db/system/syslog-8f51756b761f415c89e94b71aae947bd/log/messages

are corrupt.
I stumbled upon this thred:

Solved - Stuck in degraded/resilver endless loop

Hi, I've had a disk failure in a ZFS pool. I replaced the disk, it resilvered but always stays in the degraded state: NAME STATE READ WRITE CKSUM storage2 DEGRADED 0 0 3 raidz1-0 DEGRADED 0 0 6 ada2 ONLINE 0 0 0 replacing-1 DEGRADED 0 0 0...

forums.freebsd.org

Somewhere in the answers it tells you to:

1. do zpool status -v Pool1
2. delete the corrupt files it shows
3. try zpool clear Pool1
4. try zpool replace

As I mentioned, I am not very familiar with FreeNas.
But you can read the manual for zpool clear and zpool replace, to get an idea what they do (clear resets the error-count, replace starts the resilvering).

I hope this helps

 

[joeschmuck]

Folks... The number one thing you should do is ensure your data is backed up before doing anything, this way if you mess something up, you can restore your data.

Good Luck

 

[BGGR]

The Data have been Backup......
I have try the zpool clear Pool1 .... is resetting the error but with a system reboot is doing Resilvering and then the same error with this 2 files appears again.

The zpool replace what is doing???

If i try to delete the files from MC (what is your opinion??) will be reconstructed again in normal state????

 

[Heracles]

Hey @BGGR,

From your zpool status, it looks like your pool has no redundancy. So any single failure in it is expected to loose you the entire pool.

I recommend you re-design your pool and ensure to have some redundancy in them. As you are in trouble right now with that pool and just confirmed that your backups are fresh and good, now would be a good moment to destroy that pool and its content, to rebuild it and restore your data in a fresh and more robust pool.

 

[sretalla]

If i try to delete the files from MC (what is your opinion??) will be reconstructed again in normal state????

You may struggle to delete those as the system is logging to them, but if you can delete them, the system should replace them without issue. (whatever content was in them will be missing though, but perhaps that's less important than a healthy pool)