Issue replacing disk

[onthax]

Having an issue where i replaced a 3TB WD Red in a 4 member raidz pool with a 6TB WD Red

unfortunately the 6tb ended up being a SMR disk and it didn't complete.
I've removed the 6tb red and am now trying to run a replace and get back to the original disk

I've formatted the 3tb disk but i can't add it back in

Code:

ipstore% zpool status
  pool: freenas-boot
 state: ONLINE
  scan: scrub repaired 0 in 0 days 02:12:43 with 0 errors on Sun Jun 14 05:57:43                                                                                                     2020
config:

        NAME        STATE     READ WRITE CKSUM
        freenas-boot  ONLINE       0     0     0
          da0p2     ONLINE       0     0     0

errors: No known data errors

  pool: storage
 state: DEGRADED
status: One or more devices is currently being resilvered.  The pool will
        continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
  scan: resilver in progress since Wed Jun 17 19:13:51 2020
        567G scanned at 345M/s, 73.7G issued at 44.9M/s, 9.75T total
        17.9G resilvered, 0.74% done, 2 days 14:46:58 to go
config:

        NAME                                                  STATE     READ WRI                                                                                                    TE CKSUM
        storage                                               DEGRADED     0                                                                                                         0     0
          raidz1-0                                            DEGRADED     0                                                                                                         0     0
            gptid/09a5ba08-03f5-11e7-9a99-6805ca10bf2d.eli    ONLINE       0                                                                                                         0     0
            gptid/0aa081f0-03f5-11e7-9a99-6805ca10bf2d.eli    ONLINE       0                                                                                                         0     0
            replacing-2                                       DEGRADED     0                                                                                                         0   825
              18108575407481877948                            OFFLINE      0                                                                                                         0     0  was /dev/gptid/0b9ba0d9-03f5-11e7-9a99-6805ca10bf2d.eli
              12202762466873845583                            OFFLINE      0                                                                                                         0     0  was /dev/gptid/51303551-af69-11ea-b064-6805ca10bf2d.eli
              gptid/d53d13e7-b07a-11ea-bc08-6805ca10bf2d.eli  ONLINE       0                                                                                                         0     0
            gptid/0cad4704-03f5-11e7-9a99-6805ca10bf2d.eli    ONLINE       0                                                                                                         0     0

errors: No known data errors

under disks i see ada0 twice
when i try to replace it back in i dont see an option.

Code:

ada0
storage
WD-WCC4N0203016
2.73 TiB


ada0
storage
WD-WX41D995H8KK
5.46 TiB


ada1
storage
WD-WCC4E1227412
3.64 TiB


ada2
storage
WD-WCC4E3VNJUTJ
3.64 TiB


ada3
storage
MJ1313YNG5BGMC
2.73 TiB


da0
Boot Pool

15.63 GiB

any ideas?

 

[Samuel Tai]

You'll probably have to wait for the resilver to fail before trying anything else.

 

[onthax]

Makes sense, will check it tomorrow.

 

[onthax]

the time left is constantly going up.

don't get why, its not reslivering to anything the 6tb has been removed.

or does it do a full check of the FS?

 

[sretalla]

don't get why, its not reslivering to anything the 6tb has been removed.

Maybe this?

I've formatted the 3tb disk

 

[Samuel Tai]

or does it do a full check of the FS?

That's what a resilver is. In this case, for a RAIDZ1, a resilver is scanning all the other members of the pool to reconstruct every sector of the missing member, since parity for each sector is distributed amongst all the members, and it's necessary to XOR the parity with the other data sectors to reconstruct the missing sector. Along the way, checksums are checked and updated, and a new checksum applied to the recreated sector.

Just wait, the resilver will fail as the underlying device is no longer available.

Unfortunately, many people get impatient and try to hurry things along. This is a surefire way to kill your pool. As was said in the Apollo 13 movie: "Let's work the problem. Let's not make things worse by guessing."

 

[onthax]

Thanks for clarifying,
that makes alot of sense.