Continual Resilver

[GraemeAus]

Hey there,

So I am trying to replace the 6x3TB hard drives with 6x14TB SEAGATE ST14000NM002G drives. Last night I replaced a drive in the pool and left it to resilver overnight. Logging in this morning I can see the process is still running and I know this can take quite some time however I keep seeing the process get to about 22% or 23% and then it restarts from 0.

I have read some other posts and they seem to indicate that it can be due to errors on disks and not being able to rebuild properly. I have got two errors currently:

Code:

Device: /dev/da1 [SAT], 2 Currently unreadable (pending) sectors.
Device: /dev/da0 [SAT], 2 Currently unreadable (pending) sectors.

The mistake I think I have made is I should have replaced one of the disks with errors, instead I replaced da4 which was running fine.

Question: What should I do now, Ideally I would like to try and replace one of the drives with errors but I am worried to try that while the previous disk is still resilvering? Is there a way to safely stop this process and put back in the original da4 drive that was working and restart the whole process on da0 or da1?

Let me know if there is more information required and I'll post back as soon as I can.

Hardware Spes

• Motherboard make and model: Dell R510
• CPU make and model: Dual Intel(R) Xeon(R) CPU E5640 @ 2.67GHz
• RAM quantity: 128 GBs
• Hard drives, quantity, model numbers, and RAID configuration, including boot drives
  • RAIDZ2 - Pool - Home-Nas
  • 6x 3TB WD RED - WDC WD30EFRX-68E
  • 6x 4TB WD Red - WD40EFRX-68N
  • SSD - Pool - Fast-Storage
  • OCZ-AGILITY3
• Hard disk controllers: LSI SAS 9211-8i 8-port 6Gb/s PCI-E
• Network cards: built-in MB nic

Zpool status -v output

Code:

root@PROD-FNAS01:~ # zpool status -v
  pool: Fast-Storage
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
        still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(7) for details.
  scan: scrub repaired 0 in 0 days 00:00:22 with 0 errors on Sun Aug 23 00:00:22 2020
config:

        NAME                                          STATE     READ WRITE CKSUM
        Fast-Storage                                  ONLINE       0     0     0
          gptid/2ed9bb0c-532c-11e7-8e4b-782bcb1352a5  ONLINE       0     0     0

errors: No known data errors

  pool: Home-NAS
 state: DEGRADED
status: One or more devices is currently being resilvered.  The pool will
        continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
  scan: resilver in progress since Thu Sep 10 07:45:52 2020
        17.0T scanned at 2.92G/s, 7.50T issued at 3.89G/s, 36.0T total
        53.7G resilvered, 20.82% done, 0 days 02:05:11 to go
config:

        NAME                                              STATE     READ WRITE CKSUM
        Home-NAS                                          DEGRADED     0     0   0
          raidz2-0                                        DEGRADED     0     0   0
            gptid/c44244ae-4d8a-11e7-bf89-782bcb1352a5    ONLINE       0     0   0
            gptid/c50613f2-4d8a-11e7-bf89-782bcb1352a5    ONLINE     271   313   1
            gptid/c5c60c2d-4d8a-11e7-bf89-782bcb1352a5    ONLINE       0     0   0
            gptid/83fd2765-583b-11e9-879b-782bcb1352a5    ONLINE       0     0   0
            gptid/78cb23c4-ec71-11e7-acc8-782bcb1352a5    ONLINE       0     0   0
            replacing-5                                   OFFLINE      0     0   0
              11223942478955095176                        OFFLINE      0     0   0  was /dev/gptid/c8ebbc02-531b-11e7-ae7b-782bcb1352a5
              gptid/e6489005-f28a-11ea-a197-782bcb1352a5  ONLINE       0     0   0
          raidz2-1                                        ONLINE       0     0   0
            gptid/74160e48-583c-11e9-879b-782bcb1352a5    ONLINE       0     0   0
            gptid/75268ed2-583c-11e9-879b-782bcb1352a5    ONLINE       0     0   0
            gptid/763038e5-583c-11e9-879b-782bcb1352a5    ONLINE       0     0   0
            gptid/773ccaab-583c-11e9-879b-782bcb1352a5    ONLINE       0     0   0
            gptid/78403da3-583c-11e9-879b-782bcb1352a5    ONLINE       0     0   0
            gptid/794de5d3-583c-11e9-879b-782bcb1352a5    ONLINE       0     0   0

errors: No known data errors

  pool: freenas-boot
 state: ONLINE
  scan: scrub repaired 0 in 0 days 00:46:07 with 0 errors on Wed Sep  9 04:31:08 2020
config: