Checksum Errors: Tank <0x0>

[Wronglebowski]

Hello all, I've got a degraded array I'm trying to sort our and I'm not sure how to proceed. I had a controller failure which caused a bunch of write errors that resulted in Checksum Errors. I've done a ton of Scrubs but I can't figure out what files are actually bad. This is what my status looks like.

Code:

root@truenas[~]# zpool status -v Starter
  pool: Starter
 state: DEGRADED
status: One or more devices has experienced an error resulting in data
        corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
        entire pool from backup.
   see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-8A
  scan: scrub repaired 0B in 1 days 06:17:25 with 9 errors on Thu Mar 18 06:39:24 2021
remove: Removal of vdev 10 copied 671G in 1h6m, completed on Tue Mar 16 00:09:54 2021
    15.6M memory used for removed device mappings
config:

        NAME                                            STATE     READ WRITE CKSUM
        Starter                                         DEGRADED     0     0 0
          mirror-1                                      ONLINE       0     0 0
            gptid/f8169c3d-521c-11eb-9d3b-001b2141b43f  ONLINE       0     0 0
            gptid/f826d7f5-521c-11eb-9d3b-001b2141b43f  ONLINE       0     0 0
          mirror-4                                      ONLINE       0     0 0
            gptid/34adb076-53b0-11eb-9200-001b2141b43f  ONLINE       0     0 0
            gptid/34eb5a8a-53b0-11eb-9200-001b2141b43f  ONLINE       0     0 0
          mirror-5                                      ONLINE       0     0 0
            gptid/34c609a4-53b0-11eb-9200-001b2141b43f  ONLINE       0     0 0
            gptid/352ff4be-53b0-11eb-9200-001b2141b43f  ONLINE       0     0 0
          mirror-7                                      ONLINE       0     0 0
            gptid/3464dfdf-5940-11eb-9200-001b2141b43f  ONLINE       0     0 0
            gptid/34753e28-5940-11eb-9200-001b2141b43f  ONLINE       0     0 0
          mirror-8                                      DEGRADED     0     0 0
            gptid/17dd1ce9-5d92-11eb-bfca-001b2141b43f  DEGRADED     0     0   580  too many errors
            gptid/17f51e42-5d92-11eb-bfca-001b2141b43f  DEGRADED     0     0   580  too many errors
          mirror-9                                      DEGRADED     0     0 0
            gptid/bee72909-7ed3-11eb-a488-001b2141b43f  DEGRADED     0     0   580  too many errors
            gptid/bf3c27b7-7ed3-11eb-a488-001b2141b43f  DEGRADED     0     0   580  too many errors
          mirror-11                                     ONLINE       0     0 0
            gptid/57402eaa-8660-11eb-808a-001b2141b43f  ONLINE       0     0 0
            gptid/575166f1-8660-11eb-808a-001b2141b43f  ONLINE       0     0 0
        logs
          gptid/f70b6e8c-521c-11eb-9d3b-001b2141b43f    ONLINE       0     0 0
        cache
          gptid/f64a55d8-521c-11eb-9d3b-001b2141b43f    ONLINE       0     0 0

errors: Permanent errors have been detected in the following files:

        Starter:<0x0>

Is there any way to determine what files <0x0> are referencing? Is there a way to tell TrueNAS to just blow away all checksum failed data?

 

[Samuel Tai]

That's pool metadata. You could try zpool clear Starter to reset the error count, but as you have multiple stripes in your pool with errors, the only surefire fix is to destroy and rebuild the pool, and to reload its contents from backup.

 

[Wronglebowski]

That's pool metadata. You could try zpool clear Starter to reset the error count, but as you have multiple stripes in your pool with errors, the only surefire fix is to destroy and rebuild the pool, and to reload its contents from backup.

Since it's related to the metadata can I be confident my files are healthy? If I manually copied all data via an external host. Like copying from one SMB share to the next. Would the checksum errors come with it?

 

[Samuel Tai]

Since it's related to the metadata can I be confident my files are healthy? If I manually copied all data via an external host. Like copying from one SMB share to the next. Would the checksum errors come with it?

Sorry, no, you can't be confident your files are healthy.