Unreadable (pending) sectors vs replication

[markgca]

For the last few days im getting this console message:
Dec 26 08:32:54 freenas.local smartd[3654]: Device: /dev/da9 [SAT], 2 Currently unreadable (pending) sectors

and now it wont let me replicate to that pool; not sure if that is a coincidence or not

if i run a long smart test it doesnt show anything of concern. i thought that drives just waited until it tried to write to a bad sector, then mark it bad and relocate the data if possible; but the replication issue makes me suspicious that there is something else going on that i dont understand about freenas.

thanks for any guidance

 

[sretalla]

It won't be something imaginary...

Based on what you have said, it seems review of cabling to that disk or the SATA controller is in order.

Has anything been moved/touched in the box recently?

How is the airflow/heat in the case?

Can you share the output from smartctl -a /dev/da9 ? It seems a little off that FreeNAS thinks smartd is giving it that information.

 

[blueether]

Can you share the output from smartctl -a /dev/da9 ? It seems a little off that FreeNAS thinks smartd is giving it that information.

and also the output from zpool status would be good (as well as the system specs (inc HBA etc)

 

[markgca]

and also the output from zpool status would be good (as well as the system specs (inc HBA etc)

system specs are in my signature including hba card/LSI 9306 16i

Code:

zpool status:
% zpool status
  pool: NASFeratu
state: ONLINE
  scan: scrub repaired 0 in 0 days 00:49:22 with 0 errors on Thu Dec 26 11:27:43 2019
config:

        NAME                                            STATE     READ WRITE CKSUM
        NASFeratu                                       ONLINE       0     0     0
          mirror-0                                      ONLINE       0     0     0
            gptid/d2ad1e67-0f1f-11ea-8f21-002590badbc2  ONLINE       0     0     0
            gptid/d9755d62-0f1f-11ea-8f21-002590badbc2  ONLINE       0     0     0
          mirror-1                                      ONLINE       0     0     0
            gptid/f002f192-0f1f-11ea-8f21-002590badbc2  ONLINE       0     0     0
            gptid/f30be6d2-0f1f-11ea-8f21-002590badbc2  ONLINE       0     0     0

errors: No known data errors

  pool: freenas-boot
state: ONLINE
  scan: scrub repaired 0 in 0 days 00:00:05 with 0 errors on Sun Dec 22 03:45:05 2019
config:

        NAME        STATE     READ WRITE CKSUM
        freenas-boot  ONLINE       0     0     0
          mirror-0  ONLINE       0     0     0
            ada0p2  ONLINE       0     0     0
            ada1p2  ONLINE       0     0     0

errors: No known data errors

  pool: tank
state: ONLINE
  scan: scrub repaired 0 in 0 days 00:00:17 with 0 errors on Thu Dec  5 11:05:30 2019
config:

        NAME                                                STATE     READ WRITE CKSUM
        tank                                                ONLINE       0     0     0
          raidz3-0                                          ONLINE       0     0     0
            gptid/528853cd-058e-11ea-85f9-002590badbc2.eli  ONLINE       0     0     0
            gptid/571b651b-058e-11ea-85f9-002590badbc2.eli  ONLINE       0     0     0
            gptid/5b0653f0-058e-11ea-85f9-002590badbc2.eli  ONLINE       0     0     0
            gptid/5f8ee135-058e-11ea-85f9-002590badbc2.eli  ONLINE       0     0     0
            gptid/6378e05c-058e-11ea-85f9-002590badbc2.eli  ONLINE       0     0     0
            gptid/6807f356-058e-11ea-85f9-002590badbc2.eli  ONLINE       0     0     0
            gptid/6bf480cd-058e-11ea-85f9-002590badbc2.eli  ONLINE       0     0     0

errors: No known data errors
%

 

[markgca]

It won't be something imaginary...

Based on what you have said, it seems review of cabling to that disk or the SATA controller is in order.

Has anything been moved/touched in the box recently?

How is the airflow/heat in the case?

Can you share the output from smartctl -a /dev/da9 ? It seems a little off that FreeNAS thinks smartd is giving it that information.

box is new; received a couple months ago, been playing with it/testing since then (im new to freenas, so trying everything out; different pool configurations, vm testing etc. Had some issues with dataset sharing, got everything to work except replication)
airflow should be fine; its in a rack with good flow and temps are under 80f

the drive in question is a 4k sector drive i had lying around; perhaps it doesnt like those? its only temporary, im going to replace those with another pool of 16tb drives first of the year. but i was testing replicating to another pool, and thats all i had for spares.

maybe i should power it down and swap a couple drives to see if it follows the slots. but this is a storinator box so the drives just plug into the backplane and the cables are attached there.

Code:

smartctl:
root@freenas[~]# smartctl -a /dev/da9
smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.2-STABLE amd64] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Caviar Green (AF)
Device Model:     WDC WD20EARS-00MVWB0
Serial Number:    WD-WMAZA0071655
LU WWN Device Id: 5 0014ee 002496857
Firmware Version: 50.0AB50
User Capacity:    2,000,398,934,016 bytes [2.00 TB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS (minor revision not indicated)
SATA Version is:  SATA 2.6, 3.0 Gb/s
Local Time is:    Thu Dec 26 22:41:00 2019 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x84) Offline data collection activity
                                        was suspended by an interrupting command from host.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever
                                        been run.
Total time to complete Offline
data collection:                (37200) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        ( 424) minutes.
Conveyance self-test routine
recommended polling time:        (   5) minutes.
SCT capabilities:              (0x3035) SCT Status supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   163   158   021    Pre-fail  Always       -       6833
  4 Start_Stop_Count        0x0032   095   095   000    Old_age   Always       -       5633
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   091   091   000    Old_age   Always       -       7072
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   099   099   000    Old_age   Always       -       1011
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       355
193 Load_Cycle_Count        0x0032   159   159   000    Old_age   Always       -       125408
194 Temperature_Celsius     0x0022   123   109   000    Old_age   Always       -       27
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       2
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       5

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      7066         -
# 2  Short offline       Completed without error       00%      7011         -
# 3  Short offline       Completed without error       00%      6874         -
# 4  Extended offline    Completed without error       00%      6812         -
# 5  Conveyance offline  Completed without error       00%      6805         -
# 6  Short offline       Completed without error       00%      6805         -
# 7  Short offline       Completed without error       00%      6797         -
# 8  Short offline       Completed without error       00%      6630         -
# 9  Short offline       Completed without error       00%      6596         -
#10  Short offline       Completed without error       00%      6462         -
#11  Short offline       Completed without error       00%      6416         -
#12  Extended offline    Completed without error       00%      6394         -
#13  Extended offline    Aborted by host               90%      6381         -
#14  Short offline       Completed without error       00%      6260         -
#15  Short offline       Completed without error       00%      6236         -
#16  Short offline       Completed without error       00%      6212         -
#17  Short offline       Completed without error       00%      6164         -
#18  Short offline       Completed without error       00%      6140         -
#19  Short offline       Completed without error       00%      6117         -
#20  Short offline       Completed without error       00%      6093         -
#21  Extended offline    Completed without error       00%      6093         -

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

root@freenas[~]#

 

[Chris Moore]

Here is a link to some of the BB codes available to make your post more readable:

BB codes

The list of BB codes you can use to spice up the look of your messages. This page shows a list of all BB codes that are available.

www.ixsystems.com

The easy one that should be used often is the code tag [CODE] with your pasted text inside and the end tag [/CODE]

 

[sretalla]

197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 2
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 5

Those indicate it's the drive. I would change it if it was in my system.

 

[markgca]

Those indicate it's the drive. I would change it if it was in my system.

thanks, will do.