Understanding a disk failure

[lloyd]

Hi everyone, My freenas system says

zpool status media gives

Code:

  pool: media
state: ONLINE
  scan: scrub repaired 0 in 3h2m with 0 errors on Sat May  9 03:07:30 2015
config:

        NAME                                            STATE     READ WRITE CKSUM
        media                                           ONLINE       0     0     0
          raidz3-0                                      ONLINE       0     0     0
            gptid/00befba3-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/01812627-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/0248a557-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/030c9f1f-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/03cd5c95-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/0491309a-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/055637d6-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
          raidz3-1                                      ONLINE       0     0     0
            gptid/0621decb-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/06a133aa-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/070e583b-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/077cef11-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/07e2d677-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/08492576-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0
            gptid/08af1707-c1dc-11e3-9905-002590d7e131  ONLINE       0     0     0

errors: No known data errors

smartctl -a /dev/da11

Code:

smartctl 6.3 2014-07-26 r3976 [FreeBSD 9.3-RELEASE-p13 amd64] (local build)
Copyright (C) 2002-14, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Desktop HDD.15
Device Model:     ST4000DM000-1F2168
Serial Number:    Z300DBGT
LU WWN Device Id: 5 000c50 0507143b7
Firmware Version: CC52
User Capacity:    4,000,787,030,016 bytes [4.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5900 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sun May 10 23:29:09 2015 MDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      ( 121) The previous self-test completed having
                                        the read element of the test failed.
Total time to complete Offline
data collection:                (  612) seconds.
Offline data collection
capabilities:                    (0x73) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        No Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        ( 542) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x1085) SCT Status supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   118   099   006    Pre-fail  Always       -       179784256
  3 Spin_Up_Time            0x0003   092   092   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       184
  5 Reallocated_Sector_Ct   0x0033   098   098   010    Pre-fail  Always       -       2384
  7 Seek_Error_Rate         0x000f   073   060   030    Pre-fail  Always       -       22784740
  9 Power_On_Hours          0x0032   093   093   000    Old_age   Always       -       6223
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       184
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0 0 0
189 High_Fly_Writes         0x003a   092   092   000    Old_age   Always       -       8
190 Airflow_Temperature_Cel 0x0022   074   062   045    Old_age   Always       -       26 (Min/Max 16/27)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       177
193 Load_Cycle_Count        0x0032   054   054   000    Old_age   Always       -       92327
194 Temperature_Celsius     0x0022   026   040   000    Old_age   Always       -       26 (0 13 0 0 0)
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       152
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       152
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       5616h+27m+06.219s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       60373279110
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       83033852060

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed: read failure       90%      6211         -
# 2  Short offline       Completed: read failure       70%      6199         -
# 3  Short offline       Completed: read failure       90%      6187         -
# 4  Short offline       Completed: read failure       10%      6178         -
# 5  Short offline       Completed: read failure       90%      6164         -
# 6  Short offline       Completed: read failure       80%      6152         -
# 7  Extended offline    Completed: read failure       90%      6127         -
# 8  Extended offline    Interrupted (host reset)      00%       438         -
# 9  Extended offline    Interrupted (host reset)      00%       342         -
#10  Extended offline    Interrupted (host reset)      90%       230         -
#11  Extended offline    Interrupted (host reset)      00%       229         -

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Specifically I am confused about why zpool status says the disk is online, smart says it passed but shows a bunch of read failures and the gui error message says it is offline?

I do have a couple of spares so I will just replace the drive, but I still would like a better understanding of what this all means.

Thanks

 

[danb35]

The GUI does not say the disk is offline; the GUI says the disk has offline uncorrectable sectors. Two different things. Apparently the bad sectors didn't have data on them, which would be why 'zpool status' doesn't report any errors. As to how the overall self-assessment on the disk passed with all those errors (including multiple failed self-tests), I honestly don't know--it seems that that result only shows "failed" when the disk is already dead.

Once you get the disk replaced, revisit your SMART test schedule, for two reasons: (1) you need to re-schedule the tests on a new disk, and (2) you should probably change the schedule anyway. Right now, it looks like you're running short tests every 14 hours, and never running long tests. The short tests don't need to be quite that frequent (I'm running them daily, and some folks would consider that excessive), but you really should have a long test every week or two.

 

[Ericloewe]

SMART health assessments are useless. When they switch to failed, your drive is in really bad shape.

 

[lloyd]

Thanks danb35 and Ericlowe. Its nice to now that the GUI is correctly identifying the problem. After things get re silvered I will be sure to update my SMART tests as you suggested.

 

[Elo]

I have a similar question about how to interpret the information from the smartctl command and the zpool status xxx command. The smartctl -a <device> does not indicate any read errors while the zpool status <pool> indicates a bunch of read errors. Why are these different? A reference to a place where I can study this would be great and even better if someone can explain briefly here!

zpool status:

Code:

  pool: Pool_2
state: DEGRADED
status: One or more devices are faulted in response to persistent errors.
        Sufficient replicas exist for the pool to continue functioning in a
        degraded state.
action: Replace the faulted device, or use 'zpool clear' to mark the device
        repaired.
  scan: resilvered 479M in 0h30m with 0 errors on Thu May 21 22:19:25 2015
config:

        NAME                                            STATE     READ WRITE CKSUM
        Pool_2                                          DEGRADED     0     0     0
          mirror-0                                      ONLINE       0     0     0
            gptid/b42f1342-3e73-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/b4a4f9cc-3e73-11e4-a750-001bcd030800  ONLINE       0     0     0
          mirror-1                                      DEGRADED     0     0     0
            gptid/0aeda5bd-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/0bf2a8d0-3e74-11e4-a750-001bcd030800  FAULTED      3  1004     0  too many errors
          mirror-2                                      ONLINE       0     0     0
            gptid/020350a6-b856-11e4-82b1-001bcd030800  ONLINE       0     0     0
            gptid/16d36a24-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
          mirror-3                                      ONLINE       0     0     0
            gptid/90a7c0b1-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/0cbb57a9-ff2c-11e4-b178-001bcd030800  ONLINE       0     0     0
          mirror-4                                      ONLINE       0     0     0
            gptid/ac9603a4-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/ad97e3d3-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
          mirror-5                                      ONLINE       0     0     0
            gptid/c8a97185-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/c9484df6-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0

errors: No known data errors

smartctl -a /dev/da7 :

Code:

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Green
Device Model:     WDC WD30EZRX-00AZ6B0
Serial Number:    WD-WCC070379737
LU WWN Device Id: 5 0014ee 25db42432
Firmware Version: 80.00A80
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Thu May 21 22:32:04 2015 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x85) Offline data collection activity
                                        was aborted by an interrupting command from host.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      ( 116) The previous self-test completed having
                                        the read element of the test failed.
Total time to complete Offline
data collection:                (50280) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        ( 483) minutes.
Conveyance self-test routine
recommended polling time:        (   5) minutes.
SCT capabilities:              (0x3035) SCT Status supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   253   233   021    Pre-fail  Always       -       2816
  4 Start_Stop_Count        0x0032   098   098   000    Old_age   Always       -       2095
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   083   083   000    Old_age   Always       -       13091
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       143
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       132
193 Load_Cycle_Count        0x0032   037   037   000    Old_age   Always       -       489504
194 Temperature_Celsius     0x0022   116   095   000    Old_age   Always       -       36
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed: read failure       40%     13091         5157088
# 2  Short offline       Completed without error       00%     12242         -
# 3  Short offline       Completed without error       00%     12241         -
# 4  Short offline       Completed without error       00%     12240         -
# 5  Short offline       Completed without error       00%     12239         -
# 6  Short offline       Completed without error       00%     12238         -
# 7  Short offline       Completed without error       00%     12237         -
# 8  Short offline       Completed without error       00%     12236         -
# 9  Short offline       Completed without error       00%     12235         -
#10  Short offline       Completed without error       00%     12234         -
#11  Short offline       Completed without error       00%     12233         -
#12  Short offline       Completed without error       00%     12232         -
#13  Short offline       Completed without error       00%     12231         -
#14  Short offline       Completed without error       00%     12230         -
#15  Short offline       Completed without error       00%     12229         -
#16  Short offline       Completed without error       00%     12228         -
#17  Short offline       Completed without error       00%     12227         -
#18  Short offline       Completed without error       00%     12226         -
#19  Short offline       Completed without error       00%     12225         -
#20  Short offline       Completed without error       00%     12224         -
#21  Short offline       Completed without error       00%     12223         -

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

 

[Ericloewe]

I have a similar question about how to interpret the information from the smartctl command and the zpool status xxx command. The smartctl -a <device> does not indicate any read errors while the zpool status <pool> indicates a bunch of read errors. Why are these different? A reference to a place where I can study this would be great and even better if someone can explain briefly here!

zpool status:

Code:

  pool: Pool_2
state: DEGRADED
status: One or more devices are faulted in response to persistent errors.
        Sufficient replicas exist for the pool to continue functioning in a
        degraded state.
action: Replace the faulted device, or use 'zpool clear' to mark the device
        repaired.
  scan: resilvered 479M in 0h30m with 0 errors on Thu May 21 22:19:25 2015
config:

        NAME                                            STATE     READ WRITE CKSUM
        Pool_2                                          DEGRADED     0     0     0
          mirror-0                                      ONLINE       0     0     0
            gptid/b42f1342-3e73-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/b4a4f9cc-3e73-11e4-a750-001bcd030800  ONLINE       0     0     0
          mirror-1                                      DEGRADED     0     0     0
            gptid/0aeda5bd-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/0bf2a8d0-3e74-11e4-a750-001bcd030800  FAULTED      3  1004     0  too many errors
          mirror-2                                      ONLINE       0     0     0
            gptid/020350a6-b856-11e4-82b1-001bcd030800  ONLINE       0     0     0
            gptid/16d36a24-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
          mirror-3                                      ONLINE       0     0     0
            gptid/90a7c0b1-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/0cbb57a9-ff2c-11e4-b178-001bcd030800  ONLINE       0     0     0
          mirror-4                                      ONLINE       0     0     0
            gptid/ac9603a4-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/ad97e3d3-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
          mirror-5                                      ONLINE       0     0     0
            gptid/c8a97185-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0
            gptid/c9484df6-3e74-11e4-a750-001bcd030800  ONLINE       0     0     0

errors: No known data errors

smartctl -a /dev/da7 :

Code:

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Green
Device Model:     WDC WD30EZRX-00AZ6B0
Serial Number:    WD-WCC070379737
LU WWN Device Id: 5 0014ee 25db42432
Firmware Version: 80.00A80
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Thu May 21 22:32:04 2015 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x85) Offline data collection activity
                                        was aborted by an interrupting command from host.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      ( 116) The previous self-test completed having
                                        the read element of the test failed.
Total time to complete Offline
data collection:                (50280) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        ( 483) minutes.
Conveyance self-test routine
recommended polling time:        (   5) minutes.
SCT capabilities:              (0x3035) SCT Status supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   253   233   021    Pre-fail  Always       -       2816
  4 Start_Stop_Count        0x0032   098   098   000    Old_age   Always       -       2095
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   083   083   000    Old_age   Always       -       13091
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       143
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       132
193 Load_Cycle_Count        0x0032   037   037   000    Old_age   Always       -       489504
194 Temperature_Celsius     0x0022   116   095   000    Old_age   Always       -       36
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed: read failure       40%     13091         5157088
# 2  Short offline       Completed without error       00%     12242         -
# 3  Short offline       Completed without error       00%     12241         -
# 4  Short offline       Completed without error       00%     12240         -
# 5  Short offline       Completed without error       00%     12239         -
# 6  Short offline       Completed without error       00%     12238         -
# 7  Short offline       Completed without error       00%     12237         -
# 8  Short offline       Completed without error       00%     12236         -
# 9  Short offline       Completed without error       00%     12235         -
#10  Short offline       Completed without error       00%     12234         -
#11  Short offline       Completed without error       00%     12233         -
#12  Short offline       Completed without error       00%     12232         -
#13  Short offline       Completed without error       00%     12231         -
#14  Short offline       Completed without error       00%     12230         -
#15  Short offline       Completed without error       00%     12229         -
#16  Short offline       Completed without error       00%     12228         -
#17  Short offline       Completed without error       00%     12227         -
#18  Short offline       Completed without error       00%     12226         -
#19  Short offline       Completed without error       00%     12225         -
#20  Short offline       Completed without error       00%     12224         -
#21  Short offline       Completed without error       00%     12223         -

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SMART test says "read failure". There's your problem. Replace the drive, RMA it if possible, etc.

The write errors are a bit more baffling, but they could be from the drive spending so much time trying to read the bad sector that ZFS dropped the writes and marked them as errors.

 

[Elo]

Thank you for your quick reply. The disk is produced in 2013 and I don't think I will be able to RMA it but I will try. Still I do not understand why the errors do not show up in the smartctl report. As you see the table shows NO read errors while the last short test shows a lot of read errors. Can it be a problem, with the disk controller and how can I best determine that?

Edit: I will try to test the disk in another machine with the HD Tune utility.

 

[Ericloewe]

Thank you for your quick reply. The disk is produced in 2013 and I don't think I will be able to RMA it but I will try. Still I do not understand why the errors do not show up in the smartctl report. As you see the table shows NO read errors while the last short test shows a lot of read errors. Can it be a problem, with the disk controller and how can I best determine that?

Edit: I will try to test the disk in another machine with the HD Tune utility.

SMART suffers from a serious lack of documentation and standardization. In some edge cases, it's hard to tell what exactly is going on.

 

[cyberjock]

SMART suffers from a serious lack of documentation and standardization. In some edge cases, it's hard to tell what exactly is going on.

au contraire mon frere'

It is well documented and very standardized. The real problem is that the manufacturers get to implement SMART in lots of ways because of the versatility of SMART. So unless you have some inside info from the given manufacturer, there's no guarantee you will fully understand it. I'd say that >95% of stuff I see on the forums with "weird and bizaare" output from SMART makes complete and total sense to me.

I have no idea what is meant by "Still I do not understand why the errors do not show up in the smartctl report". They are clearly shown to me in the attributes. The disk is broken per the attributes. :P

 

[Ericloewe]

au contraire mon frere'

It is well documented and very standardized. The real problem is that the manufacturers get to implement SMART in lots of ways because of the versatility of SMART. So unless you have some inside info from the given manufacturer, there's no guarantee you will fully understand it. I'd say that >95% of stuff I see on the forums with "weird and bizaare" output from SMART makes complete and total sense to me.

I have no idea what is meant by "Still I do not understand why the errors do not show up in the smartctl report". They are clearly shown to me in the attributes. The disk is broken per the attributes. :p

Well, it's not standardization if everyone does an important part almost completely differently.

 

[cyberjock]

Well, it's not standardization if everyone does an important part almost completely differently.

So which part in particular is "important" that is almost completely different? Only some relatively minor things have been different that I've seen.

 

[Ericloewe]

So which part in particular is "important" that is almost completely different? Only some relatively minor things have been different that I've seen.

That's odd. Could've sworn that I'd finished that thought. Must've erased it or something...

In any case, what bugs me is the following:
Vendor-specific attributes are a mixture of stuff everyone seems to agree on (reallocated sectors, start/stop counts...), stuff everyone does a little differently (temperature thresholds), stuff that's radically different (raw read error rates, for instance) and stuff that really is vendor-specific and has little documentation (what on earth is a multi-zone error rate? A head problem?).

 

[cyberjock]

Yes, vendor specific attributes suck. But we have so many other "good" indicators that the only time this is a problem, really, is SSDs. Lucky for us, SSDs seem to be an item that either "works or doesn't work". So if its broken, you generally already know it. :P

Temp thresholds are based on models and brand, so those can be different depending on how they are calculated.

Error rates are allowed to be either/or. Personally, I like Seagate's more than everyone else's because everyone else lists the error rates as "zero" unless they hit a pre-set threshold. Seagate gives you the error rate regardless of how small.

Multi-Zone Error Rate: http://en.wikipedia.org/wiki/S.M.A.R.T.#Known_ATA_S.M.A.R.T._attributes

Look at attribute 200 on the chart. :)

 

[Ericloewe]

It still doesn't quite specify. It implies mechanical errors, like the head being on the wrong sector, but the basic description is vague.

I guess it's still a more informative name than "cat".

 

[cyberjock]

Well:

If it was a mechanical error, you'd have multi zone error rates along with other problems (write errors due to being on the wrong sector would undoubtedly mean you can't read some sectors too).


When it comes to writes, the primary indicator is the multi-zone error rate.

Read errors have lots of "intermediate" steps, and therefore have more indicators:

- Current Pending Sector Count
- Reallocated Sectors
- Raw Read Error Rate
- Start/Stop count in relation to power cycle count
- Offline Uncorrectable

 

[Elo]

I have no idea what is meant by "Still I do not understand why the errors do not show up in the smartctl report". They are clearly shown to me in the attributes. The disk is broken per the attributes. :p

If you look at the attached smatctl -a output. The first table line 55 shows the vendor specific thresholds and the raw data. The raw data says zero read errors. Then the last short test further down states read errors line 78. I have replaced the disk and surface tested it in hdd scan , WAS own test facility and one more program They all conclude that the disk is on good health BUT THERE IS ONE BAD SECTOR. These tools also test spin up time, seek time and other HW dependent parameters. It is clearly something I do not understand. I have also replaced the disk controller with a spare but no change. I also Se from line 58 that there is no real locations done.

I would appreciate if you can point me to some good source of information so I can study these issues and understand how to interpret these various tests.