Have my first error on HD... Should I replace?

Status
Not open for further replies.
M

mrMuppet

Contributor
Joined
Mar 14, 2014
Messages
192
Yesterday I had the 1st critical error. Should I replace the disk or should I repair it and wait how long the next error takes?

Code:
[root@thingtank] ~# smartctl -t short -a /dev/ada0
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Red
Device Model:     WDC WD30EFRX-68EUZN0
Serial Number:    WD-WMC4N2097349
LU WWN Device Id: 5 0014ee 6043d3d38
Firmware Version: 80.00A80
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue May 10 10:33:44 2016 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      ( 121) The previous self-test completed having
                                        the read element of the test failed.
Total time to complete Offline
data collection:                (39360) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        ( 395) minutes.
Conveyance self-test routine
recommended polling time:        (   5) minutes.
SCT capabilities:              (0x703d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       4860
  3 Spin_Up_Time            0x0027   200   180   021    Pre-fail  Always       -       4983
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       38
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   199   000    Old_age   Always       -       41
  9 Power_On_Hours          0x0032   075   075   000    Old_age   Always       -       18503
 10 Spin_Retry_Count        0x0032   100   253   000    Old_age   Always       -       0
 11 Calibration_Retry_Count 0x0032   100   253   000    Old_age   Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       38
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       21
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       21
194 Temperature_Celsius     0x0022   119   105   000    Old_age   Always       -       31
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       1
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   100   253   000    Old_age   Offline      -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed: read failure       90%     18502         1597934
# 2  Short offline       Completed without error       00%     18502         -
# 3  Short offline       Completed without error       00%     18070         -
# 4  Short offline       Completed without error       00%     17828         -
# 5  Short offline       Completed without error       00%     17326         -
# 6  Short offline       Completed without error       00%     17087         -
# 7  Short offline       Completed without error       00%     16631         -
# 8  Short offline       Completed without error       00%     16392         -
# 9  Short offline       Completed without error       00%     15888         -
#10  Short offline       Completed without error       00%     15648         -
#11  Short offline       Completed without error       00%     15144         -
#12  Short offline       Completed without error       00%     14905         -
#13  Short offline       Completed without error       00%     14425         -
#14  Short offline       Completed without error       00%     14186         -
#15  Short offline       Completed without error       00%     13681         -
#16  Short offline       Completed without error       00%     13441         -
#17  Short offline       Completed without error       00%     12962         -
#18  Short offline       Completed without error       00%     12722         -
#19  Short offline       Completed without error       00%     12218         -
#20  Short offline       Completed without error       00%     11979         -
#21  Short offline       Completed without error       00%     11475         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

=== START OF OFFLINE IMMEDIATE AND SELF-TEST SECTION ===
Sending command: "Execute SMART Short self-test routine immediately in off-line mode".
Drive command "Execute SMART Short self-test routine immediately in off-line mode" successful.
Testing has begun.
Please wait 2 minutes for test to complete.
Test will complete after Tue May 10 10:35:44 2016

Use smartctl -X to abort test.


What do you think?

Gesendet von meinem A0001 mit Tapatalk
 
danb35

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
Do you ever run long SMART tests? Because there aren't any in your log. The drive's only showing one pending sector, which usually isn't that bad, but the failed SMART test isn't a good sign. Try running a long SMART test and see what happens.
 
M

mrMuppet

Contributor
Joined
Mar 14, 2014
Messages
192
Started long test now. Have to wait 350 minutes...

Gesendet von meinem A0001 mit Tapatalk
 
Last edited:
M

mrMuppet

Contributor
Joined
Mar 14, 2014
Messages
192
Now the device is completely gone:

Code:
 
[root@thingtank] ~# smartctl --scan
/dev/ada1 -d atacam # /dev/ada1, ATA device
/dev/ada2 -d atacam # /dev/ada2, ATA device
/dev/ada3 -d atacam # /dev/ada3, ATA device
/dev/ada4 -d atacam # /dev/ada4, ATA device
/dev/ada5 -d atacam # /dev/ada5, ATA device


Another argument to replace?

Gesendet von meinem A0001 mit Tapatalk
 
M

mrMuppet

Contributor
Joined
Mar 14, 2014
Messages
192
danb35 said:
What does 'camcontrol devlist' show?
Click to expand...

Code:
 
root@thingtank] ~# camcontrol devlist
<WDC WD30EFRX-68EUZN0 80.00A80>    at scbus1 target 0 lun 0 (ada1,pass1)
<WDC WD30EFRX-68EUZN0 80.00A80>    at scbus2 target 0 lun 0 (ada2,pass2)
<WDC WD30EFRX-68EUZN0 80.00A80>    at scbus3 target 0 lun 0 (ada3,pass3)
<WDC WD30EFRX-68AX9N0 80.00A80>    at scbus4 target 0 lun 0 (ada4,pass4)
<WDC WD30EFRX-68AX9N0 80.00A80>    at scbus5 target 0 lun 0 (ada5,pass5)
<Lexar USB Flash Drive 1100>       at scbus7 target 0 lun 0 (da0,pass6)
<Lexar USB Flash Drive 1100>       at scbus8 target 0 lun 0 (da1,pass7)


Device ada0 is still missing...

Gesendet von meinem A0001 mit Tapatalk
 
danb35

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
That's strange, and does make it look like ada0 has dropped offline completely. The previous SMART results didn't suggest that anything catastrophic was about to happen. Are you sure the power/data connections are in good shape? Can you power down and reboot, to see if the drive comes back up?
 
M

mrMuppet

Contributor
Joined
Mar 14, 2014
Messages
192
Error mail
Device: /dev/ada0, 1 Currently unreadable (pending) sectors
Device: /dev/ada0, Self-Test Log error count increased from 2 to 3
The volume CAVE (ZFS) state is DEGRADED: One or more devices has been removed by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state


Gesendet von meinem A0001 mit Tapatalk
 
M

mrMuppet

Contributor
Joined
Mar 14, 2014
Messages
192
Ipmi doesn't find any power supply problems.

I will try to reboot.

Gesendet von meinem A0001 mit Tapatalk
 
danb35

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
Was that email before or after you ran the smartctl --scan? What about before or after you ran camcontrol devlist?

The email makes it look like it failed another SMART test, which isn't a huge surprise, and indicates it's time to RMA the drive. I'm still a little puzzled at that result with only one pending sector, but it is what it is. The drive dropping completely offline is unexpected, though. But in any case, it does sound like it's time to replace.
 
M

mrMuppet

Contributor
Joined
Mar 14, 2014
Messages
192
The email was send ca. 1 hour after I started the long test. So it was before "camcontrol".
Reboot takes some time...

Gesendet von meinem A0001 mit Tapatalk
 
M

mrMuppet

Contributor
Joined
Mar 14, 2014
Messages
192
After rebooting I get

Code:
 
Last login: Tue May 10 19:03:08 2016 from 192.168.178.28
FreeBSD 10.3-RELEASE (FreeNAS.amd64) #0 f935af8(freebsd10): Mon Apr 18 10:58:36 PDT 2016

        FreeNAS (c) 2009-2016, The FreeNAS Development Team
        All rights reserved.
        FreeNAS is released under the modified BSD license.

        For more information, documentation, help or support, go here:
        http://freenas.org
Welcome to FreeNAS
[root@thingtank] ~# smartctl --scan
/dev/ada0 -d atacam # /dev/ada0, ATA device
/dev/ada1 -d atacam # /dev/ada1, ATA device
/dev/ada2 -d atacam # /dev/ada2, ATA device
/dev/ada3 -d atacam # /dev/ada3, ATA device
/dev/ada4 -d atacam # /dev/ada4, ATA device
/dev/ada5 -d atacam # /dev/ada5, ATA device
[root@thingtank] ~# smartctl -a
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

ERROR: smartctl requires a device name as the final command-line argument.


Use smartctl -h to get a usage summary

[root@thingtank] ~# smartctl -a /dev/ada0
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Red
Device Model:     WDC WD30EFRX-68EUZN0
Serial Number:    WD-WMC4N2097349
LU WWN Device Id: 5 0014ee 6043d3d38
Firmware Version: 80.00A80
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue May 10 20:30:46 2016 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever
                                        been run.
Total time to complete Offline
data collection:                (39360) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        ( 395) minutes.
Conveyance self-test routine
recommended polling time:        (   5) minutes.
SCT capabilities:              (0x703d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       4923
  3 Spin_Up_Time            0x0027   213   180   021    Pre-fail  Always       -       4333
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       39
  5 Reallocated_Sector_Ct   0x0033   199   199   140    Pre-fail  Always       -       36
  7 Seek_Error_Rate         0x002e   196   196   000    Old_age   Always       -       336  9 Power_On_Hours          0x0032   075   075   000    Old_age   Always       -       18512
 10 Spin_Retry_Count        0x0032   100   253   000    Old_age   Always       -       0
 11 Calibration_Retry_Count 0x0032   100   253   000    Old_age   Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       39
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       21
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       22
194 Temperature_Celsius     0x0022   114   105   000    Old_age   Always       -       36
196 Reallocated_Event_Count 0x0032   196   196   000    Old_age   Always       -       4
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       1
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   100   253   000    Old_age   Offline      -       0

SMART Error Log Version: 1
ATA Error Count: 1
        CR = Command Register [HEX]
        FR = Features Register [HEX]
        SC = Sector Count Register [HEX]
        SN = Sector Number Register [HEX]
        CL = Cylinder Low Register [HEX]
        CH = Cylinder High Register [HEX]
        DH = Device/Head Register [HEX]
        DC = Device Command Register [HEX]
        ER = Error register [HEX]
        ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 1 occurred at disk power-on lifetime: 18512 hours (771 days + 8 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 17 fe 3f 40  Error: UNC at LBA = 0x003ffe17 = 4193815

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  c8 00 00 80 fd 3f 40 08      04:43:42.078  READ DMA

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed: read failure       90%     18503         1597934
# 2  Short offline       Completed: read failure       90%     18503         1597928
# 3  Short offline       Completed: read failure       90%     18502         1597934
# 4  Short offline       Completed without error       00%     18502         -
# 5  Short offline       Completed without error       00%     18070         -
# 6  Short offline       Completed without error       00%     17828         -
# 7  Short offline       Completed without error       00%     17326         -
# 8  Short offline       Completed without error       00%     17087         -
# 9  Short offline       Completed without error       00%     16631         -
#10  Short offline       Completed without error       00%     16392         -
#11  Short offline       Completed without error       00%     15888         -
#12  Short offline       Completed without error       00%     15648         -
#13  Short offline       Completed without error       00%     15144         -
#14  Short offline       Completed without error       00%     14905         -
#15  Short offline       Completed without error       00%     14425         -
#16  Short offline       Completed without error       00%     14186         -
#17  Short offline       Completed without error       00%     13681         -
#18  Short offline       Completed without error       00%     13441         -
#19  Short offline       Completed without error       00%     12962         -
#20  Short offline       Completed without error       00%     12722         -
#21  Short offline       Completed without error       00%     12218         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

[root@thingtank] ~#


Gesendet von meinem A0001 mit Tapatalk
 
M

mrMuppet

Contributor
Joined
Mar 14, 2014
Messages
192
Lucky: still in warranty. Wd will send me replacement for free.

Gesendet von meinem A0001 mit Tapatalk
 
Status
Not open for further replies.

Important Announcement for the TrueNAS Community.

The TrueNAS Community has now been moved. This forum will now become READ-ONLY for historical purposes. Please feel free to join us on the new TrueNAS Community Forums.

Related topics on forums.truenas.com for thread: "Have my first error on HD... Should I replace?"

Similar threads

F
Self Test Log error count increased from 0 to 1
Replies
15
Views
18K
glauco
glauco
madtulip
  • Locked
SMART error (FailedReadSmartSelfTestLog) detected on host
Replies
10
Views
6K
joeschmuck
joeschmuck
IceBoosteR
  • Locked
My first SMART error: What to do
Replies
12
Views
4K
IceBoosteR
IceBoosteR
D3m0nicSoul
Hard Drive Log Error Count Increased
Replies
2
Views
3K
Chris Moore
Chris Moore
mbonato
zpool CKSUM errors while resilvering after replacing a drive
Replies
5
Views
4K
sretalla
sretalla
Top