Failed SMART usage Attribute: 184 End-to-End_Error

IsaacN · May 25, 2020

Hi everyone, I am new to FreeNAS and I keep getting this error:
CRITICAL
Device: /dev/ada0, Failed SMART usage Attribute: 184 End-to-End_Error..

Here is the smartctl -a /dev/ output

Code:

Warning: settings changed through the CLI are not written to
the configuration database and will be reset on reboot.

root@freenas[~]# smartctl -a /dev/ada0
smartctl 7.0 2018-12-30 r4883 [FreeBSD 11.3-RELEASE-p9 amd64] (local build)
Copyright (C) 2002-18, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Desktop SSHD
Device Model:     ST1000DX001-1NS162
Serial Number:    Z4Y8NBBH
LU WWN Device Id: 5 000c50 07bba68ce
Firmware Version: CC41
User Capacity:    1,000,204,886,016 bytes [1.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2, ACS-3 T13/2161-D revision 3b
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is:    Mon May 25 19:36:40 2020 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
See vendor-specific Attribute list for marginal Attributes.

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
                                        was completed without error.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0) The previous self-test routine completed
                                        without error or no self-test has ever
                                        been run.
Total time to complete Offline
data collection:                (    0) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        ( 114) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x1081) SCT Status supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   118   099   006    Pre-fail  Always       -       198377872
  3 Spin_Up_Time            0x0003   097   097   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       273
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   088   060   030    Pre-fail  Always       -       733841853
  9 Power_On_Hours          0x0032   064   064   000    Old_age   Always       -       32187
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       289
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   099   099   099    Old_age   Always   FAILING_NOW 1
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   099   000    Old_age   Always       -       0 0 1
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   077   045   045    Old_age   Always   In_the_past 23 (Min/Max 18/23)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       126
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       309
194 Temperature_Celsius     0x0022   023   055   000    Old_age   Always       -       23 (0 16 0 0 0)
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       32738h+00m+13.514s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       107105658155
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       868388742747

SMART Error Log Version: 1
ATA Error Count: 1
        CR = Command Register [HEX]
        FR = Features Register [HEX]
        SC = Sector Count Register [HEX]
        SN = Sector Number Register [HEX]
        CL = Cylinder Low Register [HEX]
        CH = Cylinder High Register [HEX]
        DH = Device/Head Register [HEX]
        DC = Device Command Register [HEX]
        ER = Error register [HEX]
        ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 1 occurred at disk power-on lifetime: 28457 hours (1185 days + 17 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 50 de fc 01  Error: UNC at LBA = 0x01fcde50 = 33349200

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 28 48 de fc e1 00      00:03:14.035  READ DMA EXT
  25 00 20 a8 8b f7 e1 00      00:03:14.035  READ DMA EXT
  25 00 20 58 ba f2 e1 00      00:03:14.034  READ DMA EXT
  25 00 10 18 c2 d9 e1 00      00:03:14.031  READ DMA EXT
  25 00 08 ff ff ff ef 00      00:03:14.031  READ DMA EXT

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%     32174         -
# 2  Extended offline    Completed without error       00%     32150         -
# 3  Extended offline    Completed without error       00%     32127         -
# 4  Extended offline    Completed without error       00%     32103         -
# 5  Extended offline    Completed without error       00%     32081         -
# 6  Extended offline    Completed without error       00%     32057         -
# 7  Extended offline    Completed without error       00%     32033         -
# 8  Extended offline    Completed without error       00%     32009         -
# 9  Extended offline    Completed without error       00%     31985         -
#10  Extended offline    Completed without error       00%     31961         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing

Glorious1 · May 26, 2020

Although the drive is passing the extended tests, it's logging a lot of read and seek errors. From what I've read, the end-to-end error is serious. You should back up the pool and replace the drive.

IsaacN · May 26, 2020

Ok, do you happen to know what caused this?

IsaacN · May 26, 2020

So, it appears to have disappeared from the alerts

Also, I have updated the system

Ericloewe · May 26, 2020

IsaacN said:
Ok, do you happen to know what caused this?

The disk is dying. Not much more to it, it's a small miracle any hard drive works at all.

IsaacN · May 26, 2020

Ericloewe said:
The disk is dying. Not much more to it, it's a small miracle any hard drive works at all.

Amen

zamana · Jul 18, 2020

I'm living with this error for months in one of my backup systems (I have 2). It's an Ubuntu distro.

As long as I read elsewhere, this is not a mechanical problem.

It's part of a 4x8TB ZFS-1 pool, and all scrubs until now repaired nothing.

All short and long smartctl tests passed also.

Gold question: is it safe to continue with it?

Code:

smartctl 7.0 2018-12-30 r4883 [aarch64-linux-5.3.0-1028] (local build)
Copyright (C) 2002-18, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda Compute
Device Model:     ST8000DM004-2CX188
Serial Number:    ZCT0PEJH
LU WWN Device Id: 5 000c50 0b4bdf686
Firmware Version: 0001
User Capacity:    8,001,563,222,016 bytes [8.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5425 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-3 T13/2161-D revision 5
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Sat Jul 18 11:35:14 2020 -03
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART Status not supported: Incomplete response, ATA output registers missing
SMART overall-health self-assessment test result: PASSED
Warning: This result is based on an Attribute check.
See vendor-specific Attribute list for marginal Attributes.

General SMART Values:
Offline data collection status:  (0x00)    Offline data collection activity
                    was never started.
                    Auto Offline Data Collection: Disabled.
Self-test execution status:      (   0)    The previous self-test routine completed
                    without error or no self-test has ever
                    been run.
Total time to complete Offline
data collection:         (    0) seconds.
Offline data collection
capabilities:              (0x73) SMART execute Offline immediate.
                    Auto Offline data collection on/off support.
                    Suspend Offline collection upon new
                    command.
                    No Offline surface scan supported.
                    Self-test supported.
                    Conveyance Self-test supported.
                    Selective Self-test supported.
SMART capabilities:            (0x0003)    Saves SMART data before entering
                    power-saving mode.
                    Supports SMART auto save timer.
Error logging capability:        (0x01)    Error logging supported.
                    General Purpose Logging supported.
Short self-test routine
recommended polling time:      (   1) minutes.
Extended self-test routine
recommended polling time:      ( 995) minutes.
Conveyance self-test routine
recommended polling time:      (   2) minutes.
SCT capabilities:            (0x30a5)    SCT Status supported.
                    SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   081   060   006    Pre-fail  Always       -       139692440
  3 Spin_Up_Time            0x0003   091   091   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       353
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   085   060   045    Pre-fail  Always       -       337262751
  9 Power_On_Hours          0x0032   092   092   000    Old_age   Always       -       7866 (147 166 0)
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       297
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   099   099   099    Old_age   Always   FAILING_NOW 1
187 Reported_Uncorrect      0x0032   064   064   000    Old_age   Always       -       36
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   066   051   040    Old_age   Always       -       34 (Min/Max 30/41)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       127
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       807
194 Temperature_Celsius     0x0022   034   049   000    Old_age   Always       -       34 (0 19 0 0 0)
195 Hardware_ECC_Recovered  0x001a   081   064   000    Old_age   Always       -       139692440
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       14
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       5394 (139 207 0)
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       215666666486
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       220806118967

SMART Error Log Version: 1
ATA Error Count: 37 (device log contains only the most recent five errors)
    CR = Command Register [HEX]
    FR = Features Register [HEX]
    SC = Sector Count Register [HEX]
    SN = Sector Number Register [HEX]
    CL = Cylinder Low Register [HEX]
    CH = Cylinder High Register [HEX]
    DH = Device/Head Register [HEX]
    DC = Device Command Register [HEX]
    ER = Error register [HEX]
    ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 37 occurred at disk power-on lifetime: 5038 hours (209 days + 22 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  04 73 04 80 87 80 e0  Device Fault; Error: ABRT 4 sectors at LBA = 0x00808780 = 8423296

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  35 00 50 ff ff ff ef 00  10d+23:44:37.782  WRITE DMA EXT
  35 00 50 ff ff ff ef 00  10d+23:44:37.546  WRITE DMA EXT
  35 00 50 ff ff ff ef 00  10d+23:44:37.268  WRITE DMA EXT
  35 00 50 ff ff ff ef 00  10d+23:44:37.028  WRITE DMA EXT
  35 00 50 ff ff ff ef 00  10d+23:44:36.750  WRITE DMA EXT

Error 36 occurred at disk power-on lifetime: 5029 hours (209 days + 13 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 53 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  25 00 08 ff ff ff ef 00  10d+15:00:01.489  READ DMA EXT
  25 00 08 ff ff ff ef 00  10d+15:00:01.460  READ DMA EXT
  35 00 08 ff ff ff ef 00  10d+15:00:01.433  WRITE DMA EXT
  35 00 08 ff ff ff ef 00  10d+15:00:01.432  WRITE DMA EXT
  35 00 08 ff ff ff ef 00  10d+15:00:01.432  WRITE DMA EXT

Error 35 occurred at disk power-on lifetime: 3702 hours (154 days + 6 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  60 00 00 ff ff ff 4f 00      13:00:47.399  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00      13:00:47.398  READ FPDMA QUEUED
  2f 00 01 10 00 00 00 00      13:00:47.350  READ LOG EXT
  60 00 00 ff ff ff 4f 00      13:00:43.335  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00      13:00:43.334  READ FPDMA QUEUED

Error 34 occurred at disk power-on lifetime: 3702 hours (154 days + 6 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  60 00 00 ff ff ff 4f 00      13:00:43.335  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00      13:00:43.334  READ FPDMA QUEUED
  2f 00 01 10 00 00 00 00      13:00:43.315  READ LOG EXT
  60 00 00 ff ff ff 4f 00      13:00:39.694  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00      13:00:39.693  READ FPDMA QUEUED

Error 33 occurred at disk power-on lifetime: 3702 hours (154 days + 6 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  60 00 00 ff ff ff 4f 00      13:00:39.694  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00      13:00:39.693  READ FPDMA QUEUED
  2f 00 01 10 00 00 00 00      13:00:39.645  READ LOG EXT
  60 00 00 ff ff ff 4f 00      13:00:35.818  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00      13:00:35.817  READ FPDMA QUEUED

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%      5485         -
# 2  Short offline       Completed without error       00%      5469         -
# 3  Short offline       Completed without error       00%      4693         -
# 4  Short offline       Completed without error       00%      4669         -
# 5  Short offline       Completed without error       00%      4645         -
# 6  Short offline       Completed without error       00%      4621         -
# 7  Short offline       Completed without error       00%      4597         -
# 8  Short offline       Completed without error       00%      4573         -
# 9  Short offline       Completed without error       00%      4549         -
#10  Short offline       Completed without error       00%      4501         -
#11  Short offline       Completed without error       00%      4477         -
#12  Short offline       Completed without error       00%      4453         -
#13  Short offline       Completed without error       00%      4429         -
#14  Short offline       Completed without error       00%      4406         -
#15  Short offline       Completed without error       00%      4381         -
#16  Short offline       Completed without error       00%      4357         -
#17  Short offline       Completed without error       00%      4333         -
#18  Short offline       Completed without error       00%      4279         -
#19  Short offline       Completed without error       00%      4255         -
#20  Short offline       Completed without error       00%      4231         -
#21  Short offline       Completed without error       00%      4207         -

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Glorious1 · Jul 18, 2020

I would replace that disk if it were mine. There are many errors besides the End-to-End. At the very least do a long test - you say it passed them, but the last test logged is over 3 months ago (runtime).

João Oliveira · Mar 13, 2023

Hello,

I'm have a zfs pool of 4 x 2Tb disks. 2 WDigital (used and with different ages) and 2 Seagate Barracuda (new at the time).
After 6 months, one of the new Seagate got that error ( 184 End-to-End_Error ).
At that time I just removed, formatted on another machine and added it again. The pool reconstructed and it stayed ok for one year. Now, from time to time, that error appears, and I just make zpool-clear and it stays "good" for some time.
I will have to replace it some time, but for now its usable.

WI_Hedgehog · Mar 13, 2023

S.M.A.R.T. #184: Part of Hewlett-Packard's SMART IV technology, as well as part of other vendors' IO Error Detection and Correction schemas, and it contains a count of parity errors which occur in the data path to the media via the drive's cache RAM.

It's not as important as what else is going on to cause that flag to be set. In the Original Post the drive, from a brief look, seemed to be dying of old age even though it was 3-3/4 years old.

zamana said:

It's kind of hard to say without knowing the use, but for a drive that's not that old this one is also looking old. My drives that have 5 years run time look better than this, my 8 year old server drives running databases 24/7/365 look more like the above.

I'm new to digging into S.M.A.R.T. logs so it's really interesting, but don't have enough drive experience to say conclusively what the situation is.

Important Announcement for The TrueNAS Community.

Failed SMART usage Attribute: 184 End-to-End_Error

IsaacN

Cadet

Glorious1

Guru

IsaacN

Cadet

IsaacN

Cadet

Ericloewe

Server Wrangler

IsaacN

Cadet

zamana

Contributor

Glorious1

Guru

João Oliveira

Cadet

WI_Hedgehog

Guru

Similar threads

Important Announcement for The TrueNAS Community.