IO failures but smart test is OK?

[mvcad]

Hey guys,
I have zoneminder recording videos to a pool called "cams" on a single hard drive (strip).
It all starts with this warning:

Code:

New alerts:
* New feature flags are available for volume cams. Refer to the "Upgrading a ZFS Pool" subsection in the User Guide "Installing and Upgrading" chapter and "Upgrading" section for more instructions.

then I get this one:

Code:

Gone alerts:
* The volume cams state is UNAVAIL: One or more devices are faulted in response to IO failures.
* New feature flags are available for volume cams. Refer to the "Upgrading a ZFS Pool" subsection in the User Guide "Installing and Upgrading" chapter and "Upgrading" section for more instructions.

and after these emails My FreeNAS box becomes unresponsive and I have to do a hard reset to get it back to work. then the history repeats again and again.

I have replaced the hard drive but no luck. admittedly I have been using 10 year old WD blue that I have laying around.

Howerver I have run extended SMART tests and they come back with no errors.
The only strange thing I have noiced is that this particular hard drive is always about 41 degrees, while my other HDD are about 30 degrees Celsius.

Any idea of what could be happening?
I am thinking of getting a new HDD and sata cable. Would I be wasting my money if I do?

this is the output of SMART test:

Code:

smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.2-STABLE amd64] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Caviar Blue (SATA)
Device Model:     WDC WD5000AAKS-60A7B2
Serial Number:    WD-WCAT00881846
LU WWN Device Id: 5 0014ee 2aee34b1a
Firmware Version: 03.03B03
User Capacity:    500,107,862,016 bytes [500 GB]
Sector Size:      512 bytes logical/physical
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS (minor revision not indicated)
SATA Version is:  SATA 2.5, 3.0 Gb/s
Local Time is:    Thu Feb  7 08:53:54 2019 AWST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)    Offline data collection activity
                    was completed without error.
                    Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)    The previous self-test routine completed
                    without error or no self-test has ever
                    been run.
Total time to complete Offline
data collection:         ( 8700) seconds.
Offline data collection
capabilities:              (0x5b) SMART execute Offline immediate.
                    Auto Offline data collection on/off support.
                    Suspend Offline collection upon new
                    command.
                    Offline surface scan supported.
                    Self-test supported.
                    No Conveyance Self-test supported.
                    Selective Self-test supported.
SMART capabilities:            (0x0003)    Saves SMART data before entering
                    power-saving mode.
                    Supports SMART auto save timer.
Error logging capability:        (0x01)    Error logging supported.
                    General Purpose Logging supported.
Short self-test routine
recommended polling time:      (   2) minutes.
Extended self-test routine
recommended polling time:      ( 103) minutes.
SCT capabilities:            (0x303f)    SCT Status supported.
                    SCT Error Recovery Control supported.
                    SCT Feature Control supported.
                    SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   172   160   021    Pre-fail  Always       -       4391
  4 Start_Stop_Count        0x0032   099   099   000    Old_age   Always       -       1391
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002f   100   253   051    Pre-fail  Always       -       0
  9 Power_On_Hours          0x0032   084   084   000    Old_age   Always       -       11766
 10 Spin_Retry_Count        0x0033   100   100   051    Pre-fail  Always       -       0
 11 Calibration_Retry_Count 0x0033   100   100   051    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   099   099   000    Old_age   Always       -       1387
184 End-to-End_Error        0x0033   100   100   097    Pre-fail  Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   099   000    Old_age   Always       -       17180131332
190 Airflow_Temperature_Cel 0x0022   058   053   045    Old_age   Always       -       42
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       96
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       1391
194 Temperature_Celsius     0x0022   105   100   000    Old_age   Always       -       42
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%     11766         -
# 2  Short offline       Completed without error       00%         0         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Thanks in advance

 

[hugovsky]

Full list of hardware and pool type, please.

 

[Johnny Fartpants]

I have replaced the hard drive but no luck

Do you mean that after you replace the drive the same errors appear?

At a glance the SMART output of the drive appears ok so I would suspect a wiring issue atm.

 

[mvcad]

Thank you all,

Full list of hardware and pool type, please.

My hardware is in my signature, plus a zfs pool of 1 off hdd for zoneminder data.

Do you mean that after you replace the drive the same errors appear?

yes, exactly.
I took the plunge and bought a brand new seagate skywolf 1TB to replace the failing hdd, also a new sata cable. I hope this fix the problem. I think this happens when the disk is full and zm starts overwriting the old data. I'll post if this is the case.

Thanks again