Hi everybody
I've got the alert for the first time a few days ago that my pool is degraded due to 15 read errors on one of the drives (see picture below). I've completed a long S.M.A.R.T. test and did a scrub since which did not resolve it. The hardware of my PC is in my signature.
Output for smartctl -a /dev/sdf
Output for zpool status -v
While the the S.M.A.R.T. tests don't show anything remarkable (as far as i can tell) and the pool status sais "no known data errors" I'm at a loss to what the problem is. What do I need to do to clear the degraded status?
If of importance: a few days prior to the error showing up i shut down the system via webinterface, opened the case up and cleaned it and the airfilters with canned air.
I've got the alert for the first time a few days ago that my pool is degraded due to 15 read errors on one of the drives (see picture below). I've completed a long S.M.A.R.T. test and did a scrub since which did not resolve it. The hardware of my PC is in my signature.
Output for smartctl -a /dev/sdf
Code:
root@truenas[~]# smartctl -a /dev/sdf
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.15.131+truenas] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Device Model: WDC WD80EFZZ-68BTXN0
Serial Number: WD-CA2L12BK
LU WWN Device Id: 5 0014ee 2c0438d9b
Firmware Version: 81.00A81
User Capacity: 8,001,563,222,016 bytes [8.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5640 rpm
Form Factor: 3.5 inches
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: ACS-3 T13/2161-D revision 5
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Tue Nov 7 11:29:48 2023 CET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: (18164) seconds.
Offline data collection
capabilities: (0x11) SMART execute Offline immediate.
No Auto Offline data collection support.
Suspend Offline collection upon new
command.
No Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
No Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 884) minutes.
SCT capabilities: (0x303d) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0
3 Spin_Up_Time 0x0027 188 188 021 Pre-fail Always - 9566
4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 20
5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0
7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0
9 Power_On_Hours 0x0032 093 093 000 Old_age Always - 5496
10 Spin_Retry_Count 0x0032 100 253 000 Old_age Always - 0
11 Calibration_Retry_Count 0x0032 100 253 000 Old_age Always - 0
12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 11
192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 7
193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 28
194 Temperature_Celsius 0x0022 119 097 000 Old_age Always - 33
196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0
197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0030 100 253 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0
200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Extended offline Completed without error 00% 5488 -
# 2 Short offline Completed without error 00% 5413 -
# 3 Short offline Completed without error 00% 5365 -
# 4 Short offline Completed without error 00% 5317 -
# 5 Short offline Completed without error 00% 5244 -
# 6 Short offline Completed without error 00% 5196 -
# 7 Short offline Completed without error 00% 5148 -
# 8 Short offline Completed without error 00% 5076 -
# 9 Short offline Completed without error 00% 5028 -
#10 Short offline Completed without error 00% 4980 -
#11 Short offline Completed without error 00% 4908 -
#12 Short offline Completed without error 00% 4860 -
#13 Short offline Completed without error 00% 4812 -
#14 Short offline Completed without error 00% 4740 -
#15 Short offline Completed without error 00% 4693 -
#16 Short offline Completed without error 00% 4645 -
#17 Short offline Completed without error 00% 4573 -
#18 Short offline Completed without error 00% 4525 -
#19 Extended offline Completed without error 00% 4480 -
#20 Short offline Completed without error 00% 4405 -
#21 Short offline Completed without error 00% 4357 -
Selective Self-tests/Logging not supportedOutput for zpool status -v
Code:
root@truenas[~]# zpool status -v
pool: boot-pool
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 00:02:01 with 0 errors on Wed Nov 1 03:47:02 2023
config:
NAME STATE READ WRITE CKSUM
boot-pool ONLINE 0 0 0
sda3 ONLINE 0 0 0
errors: No known data errors
pool: storage0
state: DEGRADED
status: One or more devices are faulted in response to persistent errors.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Replace the faulted device, or use 'zpool clear' to mark the device
repaired.
scan: scrub repaired 0B in 05:30:34 with 0 errors on Tue Nov 7 03:15:10 2023
config:
NAME STATE READ WRITE CKSUM
storage0 DEGRADED 0 0 0
raidz2-0 DEGRADED 0 0 0
2efc6d96-3c27-490c-953b-9b205f81e679 FAULTED 15 0 0 too many errors
e406c91a-5d0e-407d-8ec2-c7b9d4ee4025 ONLINE 0 0 0
c620bc69-66c3-4589-8e9b-a375bc3ea9c5 ONLINE 0 0 0
ab75c80d-f093-42f5-81d1-2c68ecd07428 ONLINE 0 0 0
aa729717-a79c-4e9a-b47c-7a08c2b00f6b ONLINE 0 0 0
errors: No known data errorsWhile the the S.M.A.R.T. tests don't show anything remarkable (as far as i can tell) and the pool status sais "no known data errors" I'm at a loss to what the problem is. What do I need to do to clear the degraded status?
If of importance: a few days prior to the error showing up i shut down the system via webinterface, opened the case up and cleaned it and the airfilters with canned air.