Hi,
my pool has degraded and one of my drives has faulted. If I understand correctly this does not necessarily mean the drive is dead.
I have started a scrub and I wanted to ask if these outputs could get me some more info:
Faulted disk sda:
I've noticed sdc has 2 errors aswell so just adding this to be sure:
Don't really know much so any help would be much appreciated
my pool has degraded and one of my drives has faulted. If I understand correctly this does not necessarily mean the drive is dead.
I have started a scrub and I wanted to ask if these outputs could get me some more info:
ossy@jes01:~$ sudo zpool status -v iroh
pool: iroh
state: DEGRADED
status: One or more devices are faulted in response to persistent errors.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Replace the faulted device, or use 'zpool clear' to mark the device
repaired.
scan: scrub repaired 0B in 23:01:44 with 0 errors on Mon Nov 27 01:01:50 2023
config:
NAME STATE READ WRITE CKSUM
iroh DEGRADED 0 0 0
raidz1-0 DEGRADED 0 0 0
02dc06e8-b70a-4f60-a421-a58a4eec1eef ONLINE 2 0 0
601b245e-f067-4322-ba37-33ccc08e4761 ONLINE 0 0 0
23b6ef6c-5011-4047-99d0-2b9b7554adfb ONLINE 0 0 0
2f1eff46-5428-44bb-92a6-905de1324a6a FAULTED 13 43 0 too many errors
errors: No known data errors
Faulted disk sda:
ossy@jes01:~$ sudo smartctl -a /dev/sda
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.15.79+truenas] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Device Model: ST4000VN006-3CW104
Serial Number: ZW601853
LU WWN Device Id: 5 000c50 0e4ec51b6
Firmware Version: SC60
User Capacity: 4,000,787,030,016 bytes [4.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Form Factor: 3.5 inches
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: ACS-3 T13/2161-D revision 5
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Wed Dec 20 11:24:21 2023 CET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 0) seconds.
Offline data collection
capabilities: (0x73) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
No Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 457) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x70bd) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 082 064 006 Pre-fail Always - 145616562
3 Spin_Up_Time 0x0003 096 096 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 20
5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 088 060 045 Pre-fail Always - 577065762
9 Power_On_Hours 0x0032 088 088 000 Old_age Always - 10663
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 20
183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 4295032833
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 068 054 040 Old_age Always - 32 (Min/Max 23/44)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 14
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 20
194 Temperature_Celsius 0x0022 032 046 000 Old_age Always - 32 (0 21 0 0 0)
195 Hardware_ECC_Recovered 0x001a 082 064 000 Old_age Always - 145616562
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 10662 (192 47 0)
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 32760759549
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 1008091134678
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed without error 00% 10662 -
# 2 Short offline Completed without error 00% 10654 -
# 3 Short offline Completed without error 00% 10630 -
# 4 Short offline Completed without error 00% 10606 -
# 5 Short offline Completed without error 00% 10582 -
# 6 Short offline Completed without error 00% 10558 -
# 7 Extended offline Completed without error 00% 10542 -
# 8 Short offline Completed without error 00% 10510 -
# 9 Short offline Completed without error 00% 10486 -
#10 Short offline Completed without error 00% 10462 -
#11 Short offline Completed without error 00% 10438 -
#12 Short offline Completed without error 00% 10414 -
#13 Short offline Completed without error 00% 10390 -
#14 Short offline Completed without error 00% 10366 -
#15 Short offline Completed without error 00% 10342 -
#16 Short offline Completed without error 00% 10318 -
#17 Short offline Completed without error 00% 10294 -
#18 Short offline Completed without error 00% 10270 -
#19 Short offline Completed without error 00% 10246 -
#20 Short offline Completed without error 00% 10222 -
#21 Short offline Completed without error 00% 10198 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
I've noticed sdc has 2 errors aswell so just adding this to be sure:
ossy@jes01:~$ sudo smartctl -a /dev/sdc
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.15.79+truenas] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Device Model: ST4000VN006-3CW104
Serial Number: ZW60188X
LU WWN Device Id: 5 000c50 0e4ec6c18
Firmware Version: SC60
User Capacity: 4,000,787,030,016 bytes [4.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 5400 rpm
Form Factor: 3.5 inches
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: ACS-3 T13/2161-D revision 5
SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Wed Dec 20 11:23:24 2023 CET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
General SMART Values:
Offline data collection status: (0x00) Offline data collection activity
was never started.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 0) seconds.
Offline data collection
capabilities: (0x73) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
No Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 448) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x70bd) SCT Status supported.
SCT Error Recovery Control supported.
SCT Feature Control supported.
SCT Data Table supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 074 064 006 Pre-fail Always - 26148608
3 Spin_Up_Time 0x0003 096 096 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 20
5 Reallocated_Sector_Ct 0x0033 100 100 010 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 088 060 045 Pre-fail Always - 570921966
9 Power_On_Hours 0x0032 088 088 000 Old_age Always - 10663
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 20
183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0
189 High_Fly_Writes 0x003a 100 100 000 Old_age Always - 0
190 Airflow_Temperature_Cel 0x0022 066 054 040 Old_age Always - 34 (Min/Max 23/45)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 14
193 Load_Cycle_Count 0x0032 100 100 000 Old_age Always - 20
194 Temperature_Celsius 0x0022 034 046 000 Old_age Always - 34 (0 21 0 0 0)
195 Hardware_ECC_Recovered 0x001a 074 064 000 Old_age Always - 26148608
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 1
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 10662 (121 107 0)
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 33915199765
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 574757039176
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed without error 00% 10654 -
# 2 Short offline Completed without error 00% 10630 -
# 3 Short offline Completed without error 00% 10606 -
# 4 Short offline Completed without error 00% 10582 -
# 5 Short offline Completed without error 00% 10558 -
# 6 Extended offline Completed without error 00% 10542 -
# 7 Short offline Completed without error 00% 10510 -
# 8 Short offline Completed without error 00% 10486 -
# 9 Short offline Completed without error 00% 10462 -
#10 Short offline Completed without error 00% 10438 -
#11 Short offline Completed without error 00% 10414 -
#12 Short offline Completed without error 00% 10390 -
#13 Short offline Completed without error 00% 10366 -
#14 Short offline Completed without error 00% 10342 -
#15 Short offline Completed without error 00% 10318 -
#16 Short offline Completed without error 00% 10294 -
#17 Short offline Completed without error 00% 10270 -
#18 Short offline Completed without error 00% 10246 -
#19 Short offline Completed without error 00% 10222 -
#20 Short offline Completed without error 00% 10198 -
#21 Short offline Completed without error 00% 10174 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
Don't really know much so any help would be much appreciated