Boot disk sda error

[dankoh]

Hi guys.

This morning I got some errors. SSD disk is 2 months old.

Any idea on how to proceed?

Critical​

Boot pool status is ONLINE: One or more devices has experienced an unrecoverable error. An attempt was made to correct the error. Applications are unaffected..​

2023-04-02 03:45:57 (Europe/Zagreb)
Dismiss

Critical​

Device: /dev/sda [SAT], ATA error count increased from 0 to 1.​

2023-04-02 04:01:15 (Europe/Zagreb)

Info​

Scrub of pool 'boot-pool' finished.​

2023-04-02 03:45:09 (Europe/Zagreb)
Dismiss

Info​

Scrub of pool 'boot-pool' started.​

2023-04-02 03:45:02 (Europe/Zagreb)
Dismiss






Results of: smartctl -a /dev/sda

smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.15.79+truenas] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Device Model: SSD_2.5"_TLC_120GB_InnovationIT
Serial Number: 791232207020020
Firmware Version: U1230A0
User Capacity: 120,034,123,776 bytes [120 GB]
Sector Size: 512 bytes logical/physical
Rotation Rate: Solid State Device
Form Factor: 2.5 inches
TRIM Command: Available
Device is: Not in smartctl database [for details use: -P showall]
ATA Version is: ACS-2 T13/2015-D revision 3
SATA Version is: SATA 3.2, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is: Sun Apr 2 08:52:37 2023 CEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status: (0x02) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Disabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 120) seconds.
Offline data collection
capabilities: (0x11) SMART execute Offline immediate.
No Auto Offline data collection support.
Suspend Offline collection upon new
command.
No Offline surface scan supported.
Self-test supported.
No Conveyance Self-test supported.
No Selective Self-test supported.
SMART capabilities: (0x0002) Does not save SMART data before
entering power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 2) minutes.
Extended self-test routine
recommended polling time: ( 10) minutes.
SCT capabilities: (0x0001) SCT Status supported.

SMART Attributes Data Structure revision number: 1
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x0032 100 100 050 Old_age Always - 0
5 Reallocated_Sector_Ct 0x0032 100 100 050 Old_age Always - 0
9 Power_On_Hours 0x0032 100 100 050 Old_age Always - 1112
12 Power_Cycle_Count 0x0032 100 100 050 Old_age Always - 5
160 Unknown_Attribute 0x0032 100 100 050 Old_age Always - 0
161 Unknown_Attribute 0x0033 100 100 050 Pre-fail Always - 100
163 Unknown_Attribute 0x0032 100 100 050 Old_age Always - 44
164 Unknown_Attribute 0x0032 100 100 050 Old_age Always - 225
165 Unknown_Attribute 0x0032 100 100 050 Old_age Always - 1
166 Unknown_Attribute 0x0032 100 100 050 Old_age Always - 0
167 Unknown_Attribute 0x0032 100 100 050 Old_age Always - 0
168 Unknown_Attribute 0x0032 100 100 050 Old_age Always - 7000
169 Unknown_Attribute 0x0032 100 100 050 Old_age Always - 100
175 Program_Fail_Count_Chip 0x0032 100 100 050 Old_age Always - 0
176 Erase_Fail_Count_Chip 0x0032 100 100 050 Old_age Always - 0
177 Wear_Leveling_Count 0x0032 100 100 050 Old_age Always - 0
178 Used_Rsvd_Blk_Cnt_Chip 0x0032 100 100 050 Old_age Always - 0
181 Program_Fail_Cnt_Total 0x0032 100 100 050 Old_age Always - 0
182 Erase_Fail_Count_Total 0x0032 100 100 050 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 050 Old_age Always - 3
194 Temperature_Celsius 0x0022 100 100 050 Old_age Always - 37
195 Hardware_ECC_Recovered 0x0032 100 100 050 Old_age Always - 0
196 Reallocated_Event_Count 0x0032 100 100 050 Old_age Always - 0
197 Current_Pending_Sector 0x0032 100 100 050 Old_age Always - 0
198 Offline_Uncorrectable 0x0032 100 100 050 Old_age Always - 0
199 UDMA_CRC_Error_Count 0x0032 100 100 050 Old_age Always - 1
232 Available_Reservd_Space 0x0032 100 100 050 Old_age Always - 100
241 Total_LBAs_Written 0x0030 100 100 050 Old_age Offline - 562
242 Total_LBAs_Read 0x0030 100 100 050 Old_age Offline - 1017
245 Unknown_Attribute 0x0032 100 100 050 Old_age Always - 0

SMART Error Log Version: 1
ATA Error Count: 1
CR = Command Register [HEX]
FR = Features Register [HEX]
SC = Sector Count Register [HEX]
SN = Sector Number Register [HEX]
CL = Cylinder Low Register [HEX]
CH = Cylinder High Register [HEX]
DH = Device/Head Register [HEX]
DC = Device Command Register [HEX]
ER = Error register [HEX]
ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error -3 occurred at disk power-on lifetime: 0 hours (0 days + 0 hours)
When the command that caused the error occurred, the device was active or idle.

After command completion occurred, registers were:
ER ST SC SN CL CH DH
-- -- -- -- -- -- --
04 51 00 00 00 00 40 Error: ABRT

Commands leading to the command that caused the error were:
CR FR SC SN CL CH DH DC Powered_Up_Time Command/Feature_Name
-- -- -- -- -- -- -- -- ---------------- --------------------
b0 d0 01 00 4f c2 00 08 00:00:00.000 SMART READ DATA
b0 d1 01 01 4f c2 00 08 00:00:00.000 SMART READ ATTRIBUTE THRESHOLDS [OBS-4]
b0 da 00 00 4f c2 00 08 00:00:00.000 SMART RETURN STATUS
b0 d5 01 00 4f c2 00 08 00:00:00.000 SMART READ LOG
b0 d5 01 01 4f c2 00 08 00:00:00.000 SMART READ LOG

SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Short offline Completed without error 00% 1112 -
# 2 Short offline Completed without error 00% 1080 -
# 3 Short offline Completed without error 00% 342 -

Selective Self-tests/Logging not supported

 

[JohnDigital]

199 UDMA_CRC_Error_Count 0x0032 100 100 050 Old_age Always - 1

This normally points to a bad sata cable, power splitter or loose or tight wiring. Or gremlins, ive seen gremlins cause this.
Do
zpool status -v

 

[dankoh]

This normally points to a bad sata cable, power splitter or loose or tight wiring. Or gremlins, ive seen gremlins cause this.
Do
zpool status -v

Hi.

Ok, will replace cables.

status -v

pool: boot-pool
state: ONLINE
status: One or more devices has experienced an unrecoverable error. An
attempt was made to correct the error. Applications are unaffected.
action: Determine if the device needs to be replaced, and clear the errors
using 'zpool clear' or replace the device with 'zpool replace'.
see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-9P
scan: scrub repaired 0B in 00:00:07 with 0 errors on Sun Apr 2 03:45:09 2023
config:

NAME STATE READ WRITE CKSUM
boot-pool ONLINE 0 0 0
sda3 ONLINE 3 0 0

errors: No known data errors

pool: mainpool
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 01:07:53 with 0 errors on Wed Feb 1 10:07:54 2023
config:

NAME STATE READ WRITE CKSUM
mainpool ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
af2445fd-333b-11ec-8b1b-2cfda1729a13 ONLINE 0 0 0
afaa11c4-333b-11ec-8b1b-2cfda1729a13 ONLINE 0 0 0

errors: No known data errors

pool: tank
state: ONLINE
config:

NAME STATE READ WRITE CKSUM
tank ONLINE 0 0 0
072b4d7c-d757-4129-b8b6-bdf4f348d74a ONLINE 0 0 0

errors: No known data errors

 

[JohnDigital]

Yep, then its telling you to do zpool clear POOLNAME, then id scrub it, and watch for any error to return.

 

[NugentS]

Just in case make sure you have a copy of the config file somewhere safe, not on the NAS

 

[dankoh]

I uderstand. Thanks for your time.