FreeNAS 11.1-U3
Supermicro X11SSL-CF with six Toshiba DT01ACA3 drives connected to the LSI 3008 (FW PH15.00.03.00).
I got a critical alert today:
During the initial testing and setup a couple of days ago I've received the same alert for /dev/da1. Both then and now, the drives respond to SMART reads and show good health. I've since (after the initial testing and /dev/da1 error) destroyed the pool and did a fresh install and setup, but now the same thing happened with /dev/da3.
What could be the issue? I'm setting this NAS up to take over the data role for the whole office and need it to be reliable.
Supermicro X11SSL-CF with six Toshiba DT01ACA3 drives connected to the LSI 3008 (FW PH15.00.03.00).
I got a critical alert today:
Code:
CRITICAL: March 24, 2018, 8:52 a.m. - Device: /dev/da3 [SAT], failed to read SMART Attribute Data CRITICAL: March 24, 2018, 8:48 a.m. - The volume pool1 state is DEGRADED: One or more devices are faulted in response to persistent errors. Sufficient replicas exist for the pool to continue functioning in a degraded state.
During the initial testing and setup a couple of days ago I've received the same alert for /dev/da1. Both then and now, the drives respond to SMART reads and show good health. I've since (after the initial testing and /dev/da1 error) destroyed the pool and did a fresh install and setup, but now the same thing happened with /dev/da3.
What could be the issue? I'm setting this NAS up to take over the data role for the whole office and need it to be reliable.
Code:
Mar 24 08:47:34 FreeNAS (da3:mpr0:0:5:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 length 0 SMID 343 Aborting command 0xfffffe0000ee1d10 Mar 24 08:47:34 FreeNAS mpr0: Sending reset from mprsas_send_abort for target ID 5 Mar 24 08:47:34 FreeNAS smartd[2977]: Device: /dev/da3 [SAT], failed to read SMART Attribute Data Mar 24 08:47:35 FreeNAS (pass3:mpr0:0:5:0): ATA COMMAND PASS THROUGH(16). CDB: 85 08 0e 00 d0 00 01 00 00 00 4f 00 c2 00 b0 00 length 512 SMID 374 terminated ioc 804b loginfo 31130000 scsi 0 state c xfer 0 Mar 24 08:47:35 FreeNAS mpr0: Unfreezing devq for target ID 5 Mar 24 08:47:35 FreeNAS (da3:mpr0:0:5:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 Mar 24 08:47:35 FreeNAS (da3:mpr0:0:5:0): CAM status: Command timeout Mar 24 08:47:35 FreeNAS (da3:mpr0:0:5:0): Retrying command Mar 24 08:47:35 FreeNAS ZFS: vdev state changed, pool_guid=5585696111870732690 vdev_guid=14774311635562606667 Mar 24 08:47:35 FreeNAS ZFS: vdev state changed, pool_guid=5585696111870732690 vdev_guid=14774311635562606667 Mar 24 08:47:35 FreeNAS (da3:mpr0:0:5:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 Mar 24 08:47:35 FreeNAS (da3:mpr0:0:5:0): CAM status: SCSI Status Error Mar 24 08:47:35 FreeNAS (da3:mpr0:0:5:0): SCSI status: Check Condition Mar 24 08:47:35 FreeNAS (da3:mpr0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) Mar 24 08:47:35 FreeNAS (da3:mpr0:0:5:0): Error 6, Retries exhausted Mar 24 08:47:35 FreeNAS (da3:mpr0:0:5:0): Invalidating pack Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_write_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[WRITE(offset=249856, length=4096)] Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_write_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[WRITE(offset=512000, length=4096)] Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_read_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[READ(offset=270336, length=8192)] Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_read_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[READ(offset=2998444761088, length=8192)] Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_read_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[READ(offset=2998445023232, length=8192)] Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_write_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[WRITE(offset=2998445002752, length=4096)] Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_write_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[WRITE(offset=2998445264896, length=4096)] Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_read_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[READ(offset=270336, length=8192)] Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_read_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[READ(offset=2998444761088, length=8192)] Mar 24 08:47:35 FreeNAS GEOM_ELI: g_eli_read_done() failed (error=6) gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli[READ(offset=2998445023232, length=8192)]
Code:
smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.1-STABLE amd64] (local build) Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Family: Toshiba 3.5" DT01ACA... Desktop HDD Device Model: TOSHIBA DT01ACA300 Serial Number: 55C5P15GS LU WWN Device Id: 5 000039 fe3c294d4 Firmware Version: MX6OABB0 User Capacity: 3,000,592,982,016 bytes [3.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Rotation Rate: 7200 rpm Form Factor: 3.5 inches Device is: In smartctl database [for details use: -P show] ATA Version is: ATA8-ACS T13/1699-D revision 4 SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Sat Mar 24 15:10:38 2018 CET SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x84) Offline data collection activity was suspended by an interrupting command from host. Auto Offline Data Collection: Enabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: (22078) seconds. Offline data collection capabilities: (0x5b) SMART execute Offline immediate. Auto Offline data collection on/off support. Suspend Offline collection upon new command. Offline surface scan supported. Self-test supported. No Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 1) minutes. Extended self-test routine recommended polling time: ( 368) minutes. SCT capabilities: (0x003d) SCT Status supported. SCT Error Recovery Control supported. SCT Feature Control supported. SCT Data Table supported. SMART Attributes Data Structure revision number: 16 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000b 100 100 016 Pre-fail Always - 0 2 Throughput_Performance 0x0005 140 140 054 Pre-fail Offline - 69 3 Spin_Up_Time 0x0007 134 134 024 Pre-fail Always - 428 (Average 430) 4 Start_Stop_Count 0x0012 100 100 000 Old_age Always - 88 5 Reallocated_Sector_Ct 0x0033 100 100 005 Pre-fail Always - 0 7 Seek_Error_Rate 0x000b 100 100 067 Pre-fail Always - 0 8 Seek_Time_Performance 0x0005 124 124 020 Pre-fail Offline - 33 9 Power_On_Hours 0x0012 100 100 000 Old_age Always - 491 10 Spin_Retry_Count 0x0013 100 100 060 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 88 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 98 193 Load_Cycle_Count 0x0012 100 100 000 Old_age Always - 98 194 Temperature_Celsius 0x0002 142 142 000 Old_age Always - 42 (Min/Max 17/50) 196 Reallocated_Event_Count 0x0032 100 100 000 Old_age Always - 0 197 Current_Pending_Sector 0x0022 100 100 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0008 100 100 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x000a 200 200 000 Old_age Always - 0 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error # 1 Extended offline Completed without error 00% 239 - # 2 Short offline Completed without error 00% 234 - # 3 Extended offline Completed without error 00% 92 - # 4 Short offline Completed without error 00% 86 - # 5 Short offline Completed without error 00% 39 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
Code:
[root@FreeNAS ~]# zpool status pool: pool1 state: DEGRADED status: One or more devices are faulted in response to persistent errors. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Replace the faulted device, or use 'zpool clear' to mark the device repaired. scan: none requested config: NAME STATE READ WRITE CKSUM pool1 DEGRADED 0 0 0 mirror-0 ONLINE 0 0 0 gptid/37303cdf-2e8e-11e8-9e93-0cc47a868d02.eli ONLINE 0 0 0 gptid/3a7cdb6d-2e8e-11e8-9e93-0cc47a868d02.eli ONLINE 0 0 0 mirror-1 DEGRADED 0 0 0 gptid/40bcca1a-2e8e-11e8-9e93-0cc47a868d02.eli ONLINE 0 0 0 gptid/441118bb-2e8e-11e8-9e93-0cc47a868d02.eli FAULTED 6 4 0 too many errors mirror-2 ONLINE 0 0 0 gptid/4a6bd536-2e8e-11e8-9e93-0cc47a868d02.eli ONLINE 0 0 0 gptid/4dcdc4cb-2e8e-11e8-9e93-0cc47a868d02.eli ONLINE 0 0 0 errors: No known data errors pool: freenas-boot state: ONLINE scan: none requested config: NAME STATE READ WRITE CKSUM freenas-boot ONLINE 0 0 0 ada0p2 ONLINE 0 0 0 errors: No known data errors
Last edited: