So I have been running my Freenas server for ~ 4 months and during that time 3 of the scrubs have come up with minor errors similar to the one below. The latest scrub gave the following error messages: I will attach all of the information as one big file too for easier viewing.
My System specs are:
I have the system run a scrub every 2 weeks and have the hard drives run: short test daily, long test weekly. All of the hard drives show "Completed without error " for all tests and have none of the typical trouble signs (ie. pending sectors, reallocated sectors, etc). I have attached all of the hard drives smartctl output in the freenas logs.txt. I The machine is running ECC memory and has an UPS. Before bring the server online memory and hard drives were tested for over a week each. I checked & reattached the SAS and power cables just incase any were loose. I am using these SAS cables: https://www.amazon.com/gp/product/B01GPDBHDY/ and using the stock power cables that came with my PSU (aka no goofy adapters). I don't believe I lost any data since the scrubs show "No known data errors", but still it causes me not to fully trust the server until these issues go away.
Thanks for any help
Code:
freenas.local kernel log messages: > (da8:mpr0:0:7:0): READ(16). CDB: 88 00 00 00 00 01 a0 87 57 b0 00 00 00 e0 00 00 length 114688 SMID 770 terminated ioc 804b scsi 0 state 0 xfer 0 > (da8:mpr0:0:7:0): READ(16). CDB: 88 00 00 00 00 01 a0 87 57 b0 00 00 00 e0 00 00 > (da8:mpr0:0:7:0): CAM status: CCB request completed with an error > (da8:mpr0:0:7:0): Retrying command > (da8:mpr0:0:7:0): READ(16). CDB: 88 00 00 00 00 01 a0 87 56 c8 00 00 00 e8 00 00 > (da8:mpr0:0:7:0): CAM status: SCSI Status Error > (da8:mpr0:0:7:0): SCSI status: Check Condition > (da8:mpr0:0:7:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) > (da8:mpr0:0:7:0): Info: 0x1a08756c8 > (da8:mpr0:0:7:0): Error 5, Unretryable error > (da3:mpr0:0:2:0): READ(16). CDB: 88 00 00 00 00 01 a2 0b 66 08 00 00 00 30 00 00 length 24576 SMID 509 terminated ioc 804b scsi 0 state 0 xfer 0 > (da3:mpr0:0:2:0): READ(16). CDB: 88 00 00 00 00 01 a2 0b 66 08 00 00 00 30 00 00 > (da3:mpr0:0:2:0): CAM status: CCB request completed with an error > (da3:mpr0:0:2:0): Retrying command > (da3:mpr0:0:2:0): READ(16). CDB: 88 00 00 00 00 01 a2 0b 65 28 00 00 00 e0 00 00 > (da3:mpr0:0:2:0): CAM status: SCSI Status Error > (da3:mpr0:0:2:0): SCSI status: Check Condition > (da3:mpr0:0:2:0): SCSI sense: MEDIUM ERROR asc:11,0 (Unrecovered read error) > (da3:mpr0:0:2:0): Info: 0x1a20b6528 > (da3:mpr0:0:2:0): Error 5, Unretryable error -- End of security output -- [root@freenas] ~# zpool status pool: freenas-boot state: ONLINE scan: scrub repaired 0 in 0h0m with 0 errors on Mon Jan 16 03:45:11 2017 config: NAME STATE READ WRITE CKSUM freenas-boot ONLINE 0 0 0 da0p2 ONLINE 0 0 0 errors: No known data errors pool: tank state: ONLINE scan: scrub repaired 176K in 12h56m with 0 errors on Wed Jan 18 10:56:07 2017 config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz2-0 ONLINE 0 0 0 gptid/c375e1a1-a141-11e6-8641-0cc47ac565d4 ONLINE 0 0 0 gptid/c42a5d2c-a141-11e6-8641-0cc47ac565d4 ONLINE 0 0 0 gptid/c4d3f78e-a141-11e6-8641-0cc47ac565d4 ONLINE 0 0 0 gptid/c576f47a-a141-11e6-8641-0cc47ac565d4 ONLINE 0 0 0 gptid/c621429c-a141-11e6-8641-0cc47ac565d4 ONLINE 0 0 0 gptid/c6c8e874-a141-11e6-8641-0cc47ac565d4 ONLINE 0 0 0 gptid/c771fa0c-a141-11e6-8641-0cc47ac565d4 ONLINE 0 0 0 gptid/c82043ca-a141-11e6-8641-0cc47ac565d4 ONLINE 0 0 0 errors: No known data errors
My System specs are:
Code:
Motherboard: Supermicro X11SSH-CTF CPU: Intel Xeon E3-1230 V5 3.4GHz Quad-Core Processor Memory: Crucial 32GB Kit (2 x 16GB) DDR4-2133 ECC 2* Storage: Sandisk Extreme Pro 240GB 2.5" Solid State Drive for ESX datastore 8* Storage: Western Digital Red 6TB 3.5" 5400RPM Internal Hard Drive ($234.52 @ Newegg) Case: Fractal Design Define R5 (Black) ATX Mid Tower Case ($119.98 @ Newegg) Power Supply: SeaSonic 660W 80+ Platinum Certified Fully-Modular ATX Power Supply ($104.99 @ Newegg) FreeNAS-9.10.2 (a476f16) ESX 6.0U2 with the Motherboard's LSI controller flashed to IT mode and passthrough to the Freenas VM. The Freenas VM is assigned 2 VCPU and 20 GB reserved memory.
I have the system run a scrub every 2 weeks and have the hard drives run: short test daily, long test weekly. All of the hard drives show "Completed without error " for all tests and have none of the typical trouble signs (ie. pending sectors, reallocated sectors, etc). I have attached all of the hard drives smartctl output in the freenas logs.txt. I The machine is running ECC memory and has an UPS. Before bring the server online memory and hard drives were tested for over a week each. I checked & reattached the SAS and power cables just incase any were loose. I am using these SAS cables: https://www.amazon.com/gp/product/B01GPDBHDY/ and using the stock power cables that came with my PSU (aka no goofy adapters). I don't believe I lost any data since the scrubs show "No known data errors", but still it causes me not to fully trust the server until these issues go away.
Thanks for any help