AHCICH0 - Timeout on slot 26 port 0

[kss18]

First time I am seeing this error message, any pointers appreciated. Am I losing one of my hard disks? The machine is a GEn8 Proliant HP microserver with Xeon processor and 8GB RAM.

Another identical machine on the same network did not have this problem.

Thanks.



nas9.local kernel log messages:
> ahcich0: Timeout on slot 26 port 0
> ahcich0: is 00000000 cs 04000000 ss 00000000 rs 04000000 tfd c0 serr 00000000 cmd 0000fa17
> (ada0:ahcich0:0:0:0): FLUSHCACHE48. ACB: ea 00 00 00 00 40 00 00 00 00 00 00
> (ada0:ahcich0:0:0:0): CAM status: Command timeout
> (ada0:ahcich0:0:0:0): Retrying command
> (aprobe0:ahcich0:0:0:0): SETFEATURES ENABLE SATA FEATURE. ACB: ef 10 00 00 00 40 00 00 00 00 02 00
> (aprobe0:ahcich0:0:0:0): CAM status: ATA Status Error
> (aprobe0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 04 (ABRT )
> (aprobe0:ahcich0:0:0:0): RES: 51 04 00 00 00 40 00 00 00 02 00
> (aprobe0:ahcich0:0:0:0): Retrying command
> (aprobe0:ahcich0:0:0:0): SETFEATURES ENABLE SATA FEATURE. ACB: ef 10 00 00 00 40 00 00 00 00 02 00
> (aprobe0:ahcich0:0:0:0): CAM status: ATA Status Error
> (aprobe0:ahcich0:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 04 (ABRT )
> (aprobe0:ahcich0:0:0:0): RES: 51 04 00 00 00 40 00 00 00 02 00
> (aprobe0:ahcich0:0:0:0): Error 5, Retries exhausted

-- End of security output --

 

[Bidule0hm]

Can you post the output of smartctl -a for each of your drives (between code tags) please?

 

[kss18]

There are 4 disks - ada0 is 250GB; Drives ada1, ada2, and ada3 are all 2TB; ada1 and ada2 are mirrored, ada3 is a spare.
I have attached all four to this post because of their length.

 

[kss18]

I also ran your smart shell script and have attached here. Thanks for your help.

 

[Bidule0hm]

1) There is no SMART test scheduled one those drives. This is a bad thing and you should fix this as soon as possible after you've solved the current problem.
2) ada0 shows a very high number of command timeouts. Try to reseat the connectors to see if it makes a difference.
3) ada2 shows some reallocated sectors. Because of 1) we don't know when it has happened, if there is uncorrectable sectors, ...

I recommend you to execute a long SMART test on each drive (smartctl -t long /dev/adaX with X = 0 to 3). Note that a long test is, well, long (several hours) so don't reboot the server in the middle of the test.

How the drives are connected to the server? raid controller?