c32767a
Patron
- Joined
- Dec 13, 2012
- Messages
- 371
System:
reenas.local
Build FreeNAS-8.3.0-RELEASE-x64 (r12701M)
Platform Six-Core AMD Opteron(tm) Processor 2419 EE
Memory 32751MB
System Time Fri Dec 21 00:20:32 EST 2012
Uptime 12:20AM up 54 mins, 2 users
Load Average 2.29, 2.29, 2.55
Connected through 192.168.1.196
I'm experimenting with a new build and am getting the following kernel error when the disks are under heavy write load:
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 91 88 0 1 0 0 length 131072 SMID 378 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8e 88 0 1 0 0 length 131072 SMID 849 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8d 88 0 1 0 0 length 131072 SMID 415 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8b 88 0 1 0 0 length 131072 SMID 601 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8c 88 0 1 0 0 length 131072 SMID 409 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8f 88 0 1 0 0 length 131072 SMID 172 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 88 88 0 1 0 0 length 131072 SMID 903 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8a 88 0 1 0 0 length 131072 SMID 715 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 89 88 0 1 0 0 length 131072 SMID 880 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 90 88 0 1 0 0 length 131072 SMID 402 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 88 88 0 1 0 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): CAM status: SCSI Status Error
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): SCSI status: Check Condition
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
Dec 21 00:13:04 freenas kernel: (da4:mps1:0:3:0): WRITE(6). CDB: a 0 1 b8 8 0
Dec 21 00:13:04 freenas kernel: (da4:mps1:0:3:0): CAM status: SCSI Status Error
Dec 21 00:13:04 freenas kernel: (da4:mps1:0:3:0): SCSI status: Check Condition
Dec 21 00:13:04 freenas kernel: (da4:mps1:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
SMARTD doesn't turn anything up on any of the drives.
zpool scrub returns a clean bill of health, no errors or repairs.
The case is a 12 bay case and I've moved the drives around between bays with no effect. The problems seems to follow the drives, subject to the fact that it's 'sticky' to one drive per reboot.
drive location doesn't seen matter, nor does drive type.
The system is well capable of powering the full 12 bays. I'm only experimenting with 3 drives at the moment. No other bays are populated.
There are 2 controllers, both are LSI SAS9211-8i.
Disks are a couple new 3TB drives I had laying around as spares for a production NAS.
2 are:
<ATA ST3000DM001-1CH1 CC43> at scbus0 target 2 lun 0 (pass0,da0)
<ATA ST3000DM001-1CH1 CC43> at scbus1 target 2 lun 0 (pass3,da3)
and one is:
<ATA WDC WD30EZRX-00M 0A80> at scbus1 target 3 lun 0 (pass4,da4)
All are/were new out of the packaging today.
The LSI controllers have version 14 firmware on them.
Any thoughts as to where I should look? Is this a driver bug? Other than the syslog messages, I haven't been able to find any evidence of a failure anywhere.
With these 3 drives (yeah, I know.. one's a 5400 and all 3 are desktop drives.. I have cheap users to support.) the system can sustain 100MB/s writes, even with the syslog messages.
Thanks
reenas.local
Build FreeNAS-8.3.0-RELEASE-x64 (r12701M)
Platform Six-Core AMD Opteron(tm) Processor 2419 EE
Memory 32751MB
System Time Fri Dec 21 00:20:32 EST 2012
Uptime 12:20AM up 54 mins, 2 users
Load Average 2.29, 2.29, 2.55
Connected through 192.168.1.196
I'm experimenting with a new build and am getting the following kernel error when the disks are under heavy write load:
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 91 88 0 1 0 0 length 131072 SMID 378 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8e 88 0 1 0 0 length 131072 SMID 849 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8d 88 0 1 0 0 length 131072 SMID 415 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8b 88 0 1 0 0 length 131072 SMID 601 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8c 88 0 1 0 0 length 131072 SMID 409 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8f 88 0 1 0 0 length 131072 SMID 172 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 88 88 0 1 0 0 length 131072 SMID 903 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 8a 88 0 1 0 0 length 131072 SMID 715 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 89 88 0 1 0 0 length 131072 SMID 880 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 90 88 0 1 0 0 length 131072 SMID 402 terminated ioc 804b scsi 0 state c xfer 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): WRITE(10). CDB: 2a 0 2b f1 88 88 0 1 0 0
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): CAM status: SCSI Status Error
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): SCSI status: Check Condition
Dec 21 00:13:03 freenas kernel: (da4:mps1:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
Dec 21 00:13:04 freenas kernel: (da4:mps1:0:3:0): WRITE(6). CDB: a 0 1 b8 8 0
Dec 21 00:13:04 freenas kernel: (da4:mps1:0:3:0): CAM status: SCSI Status Error
Dec 21 00:13:04 freenas kernel: (da4:mps1:0:3:0): SCSI status: Check Condition
Dec 21 00:13:04 freenas kernel: (da4:mps1:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
SMARTD doesn't turn anything up on any of the drives.
zpool scrub returns a clean bill of health, no errors or repairs.
The case is a 12 bay case and I've moved the drives around between bays with no effect. The problems seems to follow the drives, subject to the fact that it's 'sticky' to one drive per reboot.
drive location doesn't seen matter, nor does drive type.
The system is well capable of powering the full 12 bays. I'm only experimenting with 3 drives at the moment. No other bays are populated.
There are 2 controllers, both are LSI SAS9211-8i.
Disks are a couple new 3TB drives I had laying around as spares for a production NAS.
2 are:
<ATA ST3000DM001-1CH1 CC43> at scbus0 target 2 lun 0 (pass0,da0)
<ATA ST3000DM001-1CH1 CC43> at scbus1 target 2 lun 0 (pass3,da3)
and one is:
<ATA WDC WD30EZRX-00M 0A80> at scbus1 target 3 lun 0 (pass4,da4)
All are/were new out of the packaging today.
The LSI controllers have version 14 firmware on them.
Any thoughts as to where I should look? Is this a driver bug? Other than the syslog messages, I haven't been able to find any evidence of a failure anywhere.
With these 3 drives (yeah, I know.. one's a 5400 and all 3 are desktop drives.. I have cheap users to support.) the system can sustain 100MB/s writes, even with the syslog messages.
Thanks