CAM status: SCSI status error - what does it means?

[freenas-supero]

Hello guys,

during a scrub that started yesterday afternoon (and according to zpool status is scheduled to complete within 4 hours from now), I got an email from Freenas (security run output) with the following content that worries me a lot:

Nov 9 16:47:24 freenas kernel: (da2:mps0:0:6:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 length 0 SMID 663 command timeout cm 0xffffff8000b21178 ccb 0xfffffe07518b0000
Nov 9 16:47:24 freenas kernel: (noperiph:mps0:0:4294967295:0): SMID 1 Aborting command 0xffffff8000b21178
Nov 9 16:47:24 freenas kernel: (da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 08 00 00 20 00 length 16384 SMID 471 command timeout cm 0xffffff8000b11b78 ccb 0xfffffe00149e4000
Nov 9 16:47:24 freenas kernel: (da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 38 00 00 18 00 length 12288 SMID 241 command timeout cm 0xffffff8000aff4c8 ccb 0xfffffe0758823800
Nov 9 16:47:24 freenas kernel: (da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 38 00 00 18 00 length 12288 SMID 241 terminated ioc 804b scsi 0 state c xfer 0
Nov 9 16:47:24 freenas kernel: (da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 08 00 00 20 00 length 16384 SMID 471 terminated ioc 804b scsi 0 state c xfer 0
Nov 9 16:47:24 freenas kernel: (da2:mps0:0:6:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
Nov 9 16:47:24 freenas kernel: (da2:mps0:0:6:0): CAM status: Command timeout
Nov 9 16:47:24 freenas kernel: (da2:mps0:0:6:0): Retrying command
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 08 00 00 20 00
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): CAM status: SCSI Status Error
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): SCSI status: Check Condition
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): Retrying command (per sense data)
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): READ(10). CDB: 28 00 b5 38 96 b0 00 00 10 00
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): CAM status: SCSI Status Error
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): SCSI status: Check Condition
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
Nov 9 16:47:25 freenas kernel: (da2:mps0:0:6:0): Retrying command (per sense data)

Disk da2 is a Seagate ST2000DL003-9VT1 drive.... Since I am not familiar with FreeBSD too much, I have a hard time to interpret the output run received from Freenas... Is it a drive failure? Cable failure, controller failure??

There are 8 drives in this server, 4 of them connected to a M1015, the other 4 connected to another M1015. The server runs on a Supermicro X7DBE+ motherboard.

Any hint appreciated before something terrible happens.. For now, the pool is "green" and zpool status zpool reports no corruption or errors found, and the scrub is 92% complete.

Thanks!

 

[Robert Trevellyan]

Is it a drive failure? Cable failure, controller failure??

Could be any of these.

SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)

My wild guess would a some kind of power issue, but you really need to provide more details.

 

[freenas-supero]

Hello! Im sorry for the lack of info. Heres all I could gather!

dmesg

Code:

Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
    The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.2-RELEASE-p9 #0 r262572+cc525fe: Thu Jul  3 14:22:45 PDT 2014
    root@build3.ixsystems.com:/fusion/jenkins/9.2.1.6-RELEASE/os-base/amd64/fusion/jenkins/9.2.1.6-RELEASE/FreeBSD/src/sys/FREENAS.amd64 amd64
gcc version 4.2.1 20070831 patched [FreeBSD]
CPU: Intel(R) Xeon(R) CPU           L5420  @ 2.50GHz (2500.05-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x1067a  Family = 0x6  Model = 0x17  Stepping = 10
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0xc0ce3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,DCA,SSE4.1,XSAVE,OSXSAVE>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant, performance statistics
real memory  = 51539607552 (49152 MB)
avail memory = 49805582336 (47498 MB)
Event timer "LAPIC" quality 400
ACPI APIC Table: <PTLTD       APIC  >
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 2 package(s) x 4 core(s)
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  1
cpu2 (AP): APIC ID:  2
cpu3 (AP): APIC ID:  3
cpu4 (AP): APIC ID:  4
cpu5 (AP): APIC ID:  5
cpu6 (AP): APIC ID:  6
cpu7 (AP): APIC ID:  7
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
ioapic1 <Version 2.0> irqs 24-47 on motherboard
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
aesni0: No AESNI support.
padlock0: No ACE support.
acpi0: <PTLTD   RSDT> on motherboard
acpi0: Power Button (fixed)
unknown: I/O range not supported
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci1
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 0.0 on pci2
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 0.0 on pci3
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> at device 0.2 on pci3
pci5: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 18 at device 2.0 on pci2
pci6: <ACPI PCI bus> on pcib6
em0: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0x2000-0x201f mem 0xd8220000-0xd823ffff,0xd8200000-0xd821ffff irq 18 at device 0.0 on pci6
em0: Using an MSI interrupt
em0: Ethernet address: 00:30:48:7f:11:ba
em1: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0x2020-0x203f mem 0xd8260000-0xd827ffff,0xd8240000-0xd825ffff irq 19 at device 0.1 on pci6
em1: Using an MSI interrupt
em1: Ethernet address: 00:30:48:7f:11:bb
pcib7: <ACPI PCI-PCI bridge> at device 0.3 on pci1
pci7: <ACPI PCI bus> on pcib7
pcib8: <ACPI PCI-PCI bridge> at device 4.0 on pci0
pci8: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci9: <ACPI PCI bus> on pcib9
mps0: <LSI SAS2008> port 0x3000-0x30ff mem 0xd8040000-0xd8043fff,0xd8000000-0xd803ffff irq 18 at device 0.0 on pci9
mps0: Firmware: 15.00.00.00, Driver: 16.00.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pci0: <base peripheral> at device 8.0 (no driver attached)
pcib10: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
pci10: <ACPI PCI bus> on pcib10
mps1: <LSI SAS2008> port 0x4000-0x40ff mem 0xd8340000-0xd8343fff,0xd8300000-0xd833ffff irq 16 at device 0.0 on pci10
mps1: Firmware: 15.00.00.00, Driver: 16.00.00.00-fbsd
mps1: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
uhci0: <Intel 631XESB/632XESB/3100 USB controller USB-1> port 0x1800-0x181f irq 17 at device 29.0 on pci0
usbus0 on uhci0
uhci1: <Intel 631XESB/632XESB/3100 USB controller USB-2> port 0x1820-0x183f irq 19 at device 29.1 on pci0
usbus1 on uhci1
uhci2: <Intel 631XESB/632XESB/3100 USB controller USB-3> port 0x1840-0x185f irq 18 at device 29.2 on pci0
usbus2 on uhci2
ehci0: <Intel 63XXESB USB 2.0 controller> mem 0xd8700400-0xd87007ff irq 17 at device 29.7 on pci0
usbus3: EHCI version 1.0
usbus3 on ehci0
pcib11: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci11: <ACPI PCI bus> on pcib11
vgapci0: <VGA-compatible display> port 0x5000-0x50ff mem 0xd0000000-0xd7ffffff,0xd8420000-0xd842ffff irq 18 at device 1.0 on pci11
em2: <Intel(R) PRO/1000 Legacy Network Connection 1.0.6> port 0x5400-0x543f mem 0xd8400000-0xd841ffff irq 16 at device 2.0 on pci11
em2: Ethernet address: 00:30:48:9b:96:e3
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel 63XXESB2 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1860-0x186f at device 31.1 on pci0
ata0: <ATA channel> at channel 0 on atapci0
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Power Button> on acpi0
ipmi0: <IPMI System Interface> port 0xca2-0xca3 on acpi0
ipmi0: KCS mode found at io 0xca2 on acpi
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: does not respond
device_attach: fdc0 attach returned 6
ichwd0 on isa0
wbwd0: <Winbond 83627HF/F/HG/G Rev. UD-A> at port 0x2e-0x2f on isa0
wbwd0: Before watchdog attach: Watchdog enabled. Scaling by 60s, timer at 5 (<=300s left). CRF5 0x08 CRF7 0xc0
ipmi1: <IPMI System Interface> on isa0
device_attach: ipmi1 attach returned 16
ipmi1: <IPMI System Interface> on isa0
device_attach: ipmi1 attach returned 16
orm0: <ISA Option ROMs> at iomem 0xc0000-0xcafff,0xcb000-0xcbfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
fdc0: No FDOUT register!
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
coretemp4: <CPU On-Die Thermal Sensors> on cpu4
est4: <Enhanced SpeedStep Frequency Control> on cpu4
p4tcc4: <CPU Frequency Thermal Control> on cpu4
coretemp5: <CPU On-Die Thermal Sensors> on cpu5
est5: <Enhanced SpeedStep Frequency Control> on cpu5
p4tcc5: <CPU Frequency Thermal Control> on cpu5
coretemp6: <CPU On-Die Thermal Sensors> on cpu6
est6: <Enhanced SpeedStep Frequency Control> on cpu6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
coretemp7: <CPU On-Die Thermal Sensors> on cpu7
est7: <Enhanced SpeedStep Frequency Control> on cpu7
p4tcc7: <CPU Frequency Thermal Control> on cpu7
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
DUMMYNET 0xfffffe0007d661c0 with IPv6 initialized (100409)
load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <Intel> at usbus2
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
ipmi0: IPMI device rev. 1, firmware rev. 1.64, version 2.0
ipmi0: Number of channels 8
ipmi0: Attached watchdog
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 6 ports with 6 removable, self powered
ugen0.2: <American Power Conversion> at usbus0
ugen3.2: <Staples> at usbus3
umass0: <Staples Relay UFD, class 0/0, rev 2.00/2.01, addr 2> on usbus3
umass0:  SCSI over Bulk-Only; quirks = 0x0100
umass0:4:0:-1: Attached to scbus4
usb_alloc_device: set address 3 failed (USB_ERR_STALLED, ignored)
usbd_req_re_enumerate: addr=3, set address failed! (USB_ERR_STALLED, ignored)
da2 at mps0 bus 0 scbus0 target 6 lun 0
da2: <ATA ST2000DL003-9VT1 CC45> Fixed Direct Access SCSI-6 device
da2: Serial Number             5YD9RJXW
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da2: quirks=0x8<4K>
da4 at mps1 bus 0 scbus1 target 2 lun 0
da4: <ATA ST2000DM001-1CH1 CC24> Fixed Direct Access SCSI-6 device
da4: Serial Number             S1E1RH1L
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da4: quirks=0x8<4K>
da6 at mps1 bus 0 scbus1 target 4 lun 0
da6: <ATA ST3000DM001-1CH1 CC26> Fixed Direct Access SCSI-6 device
da6: Serial Number             Z1F31JSY
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da6: quirks=0x8<4K>
da5 at mps1 bus 0 scbus1 target 3 lun 0
da5: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-6 device
da5: Serial Number       ML4220F318UPDK
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da7 at mps1 bus 0 scbus1 target 5 lun 0
da7: <ATA HGST HDN724030AL A5E0> Fixed Direct Access SCSI-6 device
da7: Serial Number       PK2234P8JYHX5Y
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 2861588MB (5860533168 512 byte sectors: 255H 63S/T 364801C)
da1 at mps0 bus 0 scbus0 target 5 lun 0
da1: <ATA Hitachi HDS5C302 A580> Fixed Direct Access SCSI-6 device
da1: Serial Number       ML0220F31B18RD
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da3 at mps0 bus 0 scbus0 target 7 lun 0
da3: <ATA Hitachi HDS5C302 A180> Fixed Direct Access SCSI-6 device
da3: Serial Number       ML0221F306AUSD
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da0 at mps0 bus 0 scbus0 target 4 lun 0
da0: <ATA ST32000542AS CC34> Fixed Direct Access SCSI-6 device
da0: Serial Number             5XW2NFYN
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 1907729MB (3907029168 512 byte sectors: 255H 63S/T 243201C)
da8 at umass-sim0 bus 0 scbus4 target 0 lun 0
cd0 at ata0 bus 0 scbus2 target 1 lun 0
cd0: <MATSHITA DVD-ROM UJDA780 1.50> Removable CD-ROM SCSI-0 device
cd0: 33.300MB/s transfers (UDMA2, ATAPI 12bytes, PIO 65534bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
da8: <Staples Relay UFD 2.01> Fixed Direct Access SCSI-6 device
da8: Serial Number 20041101321194D11878
da8: 40.000MB/s transfers
da8: 7633MB (15633408 512 byte sectors: 255H 63S/T 973C)
da8: quirks=0x2<NO_6_BYTE>
SMP: AP CPU #4 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #2 Launched!
usbd_req_re_enumerate: addr=3, set address failed! (USB_ERR_STALLED, ignored)
ugen3.3: <Unknown> at usbus3 (disconnected)
uhub_reattach_port: could not allocate new device
Trying to mount root from ufs:/dev/ufs/FreeNASs1a [ro]...
GEOM_RAID5: Module loaded, version 1.1.20130907.44 (rev 5c6d2a159411)
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
GEOM_ELI: Device da6p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: software
GEOM_ELI: Device da5p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: software
GEOM_ELI: Device da0p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: software
GEOM_ELI: Device da1p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: software
GEOM_ELI: Device da2p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: software
GEOM_ELI: Device da3p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: software
GEOM_ELI: Device da7p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: software
GEOM_ELI: Device da4p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: software
vboxdrv: fAsync=0 offMin=0x47b offMax=0xc118
ugen0.2: <American Power Conversion> at usbus0 (disconnected)
ugen1.2: <American Power Conversion> at usbus1
ugen3.3: <Kingston> at usbus3
umass1: <Kingston DataTraveler 3.0, class 0/0, rev 2.10/1.00, addr 3> on usbus3
umass1:  SCSI over Bulk-Only; quirks = 0x0100
umass1:5:1:-1: Attached to scbus5
da9 at umass-sim1 bus 1 scbus5 target 0 lun 0
da9: <KINGSTON DataTraveler 3.0 1.01> Removable Direct Access SCSI-6 device
da9: Serial Number 60A44C4252A8AF7020000821
da9: 40.000MB/s transfers
da9: 14832MB (30375936 512 byte sectors: 255H 63S/T 1890C)
da9: quirks=0x2<NO_6_BYTE>
ugen3.3: <Kingston> at usbus3 (disconnected)
umass1: at uhub3, port 1, addr 3 (disconnected)
da9 at umass-sim1 bus 1 scbus5 target 0 lun 0
da9: <KINGSTON DataTraveler 3.0 1.01> s/n 60A44C4252A8AF7020000821 detached
(da9:umass-sim1:1:0:0): Periph destroyed
ugen3.3: <Kingston> at usbus3
umass1: <Kingston DataTraveler 3.0, class 0/0, rev 2.10/1.00, addr 3> on usbus3
umass1:  SCSI over Bulk-Only; quirks = 0x0100
umass1:5:1:-1: Attached to scbus5
da9 at umass-sim1 bus 1 scbus5 target 0 lun 0
da9: <KINGSTON DataTraveler 3.0 1.01> Removable Direct Access SCSI-6 device
da9: Serial Number 60A44C4252A8AF7020000821
da9: 40.000MB/s transfers
da9: 14832MB (30375936 512 byte sectors: 255H 63S/T 1890C)
da9: quirks=0x2<NO_6_BYTE>
arp: 192.168.0.107 moved from f2:a1:e1:7c:90:16 to 1e:7a:8b:73:80:ae on em0
ugen3.3: <Kingston> at usbus3 (disconnected)
umass1: at uhub3, port 1, addr 3 (disconnected)
da9 at umass-sim1 bus 1 scbus5 target 0 lun 0
da9: <KINGSTON DataTraveler 3.0 1.01> s/n 60A44C4252A8AF7020000821 detached
(da9:umass-sim1:1:0:0): Periph destroyed
ugen1.2: <American Power Conversion> at usbus1 (disconnected)
ugen3.3: <vendor 0x1a40> at usbus3
uhub4: <vendor 0x1a40 USB 2.0 Hub, class 9/0, rev 2.00/1.11, addr 3> on usbus3
uhub4: 4 ports with 4 removable, self powered
ugen3.4: <Kingston> at usbus3
umass1: <Kingston DataTraveler 3.0, class 0/0, rev 2.10/1.00, addr 4> on usbus3
umass1:  SCSI over Bulk-Only; quirks = 0x0100
umass1:5:1:-1: Attached to scbus5
da9 at umass-sim1 bus 1 scbus5 target 0 lun 0
da9: <KINGSTON DataTraveler 3.0 1.01> Removable Direct Access SCSI-6 device
da9: Serial Number 60A44C4252A8AF7020000821
da9: 40.000MB/s transfers
da9: 14832MB (30375936 512 byte sectors: 255H 63S/T 1890C)
da9: quirks=0x2<NO_6_BYTE>
ugen3.5: <American Power Conversion> at usbus3
arp: 192.168.0.108 moved from a2:f7:c4:01:ef:dc to be:da:1c:df:01:31 on em0
    (da2:mps0:0:6:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00 length 0 SMID 663 command timeout cm 0xffffff8000b21178 ccb 0xfffffe07518b0000
    (noperiph:mps0:0:4294967295:0): SMID 1 Aborting command 0xffffff8000b21178
    (da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 08 00 00 20 00 length 16384 SMID 471 command timeout cm 0xffffff8000b11b78 ccb 0xfffffe00149e4000
    (da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 38 00 00 18 00 length 12288 SMID 241 command timeout cm 0xffffff8000aff4c8 ccb 0xfffffe0758823800
    (da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 38 00 00 18 00 length 12288 SMID 241 terminated ioc 804b scsi 0 state c xfer 0
    (da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 08 00 00 20 00 length 16384 SMID 471 terminated ioc 804b scsi 0 state c xfer 0
(da2:mps0:0:6:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 00
(da2:mps0:0:6:0): CAM status: Command timeout
(da2:mps0:0:6:0): Retrying command
(da2:mps0:0:6:0): READ(10). CDB: 28 00 b4 9b 12 08 00 00 20 00
(da2:mps0:0:6:0): CAM status: SCSI Status Error
(da2:mps0:0:6:0): SCSI status: Check Condition
(da2:mps0:0:6:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
(da2:mps0:0:6:0): Retrying command (per sense data)
(da2:mps0:0:6:0): READ(10). CDB: 28 00 b5 38 96 b0 00 00 10 00
(da2:mps0:0:6:0): CAM status: SCSI Status Error
(da2:mps0:0:6:0): SCSI status: Check Condition
(da2:mps0:0:6:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
(da2:mps0:0:6:0): Retrying command (per sense data)

More on the next post.....

 

[freenas-supero]

Some more info..

pciconf -lv

Code:

[root@freenas] ~# pciconf -lv
hostb0@pci0:0:0:0:    class=0x060000 card=0x808015d9 chip=0x25d88086 rev=0xb1 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5000P Chipset Memory Controller Hub'
    class      = bridge
    subclass   = HOST-PCI
pcib1@pci0:0:2:0:    class=0x060400 card=0x00000000 chip=0x25f78086 rev=0xb1 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset PCI Express x8 Port 2-3'
    class      = bridge
    subclass   = PCI-PCI
pcib8@pci0:0:4:0:    class=0x060400 card=0x00000000 chip=0x25f88086 rev=0xb1 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset PCI Express x8 Port 4-5'
    class      = bridge
    subclass   = PCI-PCI
pcib9@pci0:0:6:0:    class=0x060400 card=0x00000000 chip=0x25f98086 rev=0xb1 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset PCI Express x8 Port 6-7'
    class      = bridge
    subclass   = PCI-PCI
none0@pci0:0:8:0:    class=0x088000 card=0x808015d9 chip=0x1a388086 rev=0xb1 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset DMA Engine'
    class      = base peripheral
hostb1@pci0:0:16:0:    class=0x060000 card=0x808015d9 chip=0x25f08086 rev=0xb1 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset FSB Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb2@pci0:0:16:1:    class=0x060000 card=0x808015d9 chip=0x25f08086 rev=0xb1 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset FSB Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb3@pci0:0:16:2:    class=0x060000 card=0x808015d9 chip=0x25f08086 rev=0xb1 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset FSB Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb4@pci0:0:17:0:    class=0x060000 card=0x808015d9 chip=0x25f18086 rev=0xb1 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset Reserved Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb5@pci0:0:19:0:    class=0x060000 card=0x808015d9 chip=0x25f38086 rev=0xb1 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset Reserved Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb6@pci0:0:21:0:    class=0x060000 card=0x808015d9 chip=0x25f58086 rev=0xb1 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset FBD Registers'
    class      = bridge
    subclass   = HOST-PCI
hostb7@pci0:0:22:0:    class=0x060000 card=0x808015d9 chip=0x25f68086 rev=0xb1 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '5000 Series Chipset FBD Registers'
    class      = bridge
    subclass   = HOST-PCI
pcib10@pci0:0:28:0:    class=0x060400 card=0x808015d9 chip=0x26908086 rev=0x09 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '631xESB/632xESB/3100 Chipset PCI Express Root Port 1'
    class      = bridge
    subclass   = PCI-PCI
uhci0@pci0:0:29:0:    class=0x0c0300 card=0x808015d9 chip=0x26888086 rev=0x09 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '631xESB/632xESB/3100 Chipset UHCI USB Controller'
    class      = serial bus
    subclass   = USB
uhci1@pci0:0:29:1:    class=0x0c0300 card=0x808015d9 chip=0x26898086 rev=0x09 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '631xESB/632xESB/3100 Chipset UHCI USB Controller'
    class      = serial bus
    subclass   = USB
uhci2@pci0:0:29:2:    class=0x0c0300 card=0x808015d9 chip=0x268a8086 rev=0x09 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '631xESB/632xESB/3100 Chipset UHCI USB Controller'
    class      = serial bus
    subclass   = USB
ehci0@pci0:0:29:7:    class=0x0c0320 card=0x808015d9 chip=0x268c8086 rev=0x09 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '631xESB/632xESB/3100 Chipset EHCI USB2 Controller'
    class      = serial bus
    subclass   = USB
pcib11@pci0:0:30:0:    class=0x060401 card=0x808015d9 chip=0x244e8086 rev=0xd9 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '82801 PCI Bridge'
    class      = bridge
    subclass   = PCI-PCI
isab0@pci0:0:31:0:    class=0x060100 card=0x808015d9 chip=0x26708086 rev=0x09 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '631xESB/632xESB/3100 Chipset LPC Interface Controller'
    class      = bridge
    subclass   = PCI-ISA
atapci0@pci0:0:31:1:    class=0x01018a card=0x808015d9 chip=0x269e8086 rev=0x09 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '631xESB/632xESB IDE Controller'
    class      = mass storage
    subclass   = ATA
none1@pci0:0:31:3:    class=0x0c0500 card=0x808015d9 chip=0x269b8086 rev=0x09 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '631xESB/632xESB/3100 Chipset SMBus Controller'
    class      = serial bus
    subclass   = SMBus
pcib2@pci0:1:0:0:    class=0x060400 card=0x808015d9 chip=0x35008086 rev=0x01 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6311ESB/6321ESB PCI Express Upstream Port'
    class      = bridge
    subclass   = PCI-PCI
pcib7@pci0:1:0:3:    class=0x060400 card=0x808015d9 chip=0x350c8086 rev=0x01 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6311ESB/6321ESB PCI Express to PCI-X Bridge'
    class      = bridge
    subclass   = PCI-PCI
pcib3@pci0:2:0:0:    class=0x060400 card=0x808015d9 chip=0x35108086 rev=0x01 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6311ESB/6321ESB PCI Express Downstream Port E1'
    class      = bridge
    subclass   = PCI-PCI
pcib6@pci0:2:2:0:    class=0x060400 card=0x808015d9 chip=0x35188086 rev=0x01 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6311ESB/6321ESB PCI Express Downstream Port E3'
    class      = bridge
    subclass   = PCI-PCI
pcib4@pci0:3:0:0:    class=0x060400 card=0x00000000 chip=0x03298086 rev=0x09 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6700PXH PCI Express-to-PCI Bridge A'
    class      = bridge
    subclass   = PCI-PCI
pcib5@pci0:3:0:2:    class=0x060400 card=0x00000000 chip=0x032a8086 rev=0x09 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6700PXH PCI Express-to-PCI Bridge B'
    class      = bridge
    subclass   = PCI-PCI
em0@pci0:6:0:0:    class=0x020000 card=0x109615d9 chip=0x10968086 rev=0x01 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '80003ES2LAN Gigabit Ethernet Controller (Copper)'
    class      = network
    subclass   = ethernet
em1@pci0:6:0:1:    class=0x020000 card=0x109615d9 chip=0x10968086 rev=0x01 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '80003ES2LAN Gigabit Ethernet Controller (Copper)'
    class      = network
    subclass   = ethernet
mps0@pci0:9:0:0:    class=0x010700 card=0x30201000 chip=0x00721000 rev=0x03 hdr=0x00
    vendor     = 'LSI Logic / Symbios Logic'
    device     = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]'
    class      = mass storage
    subclass   = SAS
mps1@pci0:10:0:0:    class=0x010700 card=0x30201000 chip=0x00721000 rev=0x02 hdr=0x00
    vendor     = 'LSI Logic / Symbios Logic'
    device     = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]'
    class      = mass storage
    subclass   = SAS
vgapci0@pci0:11:1:0:    class=0x030000 card=0x808015d9 chip=0x515e1002 rev=0x02 hdr=0x00
    vendor     = 'ATI Technologies Inc'
    device     = 'ES1000'
    class      = display
    subclass   = VGA
em2@pci0:11:2:0:    class=0x020000 card=0x107615d9 chip=0x10768086 rev=0x05 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82541GI Gigabit Ethernet Controller'
    class      = network
    subclass   = ethernet

smartctl -a /dev/da2 (the drive mentioned in the security output log...

Code:

[root@freenas] ~# smartctl -a /dev/da2
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p9 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda Green (AF)
Device Model:     ST2000DL003-9VT166
Serial Number:    5YD9RJXW
LU WWN Device Id: 5 000c50 0530de955
Firmware Version: CC45
User Capacity:    2,000,398,934,016 bytes [2.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5900 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS T13/1699-D revision 4
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Wed Nov 11 06:48:19 2015 EST

==> WARNING: A firmware update for this drive may be available,
see the following Seagate web pages:
http://knowledge.seagate.com/articles/en_US/FAQ/207931en
http://knowledge.seagate.com/articles/en_US/FAQ/218171en

SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82)    Offline data collection activity
                    was completed without error.
                    Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)    The previous self-test routine completed
                    without error or no self-test has ever
                    been run.
Total time to complete Offline
data collection:         (  623) seconds.
Offline data collection
capabilities:              (0x7b) SMART execute Offline immediate.
                    Auto Offline data collection on/off support.
                    Suspend Offline collection upon new
                    command.
                    Offline surface scan supported.
                    Self-test supported.
                    Conveyance Self-test supported.
                    Selective Self-test supported.
SMART capabilities:            (0x0003)    Saves SMART data before entering
                    power-saving mode.
                    Supports SMART auto save timer.
Error logging capability:        (0x01)    Error logging supported.
                    General Purpose Logging supported.
Short self-test routine
recommended polling time:      (   1) minutes.
Extended self-test routine
recommended polling time:      ( 353) minutes.
Conveyance self-test routine
recommended polling time:      (   2) minutes.
SCT capabilities:            (0x30b7)    SCT Status supported.
                    SCT Feature Control supported.
                    SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   118   099   006    Pre-fail  Always       -       195636848
  3 Spin_Up_Time            0x0003   074   070   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       98
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   081   060   030    Pre-fail  Always       -       148073364
  9 Power_On_Hours          0x0032   081   081   000    Old_age   Always       -       17157
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       97
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       4295032833
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   074   062   045    Old_age   Always       -       26 (Min/Max 22/33)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       92
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       98
194 Temperature_Celsius     0x0022   026   040   000    Old_age   Always       -       26 (0 17 0 0 0)
195 Hardware_ECC_Recovered  0x001a   025   004   000    Old_age   Always       -       195636848
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       93544387724032
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       2888482342
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       1665396130

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     17131         -
# 2  Short offline       Completed without error       00%     17059         -
# 3  Short offline       Completed without error       00%     16987         -
# 4  Extended offline    Completed without error       00%     16916         -
# 5  Short offline       Completed without error       00%     16890         -
# 6  Short offline       Completed without error       00%     16818         -
# 7  Short offline       Completed without error       00%     16746         -
# 8  Short offline       Completed without error       00%     16674         -
# 9  Short offline       Completed without error       00%     16602         -
#10  Short offline       Completed without error       00%     16530         -
#11  Short offline       Completed without error       00%     16458         -
#12  Short offline       Completed without error       00%     16386         -
#13  Short offline       Completed without error       00%     16314         -
#14  Short offline       Completed without error       00%     16242         -
#15  Extended offline    Completed without error       00%     16171         -
#16  Short offline       Completed without error       00%     16098         -
#17  Short offline       Completed without error       00%     16026         -
#18  Short offline       Completed without error       00%     15954         -
#19  Short offline       Completed without error       00%     15882         -
#20  Short offline       Completed without error       00%     15810         -
#21  Short offline       Completed without error       00%     15738         -

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

FreeNAS version:

Code:

FreeNAS-9.2.1.6-RELEASE-x64 (ddd1e39)
FreeBSD 9.2-RELEASE-p9 (FREENAS.amd64) #0 r262572+cc525fe: Thu Jul  3 14:22:45 PDT 2014

Motherboard (Model): Supermicro X7DBE+
CPU (Model): 2x Xeon L5420 quad cores
RAM Size (in GB and model): 24x 2GB DDR2-667 ECC (Kingston)
Hard Drives (Model), Quantity, and RAIDZ configuration: 8x (mixture of 2 & 3 TB), 4 seagates & 4 HGST in RaidZ3 (Single pool)
Add-On card:2x IBM M1015 flashed to IT
Power supplies: 2x redundant Abercom 760W (original from 2008 I believe).

I purchased this server used about 18 months ago from ebay (Unixsurplus/Mr. Rackables) and since then it has worked flawlessly albeit on the slow side.. I am concerned about hardware failure because of the age of this machine. X7DBE's came out on the market in 2008, so this server is 7+ years old... The fact that this happened during a scrub (high load in terms of power) makes me believe there could be a problem electrically..

The other thought I has was the hard drive. da2 is a Seagate drive, during the last 18 months, I replaced 2 seagates and 1 western drive because of misc failures (confirmed to be the drives after bench testing on a separate machine). Could it be simply a firmware bug or something with the drive? These drives are "consumer" grade and not enterprise grade..

I'd also like to mention that this is the first time this happens.

 

[Robert Trevellyan]

Can someone smarter than I please confirm whether mps is the right driver for the M1015 in IT mode?

mps0: Firmware: 15.00.00.00, Driver: 16.00.00.00-fbsd

mps1: Firmware: 15.00.00.00, Driver: 16.00.00.00-fbsd

You need to match the firmware version to the driver version. This might solve your problem.

There is nothing jumping out at me as obviously wrong with your setup or with the SMART results from da2, though I think you're right to consider age as a possible factor.

The drive could be failing, even with nothing obvious in the SMART results. I have an old Hitachi drive that would throw errors under load despite passing all tests. However, your errors don't appear in the drive's internal log, so I'm skeptical of this.

You can do some basic stuff like reseating cables.

Why do you have two M1015s with only 8 drives? You could test with each card individually to rule out a failing M1015.

You could test with each PSU separately to rule out a failing PSU.

 

[cyberjock]

So did upgrading your firmware fix your issue?

 

[freenas-supero]

Hello cyberjock,

no I did not have a chance to update the firmware on the M1015's in this server since I am using it intensively right now.. I have planned to do a quick overhaul of that machine, with upgrading freenas to the latest release to be able to do a mirrored USB boot arrangement, and strip one of the M1015's from it.. It also needs a cleanup because of the dust.

When I get around I will try to flash one of the controllers and see if it helps but since Nov 10, I havent seen this again so I assume this is either a rare hardware comm problem or a sign of wear which could get worst in the future..

Keeping an eye on it!

 

[cyberjock]

Wow... ok. Well, good luck to you.