scrub seems to make randomly disk faulty

Status
Not open for further replies.

Simond

Cadet
Joined
Sep 18, 2015
Messages
2
Hello,
I need help to diagnose a problem on a FreeNas 9.3 server.
When I scrub the volume, drive becomes faulty randomly ; when I reboot or replace it, it comes back online.
I made short and long smart tests, all completed successfully.
I tried to group relevant informations below.

Do you have an idea why scrub makes a drive faulty so often ?
Do you think desactivate SSD for Logs and Cache could help ?

Thanks
Simon

Code:
first scrub :
NAME                                        STATE     READ WRITE CKSUM
gptid/72b34089-3454-11e5-9824-001e67c53f64  FAULTED      6    47     0  too many errors
this id corresponds to the disk  da5  with serial number    WD-WX71DA4A07DF
I replaced it, it resilvered it successfully

second scrub :
gptid/caaae6e2-3534-11e5-9824-001e67c53f64  FAULTED      3    43     0  too many errors
da11   WD-WXM1H84ADTNV
reboot -> resilvered -> ok

third scrub : (only time scrub finished without faulty drive but with one CheckSum error)
gptid/caaae6e2-3534-11e5-9824-001e67c53f64  ONLINE       0     0     1
da11   WD-WXM1H84ADTNV

fourth scrub : around 41.24 % it declared a faulty drive, I interrupted it
gptid/74b62efe-3454-11e5-9824-001e67c53f64  FAULTED      3    39     0  too many errors
da8     WD-WX21DB41SD3H
replace with the first supposedly faulty drive ( WD-WX71DA4A07DF ) -> resilvered -> ok

fifth scrub : around 5.83 %  it declared a faulty drive, I interrupted it
gptid/73b902ef-3454-11e5-9824-001e67c53f64  FAULTED      3    43     0  too many errors
da6     WD-WX11D15P361L
reboot  -> resilvered -> ok
Code:
Server 2U intel R2000GZ 
Build 	  FreeNAS-9.3-STABLE-201506292332
Platform  Intel(R) Xeon(R) CPU E5-2609 v2 @ 2.50GHz
Memory 	  98199MB
Disk      12 x WD Red 6TB NAS SATA 6 Gb/s 64MB Cache 3.5 Inch
          2 x 60GB SSD for Logs and Cache

Code:
result of "zpool status data" (when there isn't error) :
  pool: data
 state: ONLINE
  scan: resilvered 6.55M in 0h36m with 0 errors on Fri Nov 13 10:42:04 2015
config:

	NAME                                            STATE     READ WRITE CKSUM
	data                                            ONLINE       0     0     0
	  raidz2-0                                      ONLINE       0     0     0
	    gptid/6fc9b15b-3454-11e5-9824-001e67c53f64  ONLINE       0     0     0
	    gptid/cb682217-36d4-11e5-9824-001e67c53f64  ONLINE       0     0     0
	    gptid/70c28b41-3454-11e5-9824-001e67c53f64  ONLINE       0     0     0
	    gptid/713e6970-3454-11e5-9824-001e67c53f64  ONLINE       0     0     0
	    gptid/71b9f04f-3454-11e5-9824-001e67c53f64  ONLINE       0     0     0
	    gptid/72366cfb-3454-11e5-9824-001e67c53f64  ONLINE       0     0     0
	    gptid/e4958922-7991-11e5-af7a-001e67c53f64  ONLINE       0     0     0
	    gptid/7337ab74-3454-11e5-9824-001e67c53f64  ONLINE       0     0     0
	    gptid/73b902ef-3454-11e5-9824-001e67c53f64  ONLINE       0     0     0
	    gptid/caaae6e2-3534-11e5-9824-001e67c53f64  ONLINE       0     0     0
	    gptid/ef5ab67c-8955-11e5-a182-001e67c53f64  ONLINE       0     0     0
	    gptid/752e1552-3454-11e5-9824-001e67c53f64  ONLINE       0     0     0
	logs
	  gptid/6861928a-3455-11e5-9824-001e67c53f64    ONLINE       0     0     0
	cache
	  gptid/a964d2da-3455-11e5-9824-001e67c53f64    ONLINE       0     0     0

errors: No known data errors
Code:
# df -h
Filesystem                                               Size    Used   Avail Capacity  Mounted on
freenas-boot/ROOT/default                                  7G    508M    6.5G     7%    /
devfs                                                    1.0k    1.0k      0B   100%    /dev
tmpfs                                                     32M    5.3M     26M    16%    /etc
tmpfs                                                    4.0M    8.0k      4M     0%    /mnt
tmpfs                                                     32G     16M     32G     0%    /var
freenas-boot/grub                                        6.5G    6.8M    6.5G     0%    /boot/grub
data                                                      30T    219k     30T     0%    /mnt/data
data/data                                                 30T     95G     30T     0%    /mnt/data/data
data/jails                                                30T    219k     30T     0%    /mnt/data/jails
data/simon                                                47T     17T     30T    36%    /mnt/data/simon
data/.system                                              30T    314M     30T     0%    /var/db/system
data/.system/cores                                        30T    4.6M     30T     0%    /var/db/system/cores
data/.system/samba4                                       30T    868k     30T     0%    /var/db/system/samba4
data/.system/syslog-f1ae6c68bbe041c7bb38cadeec088781      30T      4M     30T     0%    /var/db/system/syslog-f1ae6c68bbe041c7bb38cadeec088781
data/.system/rrd-f1ae6c68bbe041c7bb38cadeec088781         30T     46M     30T     0%    /var/db/system/rrd-f1ae6c68bbe041c7bb38cadeec088781
data/.system/configs-f1ae6c68bbe041c7bb38cadeec088781     30T    219k     30T     0%    /var/db/system/configs-f1ae6c68bbe041c7bb38cadeec088781
Code:
# zpool list
NAME           SIZE  ALLOC   FREE  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
data            65T  22.6T  42.4T         -    21%    34%  1.00x  ONLINE  /mnt
freenas-boot  7.50G   786M  6.73G         -      -    10%  1.00x  ONLINE  -
Code:
# zfs list
NAME                                                    USED  AVAIL  REFER  MOUNTPOINT
data                                                   17.2T  30.7T   219K  /mnt/data
data/.system                                            371M  30.7T   314M  legacy
data/.system/configs-f1ae6c68bbe041c7bb38cadeec088781   219K  30.7T   219K  legacy
data/.system/cores                                     4.62M  30.7T  4.62M  legacy
data/.system/rrd-f1ae6c68bbe041c7bb38cadeec088781      46.8M  30.7T  46.8M  legacy
data/.system/samba4                                     868K  30.7T   868K  legacy
data/.system/syslog-f1ae6c68bbe041c7bb38cadeec088781   3.95M  30.7T  3.95M  legacy
data/data                                              96.1G  30.7T  95.0G  /mnt/data/data
data/jails                                              219K  30.7T   219K  /mnt/data/jails
data/simon                                             17.1T  30.7T  17.1T  /mnt/data/simon
freenas-boot                                            786M  6.50G    31K  none
freenas-boot/ROOT                                       770M  6.50G    25K  none
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201509160044       254M  6.50G   511M  /
freenas-boot/ROOT/Initial-Install                         1K  6.50G   508M  legacy
freenas-boot/ROOT/Wizard-2015-07-24_16:44:30            440K  6.50G   508M  legacy
freenas-boot/ROOT/default                               515M  6.50G   509M  /
freenas-boot/grub                                      13.6M  6.50G  6.79M  legacy
Code:
# camcontrol devlist
<TOSHIBA THNSNJ060GCSU JUGA0101>   at scbus0 target 0 lun 0 (pass0,ada0)
<TOSHIBA THNSNJ060GCSU JUGA0101>   at scbus1 target 0 lun 0 (pass1,ada1)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 0 lun 0 (pass2,da0)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 3 lun 0 (pass3,da1)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 4 lun 0 (pass4,da2)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 5 lun 0 (pass5,da3)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 6 lun 0 (pass6,da4)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 7 lun 0 (pass7,da5)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 8 lun 0 (pass8,da6)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 9 lun 0 (pass9,da7)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 10 lun 0 (pass10,da8)
<ATA WDC WD60EFRX-68T 0A82>        at scbus6 target 13 lun 0 (pass11,da9)
<ATA WDC WD60EFRX-68M 0A82>        at scbus6 target 14 lun 0 (pass12,da10)
<ATA WDC WD60EFRX-68M 0A82>        at scbus6 target 15 lun 0 (pass13,da11)
<USB Flash DISK 1100>              at scbus8 target 0 lun 0 (pass14,da12)

Code:
# dmesg
aesni0: <AES-CBC,AES-XTS> on motherboard
padlock0: No ACE support.
acpi0: <INTEL S2600GZ> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 0, 9d000 (3) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 47 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 47 at device 1.1 on pci0
pci2: <ACPI PCI bus> on pcib2
igb0: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0x1060-0x107f mem 0xd0960000-0xd097ffff,0xd09b0000-0xd09b3fff irq 27 at device 0.0 on pci2
igb0: Using MSIX interrupts with 9 vectors
igb0: Ethernet address: 00:1e:67:c5:3f:64
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
igb0: Bound queue 4 to cpu 4
igb0: Bound queue 5 to cpu 5
igb0: Bound queue 6 to cpu 6
igb0: Bound queue 7 to cpu 7
igb1: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0x1040-0x105f mem 0xd0940000-0xd095ffff,0xd09a0000-0xd09a3fff irq 30 at device 0.1 on pci2
igb1: Using MSIX interrupts with 9 vectors
igb1: Ethernet address: 00:1e:67:c5:3f:65
igb1: Bound queue 0 to cpu 0
igb1: Bound queue 1 to cpu 1
igb1: Bound queue 2 to cpu 2
igb1: Bound queue 3 to cpu 3
igb1: Bound queue 4 to cpu 4
igb1: Bound queue 5 to cpu 5
igb1: Bound queue 6 to cpu 6
igb1: Bound queue 7 to cpu 7
igb2: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0x1020-0x103f mem 0xd0920000-0xd093ffff,0xd0990000-0xd0993fff irq 28 at device 0.2 on pci2
igb2: Using MSIX interrupts with 9 vectors
igb2: Ethernet address: 00:1e:67:c5:3f:66
igb2: Bound queue 0 to cpu 0
igb2: Bound queue 1 to cpu 1
igb2: Bound queue 2 to cpu 2
igb2: Bound queue 3 to cpu 3
igb2: Bound queue 4 to cpu 4
igb2: Bound queue 5 to cpu 5
igb2: Bound queue 6 to cpu 6
igb2: Bound queue 7 to cpu 7
igb3: <Intel(R) PRO/1000 Network Connection version - 2.4.0> port 0x1000-0x101f mem 0xd0900000-0xd091ffff,0xd0980000-0xd0983fff irq 29 at device 0.3 on pci2
igb3: Using MSIX interrupts with 9 vectors
igb3: Ethernet address: 00:1e:67:c5:3f:67
igb3: Bound queue 0 to cpu 0
igb3: Bound queue 1 to cpu 1
igb3: Bound queue 2 to cpu 2
igb3: Bound queue 3 to cpu 3
igb3: Bound queue 4 to cpu 4
igb3: Bound queue 5 to cpu 5
igb3: Bound queue 6 to cpu 6
igb3: Bound queue 7 to cpu 7
pcib3: <ACPI PCI-PCI bridge> irq 47 at device 2.0 on pci0
pci4: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 47 at device 2.2 on pci0
pci5: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 3.0 on pci0
pci6: <ACPI PCI bus> on pcib5
pcib6: <ACPI PCI-PCI bridge> irq 16 at device 3.2 on pci0
pci7: <ACPI PCI bus> on pcib6
pcib7: <ACPI PCI-PCI bridge> irq 16 at device 17.0 on pci0
pci8: <ACPI PCI bus> on pcib7
pci0: <simple comms> at device 22.0 (no driver attached)
pci0: <simple comms> at device 22.1 (no driver attached)
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xd0b20000-0xd0b203ff irq 22 at device 26.0 on pci0
usbus0: EHCI version 1.0
usbus0 on ehci0
pcib8: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci9: <ACPI PCI bus> on pcib8
pcib9: <ACPI PCI-PCI bridge> irq 19 at device 28.7 on pci0
pci10: <ACPI PCI bus> on pcib9
vgapci0: <VGA-compatible display> mem 0xea000000-0xeaffffff,0xd0810000-0xd0813fff,0xd0000000-0xd07fffff irq 19 at device 0.0 on pci10
vgapci0: Boot video device
ehci1: <EHCI (generic) USB 2.0 controller> mem 0xd0b10000-0xd0b103ff irq 20 at device 29.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci1
pcib10: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci11: <ACPI PCI bus> on pcib10
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel Patsburg AHCI SATA controller> port 0x2070-0x2077,0x2060-0x2063,0x2050-0x2057,0x2040-0x2043,0x2020-0x203f mem 0xd0b00000-0xd0b007ff irq 21 at device 31.2 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
pcib11: <ACPI Host-PCI bridge> on acpi0
pci128: <ACPI PCI bus> on pcib11
pcib12: <ACPI PCI-PCI bridge> irq 71 at device 1.0 on pci128
pci129: <ACPI PCI bus> on pcib12
pcib13: <ACPI PCI-PCI bridge> irq 71 at device 2.0 on pci128
pci130: <ACPI PCI bus> on pcib13
mps0: <LSI SAS2116> port 0xc000-0xc0ff mem 0xec280000-0xec283fff,0xec240000-0xec27ffff irq 56 at device 0.0 on pci130
mps0: Firmware: 16.00.00.00, Driver: 16.00.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
pcib14: <ACPI PCI-PCI bridge> irq 71 at device 2.2 on pci128
pci131: <ACPI PCI bus> on pcib14
pcib15: <ACPI PCI-PCI bridge> irq 71 at device 3.0 on pci128
pci132: <ACPI PCI bus> on pcib15
pcib16: <ACPI PCI-PCI bridge> irq 71 at device 3.2 on pci128
pci133: <ACPI PCI bus> on pcib16
acpi_button0: <Sleep Button> on acpi0
pcib17: <ACPI Host-PCI bridge> on acpi0
pci127: <ACPI PCI bus> on pcib17
pcib18: <ACPI Host-PCI bridge> on acpi0
pci255: <ACPI PCI bus> on pcib18
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
ichwd0 on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
ichwd0 at port 0x430-0x437,0x460-0x47f on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcdfff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
wbwd0: HEFRAS and EFER do not align: EFER 0x2e DevID 0xff DevRev 0xff CR26 0xff
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
est2: <Enhanced SpeedStep Frequency Control> on cpu2
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
est3: <Enhanced SpeedStep Frequency Control> on cpu3
coretemp4: <CPU On-Die Thermal Sensors> on cpu4
est4: <Enhanced SpeedStep Frequency Control> on cpu4
coretemp5: <CPU On-Die Thermal Sensors> on cpu5
est5: <Enhanced SpeedStep Frequency Control> on cpu5
coretemp6: <CPU On-Die Thermal Sensors> on cpu6
est6: <Enhanced SpeedStep Frequency Control> on cpu6
coretemp7: <CPU On-Die Thermal Sensors> on cpu7
est7: <Enhanced SpeedStep Frequency Control> on cpu7
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
usbus0: 480Mbps High Speed USB v2.0
usbus1: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
ugen0.2: <vendor 0x8087> at usbus0
uhub2: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
ugen1.2: <vendor 0x8087> at usbus1
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
uhub2: 6 ports with 6 removable, self powered
uhub3: 8 ports with 8 removable, self powered
ugen1.3: <Minicom Advanced System Ltd.> at usbus1
ukbd0: <Minicom Advanced System Ltd. USB keyboard and mouse device, class 0/0, rev 1.00/60.00, addr 3> on usbus1
kbd0 at ukbd0
ums0: <Minicom Advanced System Ltd. USB keyboard and mouse device, class 0/0, rev 1.00/60.00, addr 3> on usbus1
ums0: 8 buttons and [XYZ] coordinates ID=1
ums0: 8 buttons and [Z] coordinates ID=2
ugen1.4: <USB> at usbus1
umass0: <USB Flash DISK, class 0/0, rev 2.00/11.00, addr 4> on usbus1
umass0:  SCSI over Bulk-Only; quirks = 0x4000
umass0:8:0:-1: Attached to scbus8
ugen1.5: <American Megatrends Inc.> at usbus1
ukbd1: <Keyboard Interface> on usbus1
kbd2 at ukbd1
ums1: <Mouse Interface> on usbus1
ums1: 3 buttons and [Z] coordinates ID=0
da0 at mps0 bus 0 scbus6 target 0 lun 0
da0: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da0: Serial Number      WD-WX11D153XVEY
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da0: quirks=0x8<4K>
da1 at mps0 bus 0 scbus6 target 3 lun 0
da1: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da1: Serial Number      WD-WX21DC4D5ZFD
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da1: quirks=0x8<4K>
da2 at mps0 bus 0 scbus6 target 4 lun 0
da2: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da2: Serial Number      WD-WX31DC4CKVZ9
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da2: quirks=0x8<4K>
da3 at mps0 bus 0 scbus6 target 5 lun 0
da3: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da3: Serial Number      WD-WX11DC449ZCP
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da3: quirks=0x8<4K>
da4 at mps0 bus 0 scbus6 target 6 lun 0
da4: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da4: Serial Number      WD-WX11DB4H89KR
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da4: quirks=0x8<4K>
da5 at mps0 bus 0 scbus6 target 7 lun 0
da5: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da5: Serial Number      WD-WX71DA4A07DF
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da5: quirks=0x8<4K>
da6 at mps0 bus 0 scbus6 target 8 lun 0
da6: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da6: Serial Number      WD-WX31DC46JSJY
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da6: quirks=0x8<4K>
da7 at mps0 bus 0 scbus6 target 9 lun 0
da7: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da7: Serial Number      WD-WX11D15P361L
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da7: quirks=0x8<4K>
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
da8 at mps0 bus 0 scbus6 target 10 lun 0
da8: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da8: Serial Number      WD-WX31DC4CKTU5
da8: 600.000MB/s transfers
da8: Command Queueing enabled
da8: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da8: quirks=0x8<4K>
da9 at mps0 bus 0 scbus6 target 13 lun 0
da9: <ATA WDC WD60EFRX-68T 0A82> Fixed Direct Access SCSI-6 device 
da9: Serial Number      WD-WX11DC4FK4HR
da9: 600.000MB/s transfers
da9: Command Queueing enabled
da9: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da9: quirks=0x8<4K>
da11 at mps0 bus 0 scbus6 target 15 lun 0
da11: <ATA WDC WD60EFRX-68M 0A82> Fixed Direct Access SCSI-6 device 
da11: Serial Number      WD-WX81D65D9D8F
da11: 600.000MB/s transfers
da11: Command Queueing enabled
da11: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da11: quirks=0x8<4K>
da10 at mps0 bus 0 scbus6 target 14 lun 0
da10: <ATA WDC WD60EFRX-68M 0A82> Fixed Direct Access SCSI-6 device 
da10: Serial Number      WD-WXM1H84ADTNV
da10: 600.000MB/s transfers
da10: Command Queueing enabled
da10: 5723166MB (11721045168 512 byte sectors: 255H 63S/T 729601C)
da10: quirks=0x8<4K>
da12 at umass-sim0 bus 0 scbus8 target 0 lun 0
da12: <USB Flash DISK 1100> Removable Direct Access SCSI-4 device 
da12: Serial Number 1408032790000372
da12: 40.000MB/s transfers
da12: 7728MB (15826944 512 byte sectors: 255H 63S/T 985C)
da12: quirks=0x2<NO_6_BYTE>
ada0: <TOSHIBA THNSNJ060GCSU JUGA0101> ATA-9 SATA 3.x device
ada0: Serial Number 25JS107OT9PW
ada0: 600.000MB/s transfers (SATA 3.x, UDMA5, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 57241MB (117231408 512 byte sectors: 16H 63S/T 16383C)
ada0: Previously was known as ad4
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <TOSHIBA THNSNJ060GCSU JUGA0101> ATA-9 SATA 3.x device
ada1: Serial Number 25JS107AT9PW
ada1: 600.000MB/s transfers (SATA 3.x, UDMA5, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 57241MB (117231408 512 byte sectors: 16H 63S/T 16383C)
ada1: Previously was known as ad6
SMP: AP CPU #6 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #4 Launched!
Swap zone entries reduced from 12196265 to 5420562.
Timecounter "TSC-low" frequency 1247019324 Hz quality 1000
Trying to mount root from zfs:freenas-boot/ROOT/default []...
GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
ichwd0 at port 0x430-0x437,0x460-0x47f on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
wbwd0: HEFRAS and EFER do not align: EFER 0x2e DevID 0xff DevRev 0xff CR26 0xff
GEOM_ELI: Device da0p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da8p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da1p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da2p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da3p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da4p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da11p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da6p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da7p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da10p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da5p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da9p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
vboxdrv: fAsync=0 offMin=0x35f offMax=0x7375
pid 2482 (syslog-ng), uid 0: exited on signal 6 (core dumped)
 

Robert Trevellyan

Pony Wrangler
Joined
May 16, 2014
Messages
3,778
Do you have an idea why scrub makes a drive faulty so often ?
A scrub puts more load on the system than most normal operations, so my guess is your system is unstable under load, for some yet to be determined reason. Obvious possibilities include power problems and cooling problems. Did you burn everything in before putting it into production?
 

Starpulkka

Contributor
Joined
Apr 9, 2013
Messages
179
Its that shitty backplane i see on pdf document on you 2u only 4x3 wires to supply power on those hdds, i have WD RED 6TB and it needs proper sata power all its needed different volts, not some compromise shit. You can try to disable sleeping on all hdds and wdidle3 tool to set hdds to disable it just might help or not.
 

Simond

Cadet
Joined
Sep 18, 2015
Messages
2
Thanks for your answers.
This server is not yet fully in production. So far we use it as a backup external usb drives.
I will try to monitor the temperature for a scrub to see if there is overheating.
If it is due to an insufficient power supply I wonder how to reduce power consumption.
Maybe I could use fewer disks, 11 or 10 instead of 12.
I will keep you informed of the results.
Simon
 
Status
Not open for further replies.
Top