Zpool Unavailable Disks

[rockwood]

Hi All!

So I'm having a bit of trouble with a zpool declaring that disks are unavailable. I've been googling all day, but things just aren't working. Any advice would be totally awesome.

System:

• Intel 64bit box
• FreeNAS-8.0.3-RELEASE-p1-x64 (9591) - Running on a 2gb USB thumb drive

Disks:

• 3x 2tb Samsung HDDs
• 1x 250gb Seagate HDD

Ok, here's the backstory. I have the three 2tb disks setup in a ZFS Raidz volume (named "stripe"). The 250gb Seagate disk was attached, but not configured with any volume or fs - ie. it was plugged into the system, but not doing anything. I recently removed the 250gb Seagate disk to use as an external drive for my laptop. After doing so, I got an error with the "stripe" volume saying "Error getting used space" and "Error getting available space".

Here's what I've tried:

• I've exported the volume (not destroying it) and re-imported it using "auto import volume". Each time, I got an empty drop down.
• I've reset Freenas to the factory defaults and used "auto import volume". Again, empty drop down.
• Reinstalled Freenas from scratch. Same there too.

I'm now in terminal trying to figure out whats up. Here's what I'm seeing

Code:

# zpool import -f stripe
   cannot import 'stripe': one or more devices is currently unavailable

Code:

# zpool import
    pool: stripe
         id: 10796347832224145012
         state: UNAVAIL
         status: One or more devices are missing from the system.
         action: The pool cannot be imported. Attach the missing devices and try again.
         see: http://www.sun.com/msg/ZFS-8000-6X
    config:

	stripe       UNAVAIL  missing device
	  gpt/disk0  ONLINE
	  gpt/disk1  ONLINE

	Additional devices are known to be part of this pool, though their
	exact configuration cannot be determined.

( edited for brevity )

Code:

#gpart list

    Geom name: ada0
    state: OK
    fwheads: 16
    fwsectors: 63
    last: 3907029134
    first: 34
    entries: 128
    scheme: GPT
    Providers:
    1. Name: ada0p1
       Mediasize: 2147483648 (2.0G)
       Sectorsize: 512
       Mode: r0w0e0
       rawuuid: 0a23e1a4-be4c-11e0-9827-003067b2904e
       rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
       label: swap-ada0
       length: 2147483648
       offset: 65536
       type: freebsd-swap
       index: 1
       end: 4194431
       start: 128
    2. Name: ada0p2
       Mediasize: 1998251367936 (1.8T)
       Sectorsize: 512
       Mode: r0w0e0
       rawuuid: 0a2cbfc0-be4c-11e0-9827-003067b2904e
       rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
       label: disk0
       length: 1998251367936
       offset: 2147549184
       type: freebsd-zfs
       index: 2
       end: 3907029134
       start: 4194432
    Consumers:
    1. Name: ada0
       Mediasize: 2000398934016 (1.8T)
       Sectorsize: 512
       Mode: r0w0e0

    Geom name: ada1
    state: OK
    fwheads: 16
    fwsectors: 63
    last: 3907029134
    first: 34
    entries: 128
    scheme: GPT
    Providers:
    1. Name: ada1p1
       Mediasize: 2147483648 (2.0G)
       Sectorsize: 512
       Mode: r0w0e0
       rawuuid: 0a8b0961-be4c-11e0-9827-003067b2904e
       rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
       label: swap-ada1
       length: 2147483648
       offset: 65536
       type: freebsd-swap
       index: 1
       end: 4194431
       start: 128
    2. Name: ada1p2
       Mediasize: 1998251367936 (1.8T)
       Sectorsize: 512
       Mode: r0w0e0
       rawuuid: 0a9c3903-be4c-11e0-9827-003067b2904e
       rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
       label: disk1
       length: 1998251367936
       offset: 2147549184
       type: freebsd-zfs
       index: 2
       end: 3907029134
       start: 4194432
    Consumers:
    1. Name: ada1
       Mediasize: 2000398934016 (1.8T)
       Sectorsize: 512
       Mode: r0w0e0

    Geom name: ada2
    state: OK
    fwheads: 16
    fwsectors: 63
    last: 3907029134
    first: 34
    entries: 128
    scheme: GPT
    Providers:
    1. Name: ada2p1
       Mediasize: 2147483648 (2.0G)
       Sectorsize: 512
       Mode: r0w0e0
       rawuuid: 0b064987-be4c-11e0-9827-003067b2904e
       rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
       label: swap-ada2
       length: 2147483648
       offset: 65536
       type: freebsd-swap
       index: 1
       end: 4194431
       start: 128
    2. Name: ada2p2
       Mediasize: 1998251367936 (1.8T)
       Sectorsize: 512
       Mode: r0w0e0
       rawuuid: 0b0ed469-be4c-11e0-9827-003067b2904e
       rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
       label: ada2
       length: 1998251367936
       offset: 2147549184
       type: freebsd-zfs
       index: 2
       end: 3907029134
       start: 4194432
    Consumers:
    1. Name: ada2
       Mediasize: 2000398934016 (1.8T)
       Sectorsize: 512
       Mode: r0w0e0

Code:

#vi /var/run/dmesg.boot
Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-RELEASE-p6 #0: Wed Jan 18 13:52:11 PST 2012
    root@build.ixsystems.com:/build/home/gcooper/e2e-bld.Pp7kV0qa/obj.amd64/build/home/gcooper/e2e-bld.Pp7kV0qa/FreeBSD/src/sys/FREENAS.amd64 amd64
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Pentium(R) CPU G620T @ 2.20GHz (2195.04-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x206a7  Family = 6  Model = 2a  Stepping = 7
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x59ae3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,POPCNT,<b24>,XSAVE>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  TSC: P-state invariant
real memory  = 8589934592 (8192 MB)
avail memory = 8145375232 (7768 MB)
ACPI APIC Table: <ALASKA A M I>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  2
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
acpi0: <ALASKA A M I> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
Timecounter "ACPI-safe" frequency 3579545 Hz quality 850
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
vgapci0: <VGA-compatible display> port 0xf000-0xf03f mem 0xfe000000-0xfe3fffff,0xc0000000-0xcfffffff irq 16 at device 2.0 on pci0
pci0: <simple comms> at device 22.0 (no driver attached)
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xfe406000-0xfe4063ff irq 16 at device 26.0 on pci0
ehci0: [ITHREAD]
usbus0: waiting for BIOS to give up control
usbus0: timed out waiting for BIOS
usbus0: EHCI version 1.0
usbus0: <EHCI (generic) USB 2.0 controller> on ehci0
pci0: <multimedia, HDA> at device 27.0 (no driver attached)
pcib1: <ACPI PCI-PCI bridge> irq 17 at device 28.0 on pci0
pci1: <ACPI PCI bus> on pcib1
re0: <RealTek 8168/8111 B/C/CP/D/DP/E PCIe Gigabit Ethernet> port 0xe000-0xe0ff mem 0xd0004000-0xd0004fff,0xd0000000-0xd0003fff irq 16 at device 0.0 on pci1
re0: Using 1 MSI-X message
re0: Chip rev. 0x2c000000
re0: MAC rev. 0x00000000
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211B media interface> PHY 1 on miibus0
rgephy0:  10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-maste
r, auto, auto-flow
re0: Ethernet address: 00:30:67:b2:90:4e
re0: [ITHREAD]
pcib2: <ACPI PCI-PCI bridge> irq 18 at device 28.2 on pci0
pci2: <ACPI PCI bus> on pcib2
pci3: <PCI bus> on pcib3
ehci1: <EHCI (generic) USB 2.0 controller> mem 0xfe405000-0xfe4053ff irq 23 at device 29.0 on pci0
ehci1: [ITHREAD]
usbus1: waiting for BIOS to give up control
usbus1: timed out waiting for BIOS
usbus1: EHCI version 1.0
usbus1: <EHCI (generic) USB 2.0 controller> on ehci1
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel Cougar Point SATA300 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xf0d0-0xf0df,0xf0c0-0xf0cf irq 19 at device 31.2 on pci0
ata0: <ATA channel 0> on atapci0
ata0: [ITHREAD]
ata1: <ATA channel 1> on atapci0
ata1: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
atapci1: <Intel Cougar Point SATA300 controller> port 0xf0b0-0xf0b7,0xf0a0-0xf0a3,0xf090-0xf097,0xf080-0xf083,0xf070-0xf07f,0xf060-0xf06f irq 19 at device 31.5 on pci0
atapci1: [ITHREAD]
ata2: <ATA channel 0> on atapci1
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci1
ata3: [ITHREAD]
acpi_button0: <Power Button> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: [FILTER]
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
orm0: <ISA Option ROM> at iomem 0xc0000-0xcd7ff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
ppc0: cannot reserve I/O port range
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
fuse4bsd: version 0.3.9-pre1, FUSE ABI 7.8
Timecounters tick every 1.000 msec
usbus0: 480Mbps High Speed USB v2.0
usbus1: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
ugen0.2: <vendor 0x8087> at usbus0
uhub2: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
ugen1.2: <vendor 0x8087> at usbus1
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
uhub2: 6 ports with 6 removable, self powered
uhub3: 8 ports with 8 removable, self powered
ugen0.3: <Memorex> at usbus0
umass0: <Memorex Mini, class 0/0, rev 2.00/1.00, addr 3> on usbus0
ada0 at ata0 bus 0 scbus0 target 1 lun 0
ada0: <SAMSUNG HD204UI 1AQ10001> ATA-8 SATA 2.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)da0 at umass-sim0 bus 0 scbus4 target 0 lun 0
da0: <Memorex Mini PMAP> Removable Direct Access SCSI-0 device
da0: 40.000MB/s transfers
da0: 1910MB (3911680 512 byte sectors: 255H 63S/T 243C)

ada0: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada1 at ata1 bus 0 scbus1 target 1 lun 0
ada1: <SAMSUNG HD204UI 1AQ10001> ATA-8 SATA 2.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada1: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada2 at ata2 bus 0 scbus2 target 0 lun 0
ada2: <SAMSUNG HD204UI 1AQ10001> ATA-8 SATA 2.x device
ada2: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada2: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
SMP: AP CPU #1 Launched!
GEOM: da0s1: geometry does not match label (16h,63s != 255h,63s).
Trying to mount root from ufs:/dev/ufs/FreeNASs1a
ZFS filesystem version 4
ZFS storage pool version 15

From other threads I've read, it sounds like disks can get out of sync with the database. I'm assuming thats what happened when I removed the 250gb disk. It looks like the "stripe" volume is only missing one of the three disks, so I'm confused why volume is unavailable, and not just degraded.

Thanks so much for checking this out. My wits are just about gone at this point!