Auto import ZFS issue

[Growden]

Hello All,

Hopefully someone can provide a little assistance with my dilemma. (I hope this is the right place to post as well)
A year or two ago I setup a Freenas server for media sharing. Re-using some old spare kit, configured with 2Gb RAM and one 3TB drive. Once setup, I took the drive out and stuck in the drawer. I then put a new 3Tb drive in and created another volume, copied media to drive and been using happily ever since distributing media to my tv. A few months back the motherboard died. I just transferred the USB drive with the Freenas installation, along with the 3Tb drive to another spare box I had (2Gb RAM as well). Then powered up, autoimport, and I was off and away again.

This brings me to now...

Motherboard died again. Thought I would follow the same procedure. Transferred USB and 3Tb drive to a spare box (same RAM) and roughly same age and powered up. Freenas came up and I logged into the WebGUI. Message about unable to obtain size. Went to autoimport zfs volume and nothing there. Realised it was showing as a 2Tb drive. Powered down, BIOS update, power back on. See’s as a 3Tb now. Auto import – nothing there. Repeat process on two other spare PC’s (I have a lot of spare PC’s), one of them with only 1Gb RAM. Same issue. Detach the old volume (did not delete shares), retried to auto import – nothing there. Did some googling and ran a few tests. Eg gpart show, zpool status – nothing there regarding the 3Tb drive. I’ll attach screen shots if required. I noticed during bootup errors about GPT corrupt or invalid. Installed latest 9.2 Freenas release and tried import on there – same, nothing shows up, but 3Tb drive seen by freenas. I now pull the old 3Tb drive from the drawer which hasn’t been touched, plug in and have all the same results as per with the other drive. Just to make sure I hadn’t wiped the old drive and forgotten, I power up with this drive as the boot drive and got a message about being a freenas data drive – confirming to me that it is not blank. I grab a spare blank 500Gb drive and plug in, power up, create volume, detach volume, autoimport volume – all with no issues?!
At this point I am a little lost with where to go. I don't believe I have done anything that could have wiped the data, but same result on 3 PC’s and with 2 different 3Tb drives. As I had to BIOS update all 3 machines to allow 3Tb drive recognition (and the same result on 2 different drives) i do suspect that the issue is hardware related though.... please help!

 

[joeschmuck]

First off you know that the RAM requirements for FreeNAS is 8GB. I'm not saying you cannot run it on 2GB but the 9.x versions don't run well with 4GB or less in many situations. But that doesn't mean I'm not going to offer some advice.

First, what version of FreeNAS were you originally using? I would go back to that if it worked well for you and that will minimize RAM concerns for you. Next do a fresh install of that old version on a new/different USB flash drive. Next try to auto-import your pool. And I'm making an assumption that your 3TB drive is a ZFS formatted drive, not UFS. Auto-Import only works for ZFS formatted drives.

If this works, great! but you may need to force the import if it doesn't.

And a question, do you at least have a backup of the data you needed to retain from the 3TB drive?

 

[Growden]

Hello Joeschmuck,

Thank you for replying.
I was expecting the RAM response :) I do understand that requirement (only since troubleshooting though). I can get onto a newer PC with 8Gb+ RAM if needs be. From what I have heard, it sounds as though you can corrupt loose data if you have less than this.... that worries me a little. (ie if important data, ecc ram damaged, boots with less ram and corrupts data requiring restore from backup.... seems odd)
I am confident it is zfs as it was only a couple of months ago that I clearly remember using auto import to get it back last time.
I do have backups (and I wouldn't loose too much sleep if I had to go back to them), but I would like to understand Freenas better, and this is a good opportunity :)

I will try your recommendation. In the meantime, here is some info using the original drive and USB install of Freenas). Please ask if there is anything else I could provide that would help.

[root@freenas ~]# zpool status no pools available [root@freenas ~]# gpart show => 63 7831489 da0 MBR (3.8G) 63 1930257 1 freebsd [active] (942M) 1930320 63 - free - (31k) 1930383 1930257 2 freebsd (942M) 3860640 3024 3 freebsd (1.5M) 3863664 41328 4 freebsd (20M) 3904992 3926560 - free - (1.9G) => 0 1930257 da0s1 BSD (942M) 0 16 - free - (8.0k) 16 1930241 1 !0 (942M) [root@freenas ~]#

Copyright (c) 1992-2012 The FreeBSD Project.

Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994

The Regents of the University of California. All rights reserved.

FreeBSD is a registered trademark of The FreeBSD Foundation.

FreeBSD 8.3-RELEASE-p7 #1 r249203M: Sat Apr 6 09:28:27 PDT 2013

root@build.ixsystems.com:/tank/home/jpaetzel/fn8.3/freenas/os-base/amd64/tan

k/home/jpaetzel/fn8.3/freenas/FreeBSD/src/sys/FREENAS.amd64 amd64

Timecounter "i8254" frequency 1193182 Hz quality 0

CPU: Intel(R) Core(TM)2 CPU 6300 @ 1.86GHz (1863.50-MHz K8-class CPU)

Origin = "GenuineIntel" Id = 0x6f6 Family = 6 Model = f Stepping = 6

Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C

MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>

Features2=0xe3bd<SSE3,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM>

AMD Features=0x20100800<SYSCALL,NX,LM>

AMD Features2=0x1<LAHF>

TSC: P-state invariant

real memory = 4294967296 (4096 MB)

avail memory = 4098691072 (3908 MB)

ACPI APIC Table: <IntelR AWRDACPI>

FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs

FreeBSD/SMP: 1 package(s) x 2 core(s)

cpu0 (BSP): APIC ID: 0

cpu1 (AP): APIC ID: 1

WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0: Changing APIC ID to 4
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
hpt27xx: RocketRAID 27xx controller driver v1.0 (Apr 6 2013 09:28:15)
cryptosoft0: <software crypto> on motherboard
aesni0: No AESNI support.
acpi0: <IntelR AWRDACPI> on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, cfde0000 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci1: <PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0xdf00-0xdf7f mem 0xfa000000-0xfaffffff,0
xd0000000-0xdfffffff,0xfb000000-0xfbffffff irq 16 at device 0.0 on pci1
uhci0: <Intel 82801H (ICH8) USB controller USB-D> port 0xff00-0xff1f irq 16 at d
evice 26.0 on pci0
uhci0: [ITHREAD]
usbus0: <Intel 82801H (ICH8) USB controller USB-D> on uhci0
uhci1: <Intel 82801H (ICH8) USB controller USB-E> port 0xfe00-0xfe1f irq 21 at d
evice 26.1 on pci0
uhci1: [ITHREAD]
usbus1: <Intel 82801H (ICH8) USB controller USB-E> on uhci1
ehci0: <Intel 82801H (ICH8) USB 2.0 controller USB2-B> mem 0xfdfff000-0xfdfff3ff
irq 18 at device 26.7 on pci0
ehci0: [ITHREAD]
usbus2: EHCI version 1.0
usbus2: <Intel 82801H (ICH8) USB 2.0 controller USB2-B> on ehci0
pci0: <multimedia, HDA> at device 27.0 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib2
atapci0: <JMicron JMB361 UDMA133 controller> port 0xbf00-0xbf07,0xbe00-0xbe03,0x
bd00-0xbd07,0xbc00-0xbc03,0xbb00-0xbb0f mem 0xfdbfe000-0xfdbfffff irq 16 at devi
ce 0.0 on pci2
atapci0: [ITHREAD]
ahci0: <JMicron JMB361 AHCI SATA controller> at channel -1 on atapci0
ahci0: [ITHREAD]
ahci0: AHCI v1.00 with 2 3Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich0: [ITHREAD]
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich1: [ITHREAD]
ata2: <ATA channel> at channel 0 on atapci0
ata2: [ITHREAD]
uhci2: <Intel 82801H (ICH8) USB controller USB-A> port 0xfd00-0xfd1f irq 23 at d
evice 29.0 on pci0
uhci2: [ITHREAD]
usbus3: <Intel 82801H (ICH8) USB controller USB-A> on uhci2
uhci3: <Intel 82801H (ICH8) USB controller USB-B> port 0xfc00-0xfc1f irq 19 at d
evice 29.1 on pci0
uhci3: [ITHREAD]
usbus4: <Intel 82801H (ICH8) USB controller USB-B> on uhci3
uhci4: <Intel 82801H (ICH8) USB controller USB-C> port 0xfb00-0xfb1f irq 18 at d
evice 29.2 on pci0
uhci4: [ITHREAD]
usbus5: <Intel 82801H (ICH8) USB controller USB-C> on uhci4
ehci1: <Intel 82801H (ICH8) USB 2.0 controller USB2-A> mem 0xfdffe000-0xfdffe3ff
irq 23 at device 29.7 on pci0
ehci1: [ITHREAD]
usbus6: EHCI version 1.0
usbus6: <Intel 82801H (ICH8) USB 2.0 controller USB2-A> on ehci1
pcib3: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci3: <ACPI PCI bus> on pcib3
re0: <RealTek 8169SC/8110SC Single-chip Gigabit Ethernet> port 0xce00-0xceff mem
0xfdeff000-0xfdeff0ff irq 21 at device 6.0 on pci3
re0: Chip rev. 0x18000000
re0: MAC rev. 0x00000000
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211B media interface> PHY 1 on miibus0
rgephy0: none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX
, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-
master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re0: Ethernet address: 00:16:17:b4:27:08
re0: [FILTER]
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci1: <Intel ICH8 SATA300 controller> port 0xfa00-0xfa07,0xf900-0xf903,0xf800
-0xf807,0xf700-0xf703,0xf600-0xf60f,0xf500-0xf50f irq 19 at device 31.2 on pci0
atapci1: [ITHREAD]
ata3: <ATA channel> at channel 0 on atapci1
ata3: [ITHREAD]
ata4: <ATA channel> at channel 1 on atapci1
ata4: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
atapci2: <Intel ICH8 SATA300 controller> port 0xf300-0xf307,0xf200-0xf203,0xf100
-0xf107,0xf000-0xf003,0xef00-0xef0f,0xee00-0xee0f irq 19 at device 31.5 on pci0
atapci2: [ITHREAD]
ata5: <ATA channel> at channel 0 on atapci2
ata5: [ITHREAD]
ata6: <ATA channel> at channel 1 on atapci2
ata6: [ITHREAD]
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz0: _PSV value is absurd, ignored (1672.0C)
acpi_tz0: _ACx value is absurd, ignored (1672.0C)
atrtc0: <AT realtime clock> port 0x70-0x73 irq 8 on acpi0
fdc0: <floppy drive controller> port 0x3f0-0x3f5,0x3f7 irq 6 drq 2 on acpi0
fdc0: [FILTER]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: [FILTER]
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart1: [FILTER]
ppc0: <Parallel port> port 0x378-0x37f,0x778-0x77b irq 7 on acpi0
ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode
ppc0: [ITHREAD]
ppbus0: <Parallel port bus> on ppc0
lpt0: <Printer> on ppbus0
lpt0: [ITHREAD]
lpt0: Interrupt-driven port
orm0: <ISA Option ROMs> at iomem 0xd0000-0xd27ff,0xd3000-0xd3fff,0xef000-0xeffff
on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: [ITHREAD]
psm0: model IntelliMouse, device ID 3
acpi_perf0: <ACPI CPU Frequency Control> on cpu0
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 728072806000728
device_attach: est1 attach returned 6
p4tcc1: <CPU Frequency Thermal Control> on cpu1
fuse4bsd: version 0.3.9-pre1, FUSE ABI 7.8
Timecounters tick every 1.000 msec
hpt27xx: no controller detected.
GEOM_RAID5: Module loaded, version 1.1.20110927.40 (rev 00ce00e5abb4)
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 480Mbps High Speed USB v2.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 12Mbps Full Speed USB v1.0
usbus5: 12Mbps Full Speed USB v1.0
usbus6: 480Mbps High Speed USB v2.0
acpi_tz0: _PSV value is absurd, ignored (1672.0C)
acpi_tz0: _ACx value is absurd, ignored (1672.0C)
ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <Intel> at usbus2
uhub2: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
ugen4.1: <Intel> at usbus4
uhub4: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen5.1: <Intel> at usbus5
uhub5: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
ugen6.1: <Intel> at usbus6
uhub6: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus6
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
uhub4: 2 ports with 2 removable, self powered
uhub5: 2 ports with 2 removable, self powered
uhub2: 4 ports with 4 removable, self powered
acpi_tz0: _PSV value is absurd, ignored (1672.0C)
acpi_tz0: _ACx value is absurd, ignored (1672.0C)
uhub6: 6 ports with 6 removable, self powered
ugen4.2: <Microsoft> at usbus4
ukbd0: <Microsoft Microsoft Digital Media Keyboard, class 0/0, rev 2.00/1.10, ad
dr 2> on usbus4
kbd2 at ukbd0
uhid0: <Microsoft Microsoft Digital Media Keyboard, class 0/0, rev 2.00/1.10, ad
dr 2> on usbus4
ugen6.2: <General> at usbus6
umass0: <General USB Flash Disk, class 0/0, rev 2.00/1.00, addr 2> on usbus6
ada0 at ata5 bus 0 scbus5 target 0 lun 0
ada0: <WDC WD30EZRX-00DC0B0 80.00A80> ATA-9 SATA 3.x device
ada0: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada0: 2861587MB (5860531055 512 byte sectors: 16H 63S/T 16383C)
da0 at umass-sim0 bus 0 scbus7 target 0 lun 0
da0: <General USB Flash Disk 1.0> Removable Direct Access SCSI-2 device
da0: 40.000MB/s transfers
da0: 3824MB (7831552 512 byte sectors: 255H 63S/T 487C)
SMP: AP CPU #1 Launched!
cd0 at ahcich0 bus 0 scbus0 target 0 lun 0
cd0: <PIONEER DVD-RW DVR-215 1.13> Removable CD-ROM SCSI-0 device
cd0: 150.000MB/s transfers (SATA 1.x, UDMA4, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
GEOM: ada0: corrupt or invalid GPT detected.
GEOM: ada0: GPT rejected -- may not be recoverable.
GEOM: da0s1: geometry does not match label (16h,63s != 255h,63s).
Trying to mount root from ufs:/dev/ufs/FreeNASs1a
ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version 5
ZFS storage pool version 28

 

[joeschmuck]

I'm not sure what you did when you posted the text but it was white on white, not very easy to read. I adjusted it a little for you.

So it looks like FreeNAS is recognizing you have a 3TB drive connected, that is a good thing. Glad to see you are using FreeNAS 8.3, it's stable and as you know and has been known to run with low RAM.

 

[Growden]

Bugger.did as suggested and same symptons :(
Just not seeing a volume to import. The gpt invalid or corrupt thing concerns me.. but I have a feeling that is a red herring

 

[Growden]

Hello Joeschmuck,

As mentioned, no luck with that. But, how would I attempt to "force import"
Also, if I have no luck with that - What program would you suggest to use to recover the data. ie bootcd with the drive attached and file copy.

 

[Growden]

An update...
I have repeated the process from start to finish with a 250Gb drive. (won't go into the detail again, suffice to say process matched). With the 250Gb drive no issues. ie can import in on new hardware. This being the case, I would assume that the motherboard change shouldn't be the issue (eg writing data to the drive and changing somehow[HPA for example]). This leaves me with two possibilities - 1. issue with 3tb drive (unlikely as the other machines are far newer than the previous one on which the mainboard blew), and 2. with the drive being recognised as 2Tb during bootup of freenas (which I then updated BIOS to get it to recognise the drive as 3Tb) has somehow altered the drive. Unfortunately I have run out of spare computers and 3Tb drives to test with.

I suspect that the GPT has been lost as per the info below. No idea on how to fix this without wiping the drive though
cd0: Attempt to query device size failed: NOT READY, Medium not present
GEOM: ada0: corrupt or invalid GPT detected.
GEOM: ada0: GPT rejected -- may not be recoverable.
GEOM: da0s1: geometry does not match label (16h,63s != 255h,63s).
Trying to mount root from ufs:/dev/ufs/FreeNASs1a
ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version 5
ZFS storage pool version 28