Pool disappeared after power failure. Import throws error

smokeypeet · Nov 19, 2021

Hello @ all,

I know there have already been a few entries in the forum on this topic. But these are not solved or are already very old. Therefore, I am now trying my luck here. I have the TrueNAS version TrueNAS-12.0-U6.1. Before that I had the stable 11 installed, but in the course of the attempted troubleshooting I tried an update, which as you can imagine did not lead to success.

It is very important for me to get the data off the disks, as all my pictures have been stored there since I was a child. Whether the system runs again afterwards is secondary.

Software
FreeNAS 11.3 stable when the error occurred
TrueNAS 12 stable updated with the hope of eliminating the error

Hardware
Mainboard: ASUS Prime B365M-A
Processor: Intel i3-9100F0
RAM: 16GB
OS SSD: 2x Samsung SSD 128 GB mirrored
RAID HDD: 4x Western Digital 8TB HDD Raid 5

Error description
The server has been running for one year without any problems until now. About a week ago, there was a power failure at home. Since then, I have had repeated problems accessing the drive, up to a complete failure of access. A look at the web interface showed the following:

The pool was displayed as offline. Under Storage - Pool there was information about an UNKNOWN status. I tried a lot of things from the forum, up to the disconnect of the pool without any success. When importing via the console, the following message appears:

Code:

root@freenas[~]# zpool import Dataspace
cannot import 'Dataspace': I/O error
        Destroy and re-create the pool from
        a backup source.

Here is some information that I found in the forum and carried out:

Code:

root@freenas[~]# zpool status
  pool: freenas-boot
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
        still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(5) for details.
  scan: scrub repaired 0B in 00:00:38 with 0 errors on Wed Nov 17 03:45:38 2021
config:

        NAME          STATE     READ WRITE CKSUM
        freenas-boot  ONLINE       0     0     0
          mirror-0    ONLINE       0     0     0
            ada0p2    ONLINE       0     0     0
            ada1p2    ONLINE       0     0     0

errors: No known data errors

Code:

root@freenas[~]# glabel status
                                      Name  Status  Components
gptid/f89c5a23-0159-11eb-869d-a85e45e623b6     N/A  ada0p1
gptid/f8a31594-0159-11eb-869d-a85e45e623b6     N/A  ada1p1
gptid/b323c15f-015d-11eb-8643-a85e45e623b6     N/A  ada2p2
gptid/b3205408-015d-11eb-8643-a85e45e623b6     N/A  ada3p2
gptid/b3255527-015d-11eb-8643-a85e45e623b6     N/A  ada4p2
gptid/b322843c-015d-11eb-8643-a85e45e623b6     N/A  ada5p2
gptid/b3124507-015d-11eb-8643-a85e45e623b6     N/A  ada5p1
gptid/b31b1d29-015d-11eb-8643-a85e45e623b6     N/A  ada4p1
gptid/b30c576d-015d-11eb-8643-a85e45e623b6     N/A  ada3p1
gptid/b315cae7-015d-11eb-8643-a85e45e623b6     N/A  ada2p1

Code:

root@freenas[~]# camcontrol devlist
<Samsung SSD 840 EVO 120GB EXT0BB6Q>  at scbus0 target 0 lun 0 (pass0,ada0)
<Samsung SSD 840 EVO 120GB EXT0BB6Q>  at scbus1 target 0 lun 0 (pass1,ada1)
<HUS728T8TALN6L0 V8EMT430>         at scbus2 target 0 lun 0 (pass2,ada2)
<HUS728T8TALN6L0 V8EMT430>         at scbus3 target 0 lun 0 (pass3,ada3)
<HUS728T8TALN6L0 V8EMT430>         at scbus4 target 0 lun 0 (pass4,ada4)
<HUS728T8TALN6L0 V8EMT430>         at scbus5 target 0 lun 0 (pass5,ada5)
<AHCI SGPIO Enclosure 2.00 0001>   at scbus6 target 0 lun 0 (pass6,ses0)

Code:

root@freenas[~]# dmesg
---<<BOOT>>---
Copyright (c) 1992-2020 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 12.2-RELEASE-p10 b26f74b5984(HEAD) TRUENAS amd64
FreeBSD clang version 10.0.1 (git@github.com:llvm/llvm-project.git llvmorg-10.0.1-0-gef32c611aa2)
VT(efifb): resolution 1280x1024
CPU: Intel(R) Core(TM) i3-9100F CPU @ 3.60GHz (3600.15-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x906ea  Family=0x6  Model=0x9e  Stepping=10
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7ffafbbf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0x29c67af<FSGSBASE,TSCADJ,SGX,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,NFPUSG,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PROCTRACE>
  Structured Extended Features2=0x40000000<SGXLC>
  Structured Extended Features3=0x9c002400<MD_CLEAR,TSXFA,IBPB,STIBP,L1DFL,SSBD>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  VT-x: (disabled in BIOS) PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 16349106176 (15591 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: unblocking device.
ioapic0 <Version 2.0> irqs 0-119 on motherboard
Launching APs: 3 2 1
Timecounter "TSC-low" frequency 1800074033 Hz quality 1000
random: entropy device external interface
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
kbd1 at kbdmux0
mlx5en: Mellanox Ethernet driver 3.5.2 (September 2019)
nexus0
efirtc0: <EFI Realtime Clock> on motherboard
efirtc0: registered as a time-of-day clock, resolution 1.000000s
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS> on motherboard
padlock0: No ACE support.
cryptosoft0: <software crypto> on motherboard
acpi0: <ALASKA A M I > on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 24000000 Hz quality 950
Event timer "HPET" frequency 24000000 Hz quality 550
Event timer "HPET1" frequency 24000000 Hz quality 440
Event timer "HPET2" frequency 24000000 Hz quality 440
Event timer "HPET3" frequency 24000000 Hz quality 440
Event timer "HPET4" frequency 24000000 Hz quality 440
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0xe000-0xe0ff mem 0xe0000000-0xefffffff,0xf7e00000-0xf7e3ffff irq 16 at device 0.0 on pci1
vgapci0: Boot video device
pci1: <multimedia, HDA> at device 0.1 (no driver attached)
xhci0: <Intel Union Point USB 3.0 controller> mem 0xf7f10000-0xf7f1ffff irq 16 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci0: <simple comms> at device 22.0 (no driver attached)
ahci0: <Intel Union Point AHCI SATA controller> port 0xf050-0xf057,0xf040-0xf043,0xf020-0xf03f mem 0xf7f28000-0xf7f29fff,0xf7f2c000-0xf7f2c0ff,0xf7f2b000-0xf7f2b7ff irq 16 at device 23.0 on pci0
ahci0: AHCI v1.31 with 6 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
pcib2: <ACPI PCI-PCI bridge> irq 18 at device 27.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 18 at device 28.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 19 at device 28.7 on pci0
pci4: <ACPI PCI bus> on pcib4
re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xd000-0xd0ff mem 0xf7d04000-0xf7d04fff,0xf7d00000-0xf7d03fff irq 19 at device 0.0 on pci4
re0: Using 1 MSI-X message
re0: ASPM disabled
re0: Chip rev. 0x54000000
re0: MAC rev. 0x00100000
miibus0: <MII bus> on re0
rgephy0: <RTL8251/8153 1000BASE-T media interface> PHY 1 on miibus0
rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re0: Using defaults for TSO: 65518/35/2048
re0: Ethernet address: a8:5e:45:e6:23:b6
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 29.0 on pci0
pci5: <ACPI PCI bus> on pcib5
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
pci0: <memory> at device 31.2 (no driver attached)
pci0: <multimedia, HDA> at device 31.3 (no driver attached)
acpi_button0: <Sleep Button> on acpi0
acpi_button1: <Power Button> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz1: <Thermal Zone> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
orm0: <ISA Option ROM> at iomem 0xc0000-0xcffff pnpid ORM0000 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
Timecounters tick every 1.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
Trying to mount root from zfs:freenas-boot/ROOT/FreeNAS-12.0-U6.1 []...
Root mount waiting for: usbus0 CAM
ugen0.1: <0x8086 XHCI root HUB> at usbus0
uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ses0 at ahciem0 bus 0 scbus6 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <Samsung SSD 840 EVO 120GB EXT0BB6Q> ACS-2 ATA SATA 3.x device
ada0: Serial Number S1D5NSBF358264V
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 114473MB (234441648 512 byte sectors)
ada0: quirks=0x3<4K,NCQ_TRIM_BROKEN>
ses0: ada0 in 'Slot 00', SATA Slot: scbus0 target 0
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <Samsung SSD 840 EVO 120GB EXT0BB6Q> ACS-2 ATA SATA 3.x device
ada1: Serial Number S1D5NSBF358265D
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada1: Command Queueing enabled
ada1: 114473MB (234441648 512 byte sectors)
ada1: quirks=0x3<4K,NCQ_TRIM_BROKEN>
ses0: ada1 in 'Slot 01', SATA Slot: scbus1 target 0
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: <HUS728T8TALN6L0 V8EMT430> ACS-2 ATA SATA 3.x device
ada2: Serial Number VAG35RWD
ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 7630885MB (1953506646 4096 byte sectors)
ses0: ada2 in 'Slot 02', SATA Slot: scbus2 target 0
ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
ada3: <HUS728T8TALN6L0 V8EMT430> ACS-2 ATA SATA 3.x device
ada3: Serial Number VAG3117L
ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 7630885MB (1953506646 4096 byte sectors)
ses0: ada3 in 'Slot 03', SATA Slot: scbus3 target 0
ada4 at ahcich4 bus 0 scbus4 target 0 lun 0
ada4: <HUS728T8TALN6L0 V8EMT430> ACS-2 ATA SATA 3.x device
ada4: Serial Number VAG315VL
ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada4: Command Queueing enabled
ada4: 7630885MB (1953506646 4096 byte sectors)
ses0: ada4 in 'Slot 04', SATA Slot: scbus4 target 0
ada5 at ahcich5 bus 0 scbus5 target 0 lun 0
ada5: <HUS728T8TALN6L0 V8EMT430> ACS-2 ATA SATA 3.x device
ada5: Serial Number VAG37L6D
ada5: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada5: Command Queueing enabled
ada5: 7630885MB (1953506646 4096 byte sectors)
ses0: ada5,pass5 in 'Slot 05', SATA Slot: scbus5 target 0
uhub0: 24 ports with 24 removable, self powered
Root mount waiting for: usbus0
ugen0.2: <vendor 0x046a product 0x0023> at usbus0
ukbd0 on uhub0
ukbd0: <vendor 0x046a product 0x0023, class 0/0, rev 2.00/2.20, addr 1> on usbus0
kbd2 at ukbd0
uhid0 on uhub0
uhid0: <vendor 0x046a product 0x0023, class 0/0, rev 2.00/2.20, addr 1> on usbus0
lo0: link state changed to UP
vmx_init: VMX operation disabled by BIOS
module_register_init: MOD_LOAD (vmm, 0xffffffff83814e60, 0) error 6
re0: link state changed to UP
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/8/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI>
re0: link state changed to DOWN
re0: link state changed to UP
CPU: Intel(R) Core(TM) i3-9100F CPU @ 3.60GHz (3600.15-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x906ea  Family=0x6  Model=0x9e  Stepping=10
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7ffafbbf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0x29c67af<FSGSBASE,TSCADJ,SGX,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,NFPUSG,MPX,RDSEED,ADX,SMAP,CLFLUSHOPT,PROCTRACE>
  Structured Extended Features2=0x40000000<SGXLC>
  Structured Extended Features3=0x9c002600<MCUOPT,MD_CLEAR,TSXFA,IBPB,STIBP,L1DFL,SSBD>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  VT-x: (disabled in BIOS) PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
Security policy loaded: MAC/ntpd (mac_ntpd)
Solaris: WARNING: can't open objset 80, error 5
Solaris: WARNING: can't open objset 80, error 5

Code:

root@freenas[~]# gpart list
Geom name: ada0
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 234441607
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: ada0p1
   Mediasize: 272629760 (260M)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   efimedia: HD(1,GPT,f89c5a23-0159-11eb-869d-a85e45e623b6,0x28,0x82000)
   rawuuid: f89c5a23-0159-11eb-869d-a85e45e623b6
   rawtype: c12a7328-f81f-11d2-ba4b-00a0c93ec93b
   label: (null)
   length: 272629760
   offset: 20480
   type: efi
   index: 1
   end: 532519
   start: 40
2. Name: ada0p2
   Mediasize: 119755767808 (112G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   efimedia: HD(2,GPT,f89fd04d-0159-11eb-869d-a85e45e623b6,0x82028,0xdf10000)
   rawuuid: f89fd04d-0159-11eb-869d-a85e45e623b6
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 119755767808
   offset: 272650240
   type: freebsd-zfs
   index: 2
   end: 234430503
   start: 532520
Consumers:
1. Name: ada0
   Mediasize: 120034123776 (112G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2

Geom name: ada1
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 234441607
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: ada1p1
   Mediasize: 272629760 (260M)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   efimedia: HD(1,GPT,f8a31594-0159-11eb-869d-a85e45e623b6,0x28,0x82000)
   rawuuid: f8a31594-0159-11eb-869d-a85e45e623b6
   rawtype: c12a7328-f81f-11d2-ba4b-00a0c93ec93b
   label: (null)
   length: 272629760
   offset: 20480
   type: efi
   index: 1
   end: 532519
   start: 40
2. Name: ada1p2
   Mediasize: 119755767808 (112G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   efimedia: HD(2,GPT,f8a68f79-0159-11eb-869d-a85e45e623b6,0x82028,0xdf10000)
   rawuuid: f8a68f79-0159-11eb-869d-a85e45e623b6
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 119755767808
   offset: 272650240
   type: freebsd-zfs
   index: 2
   end: 234430503
   start: 532520
Consumers:
1. Name: ada1
   Mediasize: 120034123776 (112G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2

Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953506640
first: 6
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
   Mediasize: 17179869184 (16G)
   Sectorsize: 4096
   Stripesize: 0
   Stripeoffset: 524288
   Mode: r0w0e0
   efimedia: HD(1,GPT,b315cae7-015d-11eb-8643-a85e45e623b6,0x80,0x400000)
   rawuuid: b315cae7-015d-11eb-8643-a85e45e623b6
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 17179869184
   offset: 524288
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada2p2
   Mediasize: 7984382808064 (7.3T)
   Sectorsize: 4096
   Stripesize: 0
   Stripeoffset: 524288
   Mode: r0w0e0
   efimedia: HD(2,GPT,b323c15f-015d-11eb-8643-a85e45e623b6,0x400080,0x743024d1)
   rawuuid: b323c15f-015d-11eb-8643-a85e45e623b6
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 7984382808064
   offset: 17180393472
   type: freebsd-zfs
   index: 2
   end: 1953506640
   start: 4194432
Consumers:
1. Name: ada2
   Mediasize: 8001563222016 (7.3T)
   Sectorsize: 4096
   Mode: r0w0e0

Geom name: ada3
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953506640
first: 6
entries: 128
scheme: GPT
Providers:
1. Name: ada3p1
   Mediasize: 17179869184 (16G)
   Sectorsize: 4096
   Stripesize: 0
   Stripeoffset: 524288
   Mode: r0w0e0
   efimedia: HD(1,GPT,b30c576d-015d-11eb-8643-a85e45e623b6,0x80,0x400000)
   rawuuid: b30c576d-015d-11eb-8643-a85e45e623b6
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 17179869184
   offset: 524288
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada3p2
   Mediasize: 7984382808064 (7.3T)
   Sectorsize: 4096
   Stripesize: 0
   Stripeoffset: 524288
   Mode: r0w0e0
   efimedia: HD(2,GPT,b3205408-015d-11eb-8643-a85e45e623b6,0x400080,0x743024d1)
   rawuuid: b3205408-015d-11eb-8643-a85e45e623b6
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 7984382808064
   offset: 17180393472
   type: freebsd-zfs
   index: 2
   end: 1953506640
   start: 4194432
Consumers:
1. Name: ada3
   Mediasize: 8001563222016 (7.3T)
   Sectorsize: 4096
   Mode: r0w0e0

Geom name: ada4
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953506640
first: 6
entries: 128
scheme: GPT
Providers:
1. Name: ada4p1
   Mediasize: 17179869184 (16G)
   Sectorsize: 4096
   Stripesize: 0
   Stripeoffset: 524288
   Mode: r0w0e0
   efimedia: HD(1,GPT,b31b1d29-015d-11eb-8643-a85e45e623b6,0x80,0x400000)
   rawuuid: b31b1d29-015d-11eb-8643-a85e45e623b6
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 17179869184
   offset: 524288
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada4p2
   Mediasize: 7984382808064 (7.3T)
   Sectorsize: 4096
   Stripesize: 0
   Stripeoffset: 524288
   Mode: r0w0e0
   efimedia: HD(2,GPT,b3255527-015d-11eb-8643-a85e45e623b6,0x400080,0x743024d1)
   rawuuid: b3255527-015d-11eb-8643-a85e45e623b6
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 7984382808064
   offset: 17180393472
   type: freebsd-zfs
   index: 2
   end: 1953506640
   start: 4194432
Consumers:
1. Name: ada4
   Mediasize: 8001563222016 (7.3T)
   Sectorsize: 4096
   Mode: r0w0e0

Geom name: ada5
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953506640
first: 6
entries: 128
scheme: GPT
Providers:
1. Name: ada5p1
   Mediasize: 17179869184 (16G)
   Sectorsize: 4096
   Stripesize: 0
   Stripeoffset: 524288
   Mode: r0w0e0
   efimedia: HD(1,GPT,b3124507-015d-11eb-8643-a85e45e623b6,0x80,0x400000)
   rawuuid: b3124507-015d-11eb-8643-a85e45e623b6
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 17179869184
   offset: 524288
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada5p2
   Mediasize: 7984382808064 (7.3T)
   Sectorsize: 4096
   Stripesize: 0
   Stripeoffset: 524288
   Mode: r0w0e0
   efimedia: HD(2,GPT,b322843c-015d-11eb-8643-a85e45e623b6,0x400080,0x743024d1)
   rawuuid: b322843c-015d-11eb-8643-a85e45e623b6
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 7984382808064
   offset: 17180393472
   type: freebsd-zfs
   index: 2
   end: 1953506640
   start: 4194432
Consumers:
1. Name: ada5
   Mediasize: 8001563222016 (7.3T)
   Sectorsize: 4096
   Mode: r0w0e0

smokeypeet · Nov 21, 2021

This is the error message when I try to import the pool via WebUI.

Code:

Error: concurrent.futures.process._RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/concurrent/futures/process.py", line 243, in _process_worker
    r = call_item.fn(*call_item.args, **call_item.kwargs)
  File "/usr/local/lib/python3.9/site-packages/middlewared/worker.py", line 94, in main_worker
    res = MIDDLEWARE._run(*call_args)
  File "/usr/local/lib/python3.9/site-packages/middlewared/worker.py", line 45, in _run
    return self._call(name, serviceobj, methodobj, args, job=job)
  File "/usr/local/lib/python3.9/site-packages/middlewared/worker.py", line 39, in _call
    return methodobj(*params)
  File "/usr/local/lib/python3.9/site-packages/middlewared/worker.py", line 39, in _call
    return methodobj(*params)
  File "/usr/local/lib/python3.9/site-packages/middlewared/schema.py", line 979, in nf
    return f(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/zfs.py", line 371, in import_pool
    self.logger.error(
  File "libzfs.pyx", line 391, in libzfs.ZFS.__exit__
  File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/zfs.py", line 365, in import_pool
    zfs.import_pool(found, new_name or found.name, options, any_host=any_host)
  File "libzfs.pyx", line 1095, in libzfs.ZFS.import_pool
  File "libzfs.pyx", line 1123, in libzfs.ZFS.__import_pool
libzfs.ZFSException: I/O error
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/middlewared/job.py", line 367, in run
    await self.future
  File "/usr/local/lib/python3.9/site-packages/middlewared/job.py", line 403, in __run_body
    rv = await self.method(*([self] + args))
  File "/usr/local/lib/python3.9/site-packages/middlewared/schema.py", line 975, in nf
    return await f(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/pool.py", line 1421, in import_pool
    await self.middleware.call('zfs.pool.import_pool', pool['guid'], {
  File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1256, in call
    return await self._call(
  File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1221, in _call
    return await self._call_worker(name, *prepared_call.args)
  File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1227, in _call_worker
    return await self.run_in_proc(main_worker, name, args, job)
  File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1154, in run_in_proc
    return await self.run_in_executor(self.__procpool, method, *args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1128, in run_in_executor
    return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
libzfs.ZFSException: ('I/O error',)

spotthemaniac · Dec 2, 2021

hi smokeypeet,
cant help but I have a very similar problem
one of my pools is showing as offline no data same as yours.
We had a power cut on tuesday, cant tell when the pool went offline.
my dashboard is showing Offline uknown
truenas version TrueNAS-12.0-U5.1
If i do a zpool import i get no such pool available even though it is shown in the pool window
The disk is there with N/A in the pool column and i can run smart test fine
it seems to have lost the link between the pool and the disk?
I will run all the same commands you have done and see if i have any differences worth looking into
interestingly the disk allocation numbers have changed.
I have three pools
one had ada1/ada2 , second had ada3/ada4 last which is a temp storage pool was ada5 (i think) - temp pool is the offline one
after ada2 failed and i replaced the disk - which is now re-silvering and all the numbers have changed
If i figure anything out i will let you know

sretalla · Dec 2, 2021

spotthemaniac said:
If i do a zpool import i get no such pool available even though it is shown in the pool window

You can't import a pool that's already imported (which is implied by it appearing in the "pool window", by which I assume you mean the Storage | Pools list in the GUI).

You should check the pool status if it's available from the GUI to see which disks are offline or unavailable.

spotthemaniac · Dec 2, 2021

Hi sretalla,

the pool i added was a temp one just for transfer so only had one physical disk.
the disk responds to smart request as okay
but is not associated with the pool
the pool is unavailable
i am going to try the zfs mount onto my ubunto system for the temp disk
oddly i could not create a new pool with the old disk so somehow it knew the disk was in use.
when i remove the temp pool the disk became available again to add to a new pool

not so fussed about the contents as it was a temp store for downloads so nothing really lost but more curious as to why it failed.
all my other pools have at least 2 disks.

sretalla · Dec 2, 2021

spotthemaniac said:
curious as to why it failed

I think based on what you described having done, the possibility for that is long gone.

I can guess that the fact it was a single disk pool means some writes to pool metadata were in progress when the power went out, but there's no way now of confirming anything about it.

danb35 · Dec 2, 2021

@smokeypeet, from the shell on your machine, what's the output of zpool import ?

Important Announcement for the TrueNAS Community.

Pool disappeared after power failure. Import throws error

smokeypeet

Cadet

smokeypeet

Cadet

spotthemaniac

Cadet

sretalla

Powered by Neutrality

spotthemaniac

Cadet

sretalla

Powered by Neutrality

danb35

Hall of Famer

Similar threads