Unable to import encrypted pool via GUI, but able to via CLI

Status
Not open for further replies.

Phobos

Dabbler
Joined
Sep 8, 2014
Messages
25
Background info: I’m attempting to verify my backups before moving to FreeNAS 11. My current backup strategy is to do a local replication to an encrypted backup pool, which I’ll then take offsite for safe keeping. Eventually I’ll have two sets of backup disks for rotating backups.

System specs: X10SLH-F; Xeon E3-1231v3; 32 GB Samsung ECC RAM; Seasonic PSU; FreeNAS-9.10.2-U6 (561f0d7a1)

Disk layout:
a) da8, da9: Boot pool on 2x16GB SanDisk Cruzer Fit
b) da2 – da7: tank-main - Encrypted RAIDZ2 on 6x4TB WD Red attached to LSI 9300-8i
c) ada0 – ada2: tank-backup - Encrypted RAIDZ1 on 3x6TB WD Red attached to motherboard (and mounted in a SilverStone hot-swap bay)
d) da0, da1: Unused 2x120GB SanDisk SSD Plus attached to LSI 9300-8i (will use these for FreeNAS 11 boot pool)

What I did:
1) Downloaded geli key for tank-backup
2) Detached tank-backup using the GUI (and did *not* mark the disks as new)
3) Physically removed the drives from the hotswap bay
4) Rebooted
5) Physically inserted the drives into the hotswap bay (in the same order)
6) Attempted to import the volume

Problem:
Only two disks are listed for decryption during the import phase: ada0p2 and ada1p2. However, I can manually import the volume like so:

Code:
# geli attach -j- -k tank-backup.key /dev/ada0p2
<password>
# geli attach -j- -k tank-backup.key /dev/ada1p2
<password>
# geli attach -j- -k tank-backup.key /dev/ada2p2
<password>
# zpool status
  pool: freenas-boot
 state: ONLINE
  scan: scrub repaired 0 in 0h0m with 0 errors on Sun Nov 19 03:45:35 2017
config:

	NAME		STATE	 READ WRITE CKSUM
	freenas-boot  ONLINE	   0	 0	 0
	  mirror-0  ONLINE	   0	 0	 0
		da1p2   ONLINE	   0	 0	 0
		da0p2   ONLINE	   0	 0	 0

errors: No known data errors

  pool: tank-main
 state: ONLINE
  scan: scrub repaired 0 in 8h13m with 0 errors on Wed Nov 15 12:13:44 2017
config:

	NAME												STATE	 READ WRITE CKSUM
	tank-main										   ONLINE	   0	 0	 0
	  raidz2-0										  ONLINE	   0	 0	 0
		gptid/aaaaaaaa-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli  ONLINE	   0	 0	 0
		gptid/bbbbbbbb-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli  ONLINE	   0	 0	 0
		gptid/cccccccc-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli  ONLINE	   0	 0	 0
		gptid/dddddddd-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli  ONLINE	   0	 0	 0
		gptid/eeeeeeee-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli  ONLINE	   0	 0	 0
		gptid/ffffffff-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli  ONLINE	   0	 0	 0

errors: No known data errors

  pool: tank-backup
 state: ONLINE
  scan: resilvered 12K in 0h0m with 0 errors on Tue Nov 28 20:11:10 2017
config:

	NAME			STATE	 READ WRITE CKSUM
	tank-backup	 ONLINE	   0	 0	 0
	  raidz1-0	  ONLINE	   0	 0	 0
		ada0p2.eli  ONLINE	   0	 0	 0
		ada1p2.eli  ONLINE	   0	 0	 0
		ada2p2.eli  ONLINE	   0	 0	 0
errors: No known data errors
# zpool list

NAME		   SIZE  ALLOC   FREE  EXPANDSZ   FRAG	CAP  DEDUP  HEALTH  ALTROOT

freenas-boot  14.5G  5.04G  9.46G	 97.1G	  -	34%  1.00x  ONLINE  -

tank-main	 21.8T  9.13T  12.6T		 -	11%	41%  1.00x  ONLINE  /mnt

tank-backup   16.2T  9.11T  7.14T		 -	33%	56%  1.00x  ONLINE  -


Not sure how to mount tank-backup at this point, but it seems like the pool is intact? However, I *still* cannot see the volume in the GUI.

And I can see the following entries added to geli list:

Code:
Geom name: ada0p2.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
UsedKey: 0
Flags: NONE
KeysAllocated: 1397
KeysTotal: 1397
Providers:
1. Name: ada0p2.eli
   Mediasize: 5999027552256 (5.5T)
   Sectorsize: 4096
   Mode: r1w1e1
Consumers:
1. Name: ada0p2
   Mediasize: 5999027556352 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: ada1p2.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
UsedKey: 0
Flags: NONE
KeysAllocated: 1397
KeysTotal: 1397
Providers:
1. Name: ada1p2.eli
   Mediasize: 5999027552256 (5.5T)
   Sectorsize: 4096
   Mode: r1w1e1
Consumers:
1. Name: ada1p2
   Mediasize: 5999027556352 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: ada2p2.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
UsedKey: 0
Flags: NONE
KeysAllocated: 1397
KeysTotal: 1397
Providers:
1. Name: ada2p2.eli
   Mediasize: 5999027552256 (5.5T)
   Sectorsize: 4096
   Mode: r1w1e1
Consumers:
1. Name: ada2p2
   Mediasize: 5999027556352 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1


Also of note, I see the following in the console when attempting to import the backup pool via the GUI, after the main pool has been unlocked (where each guid corresponds to 1 of the 4TB drives used in the main pool):

Code:
MiddlewareError: Failed to geli detach gptid/aaaaaaaa-xxxx-xxxx-xxxx-xxxxxxxxxxxx: geli: Cannot destroy device gptid/aaaaaaaa-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli (error=16).
MiddlewareError: Failed to geli detach gptid/bbbbbbbb-xxxx-xxxx-xxxx-xxxxxxxxxxxx: geli: Cannot destroy device gptid/bbbbbbbb-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli (error=16).
MiddlewareError: Failed to geli detach gptid/cccccccc-xxxx-xxxx-xxxx-xxxxxxxxxxxx: geli: Cannot destroy device gptid/cccccccc-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli (error=16).
MiddlewareError: Failed to geli detach gptid/dddddddd-xxxx-xxxx-xxxx-xxxxxxxxxxxx: geli: Cannot destroy device gptid/dddddddd-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli (error=16).
MiddlewareError: Failed to geli detach gptid/eeeeeeee-xxxx-xxxx-xxxx-xxxxxxxxxxxx: geli: Cannot destroy device gptid/eeeeeeee-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli (error=16).
MiddlewareError: Failed to geli detach gptid/ffffffff-xxxx-xxxx-xxxx-xxxxxxxxxxxx: geli: Cannot destroy device gptid/ffffffff-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli (error=16).


Finally, here’s a whole lot of debug output:

Code:
# camcontrol devlist
<ATA SanDisk SDSSDA12 80RL>		at scbus0 target 0 lun 0 (pass0,da0)
<ATA SanDisk SDSSDA12 80RL>		at scbus0 target 1 lun 0 (pass1,da1)
<ATA WDC WD40EFRX-68W 0A80>		at scbus0 target 2 lun 0 (pass2,da2)
<ATA WDC WD40EFRX-68W 0A82>		at scbus0 target 3 lun 0 (pass3,da3)
<ATA WDC WD40EFRX-68N 0A82>		at scbus0 target 4 lun 0 (pass4,da4)
<ATA WDC WD40EFRX-68W 0A80>		at scbus0 target 5 lun 0 (pass5,da5)
<ATA WDC WD40EFRX-68W 0A80>		at scbus0 target 6 lun 0 (pass6,da6)
<ATA WDC WD40EFRX-68W 0A80>		at scbus0 target 7 lun 0 (pass7,da7)
<WDC WD60EFRX-68L0BN1 82.00A82>	at scbus1 target 0 lun 0 (pass8,ada0)
<WDC WD60EFRX-68L0BN1 82.00A82>	at scbus2 target 0 lun 0 (pass9,ada1)
<WDC WD60EFRX-68L0BN1 82.00A82>	at scbus3 target 0 lun 0 (pass10,ada2)
<SanDisk Cruzer Fit 1.27>		  at scbus8 target 0 lun 0 (pass11,da8)
<SanDisk Cruzer Fit 1.27>		  at scbus9 target 0 lun 0 (pass12,da9)


Code:
# geom disk list
Geom name: ada0
Providers:
1. Name: ada0
   Mediasize: 6001175126016 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   descr: WDC WD60EFRX-68L0BN1
   lunid: xxxxxxxxxxxxxxxx
   ident: WD-WXXXXXXXXXXX
   rotationrate: 5700
   fwsectors: 63
   fwheads: 16

Geom name: ada1
Providers:
1. Name: ada1
   Mediasize: 6001175126016 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   descr: WDC WD60EFRX-68L0BN1
   lunid: xxxxxxxxxxxxxxxx
   ident: WD-WXXXXXXXXXXX
   rotationrate: 5700
   fwsectors: 63
   fwheads: 16

Geom name: ada2
Providers:
1. Name: ada2
   Mediasize: 6001175126016 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   descr: WDC WD60EFRX-68L0BN1
   lunid: xxxxxxxxxxxxxxxx
   ident: WD-WXXXXXXXXXXX
   rotationrate: 5700
   fwsectors: 63
   fwheads: 16

Geom name: da0
Providers:
1. Name: da0
   Mediasize: 120034123776 (112G)
   Sectorsize: 512
   Mode: r1w1e2
   descr: ATA SanDisk SDSSDA12
   lunid: xxxxxxxxxxxxxxxx
   ident: XXXXXXXXXXXX
   rotationrate: 0
   fwsectors: 63
   fwheads: 255

Geom name: da1
Providers:
1. Name: da1
   Mediasize: 120034123776 (112G)
   Sectorsize: 512
   Mode: r1w1e2
   descr: ATA SanDisk SDSSDA12
   lunid: xxxxxxxxxxxxxxxx
   ident: XXXXXXXXXXXX
   rotationrate: 0
   fwsectors: 63
   fwheads: 255

Geom name: da2
Providers:
1. Name: da2
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5
   descr: ATA WDC WD40EFRX-68W
   lunid: xxxxxxxxxxxxxxxx
   ident: WD-WXXXXXXXXXXX
   rotationrate: 5400
   fwsectors: 63
   fwheads: 255

Geom name: da3
Providers:
1. Name: da3
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5
   descr: ATA WDC WD40EFRX-68W
   lunid: xxxxxxxxxxxxxxxx
   ident: WD-WXXXXXXXXXXX
   rotationrate: 5400
   fwsectors: 63
   fwheads: 255

Geom name: da4
Providers:
1. Name: da4
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5
   descr: ATA WDC WD40EFRX-68N
   lunid: xxxxxxxxxxxxxxxx
   ident: WD-WXXXXXXXXXXX
   rotationrate: 5400
   fwsectors: 63
   fwheads: 255

Geom name: da5
Providers:
1. Name: da5
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5
   descr: ATA WDC WD40EFRX-68W
   lunid: xxxxxxxxxxxxxxxx
   ident: WD-WXXXXXXXXXXX
   rotationrate: 5400
   fwsectors: 63
   fwheads: 255

Geom name: da6
Providers:
1. Name: da6
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5
   descr: ATA WDC WD40EFRX-68W
   lunid: xxxxxxxxxxxxxxxx
   ident: WD-WXXXXXXXXXXX
   rotationrate: 5400
   fwsectors: 63
   fwheads: 255

Geom name: da7
Providers:
1. Name: da7
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5
   descr: ATA WDC WD40EFRX-68W
   lunid: xxxxxxxxxxxxxxxx
   ident: WD-WXXXXXXXXXXX
   rotationrate: 5400
   fwsectors: 63
   fwheads: 255

Geom name: da8
Providers:
1. Name: da8
   Mediasize: 15631122432 (15G)
   Sectorsize: 512
   Mode: r0w0e0
   descr: SanDisk Cruzer Fit
   lunname: SanDisk Cruzer Fit	  XXXXXXXXXXXXXXXXXXXX
   lunid: SanDisk Cruzer Fit	  XXXXXXXXXXXXXXXXXXXX
   ident: XXXXXXXXXXXXXXXXXXXX
   rotationrate: unknown
   fwsectors: 63
   fwheads: 255

Geom name: da9
Providers:
1. Name: da9
   Mediasize: 15631122432 (15G)
   Sectorsize: 512
   Mode: r0w0e0
   descr: SanDisk Cruzer Fit
   lunname: SanDisk Cruzer Fit	  XXXXXXXXXXXXXXXXXXXX
   lunid: SanDisk Cruzer Fit	  XXXXXXXXXXXXXXXXXXXX
   ident: XXXXXXXXXXXXXXXXXXXX
   rotationrate: unknown
   fwsectors: 63
   fwheads: 255


Code:
# gpart list
Geom name: ada0
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 11721045134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada0p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada0p2
   Mediasize: 5999027556352 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 5999027556352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 11721045127
   start: 4194432
Consumers:
1. Name: ada0
   Mediasize: 6001175126016 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0

Geom name: ada1
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 11721045134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada1p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada1p2
   Mediasize: 5999027556352 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 5999027556352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 11721045127
   start: 4194432
Consumers:
1. Name: ada1
   Mediasize: 6001175126016 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0

Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 11721045134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada2p2
   Mediasize: 5999027556352 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 5999027556352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 11721045127
   start: 4194432
Consumers:
1. Name: ada2
   Mediasize: 6001175126016 (5.5T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0

Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 234441614
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da0p1
   Mediasize: 524288 (512K)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 21686148-6449-6e6f-744e-656564454649
   label: (null)
   length: 524288
   offset: 17408
   type: bios-boot
   index: 1
   end: 1057
   start: 34
2. Name: da0p2
   Mediasize: 120033558528 (112G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 544768
   Mode: r1w1e1
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 120033558528
   offset: 544768
   type: freebsd-zfs
   index: 2
   end: 234441607
   start: 1064
Consumers:
1. Name: da0
   Mediasize: 120034123776 (112G)
   Sectorsize: 512
   Mode: r1w1e2

Geom name: da1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 234441614
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da1p1
   Mediasize: 524288 (512K)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 21686148-6449-6e6f-744e-656564454649
   label: (null)
   length: 524288
   offset: 17408
   type: bios-boot
   index: 1
   end: 1057
   start: 34
2. Name: da1p2
   Mediasize: 120033558528 (112G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 544768
   Mode: r1w1e1
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 120033558528
   offset: 544768
   type: freebsd-zfs
   index: 2
   end: 234441607
   start: 1064
Consumers:
1. Name: da1
   Mediasize: 120034123776 (112G)
   Sectorsize: 512
   Mode: r1w1e2

Geom name: da2
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da2p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da2
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da3
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da3p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da3p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da3
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da4
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da4p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da4p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da4
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da5
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da5p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da5p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da5
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da6
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da6p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da6p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da6
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da7
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da7p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da7p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da7
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da8
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 30529502
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da8p1
   Mediasize: 524288 (512K)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 21686148-6449-6e6f-744e-656564454649
   label: (null)
   length: 524288
   offset: 17408
   type: bios-boot
   index: 1
   end: 1057
   start: 34
2. Name: da8p2
   Mediasize: 15630557184 (15G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 544768
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 15630557184
   offset: 544768
   type: freebsd-zfs
   index: 2
   end: 30529495
   start: 1064
Consumers:
1. Name: da8
   Mediasize: 15631122432 (15G)
   Sectorsize: 512
   Mode: r0w0e0

Geom name: da9
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 30529502
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da9p1
   Mediasize: 524288 (512K)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 21686148-6449-6e6f-744e-656564454649
   label: (null)
   length: 524288
   offset: 17408
   type: bios-boot
   index: 1
   end: 1057
   start: 34
2. Name: da9p2
   Mediasize: 15630557184 (15G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 544768
   Mode: r0w0e0
   rawuuid: xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 15630557184
   offset: 544768
   type: freebsd-zfs
   index: 2
   end: 30529495
   start: 1064
Consumers:
1. Name: da9
   Mediasize: 15631122432 (15G)
   Sectorsize: 512
   Mode: r0w0e0


Code:
# geli list
Geom name: da3p1.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
Flags: ONETIME, W-DETACH, W-OPEN
KeysAllocated: 1
KeysTotal: 1
Providers:
1. Name: da3p1.eli
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 4096
   Mode: r1w1e0
Consumers:
1. Name: da3p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: da2p1.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
Flags: ONETIME, W-DETACH, W-OPEN
KeysAllocated: 1
KeysTotal: 1
Providers:
1. Name: da2p1.eli
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 4096
   Mode: r1w1e0
Consumers:
1. Name: da2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: da5p1.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
Flags: ONETIME, W-DETACH, W-OPEN
KeysAllocated: 1
KeysTotal: 1
Providers:
1. Name: da5p1.eli
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 4096
   Mode: r1w1e0
Consumers:
1. Name: da5p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: da4p1.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
Flags: ONETIME, W-DETACH, W-OPEN
KeysAllocated: 1
KeysTotal: 1
Providers:
1. Name: da4p1.eli
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 4096
   Mode: r1w1e0
Consumers:
1. Name: da4p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: da7p1.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
Flags: ONETIME, W-DETACH, W-OPEN
KeysAllocated: 1
KeysTotal: 1
Providers:
1. Name: da7p1.eli
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 4096
   Mode: r1w1e0
Consumers:
1. Name: da7p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: da6p1.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
Flags: ONETIME, W-DETACH, W-OPEN
KeysAllocated: 1
KeysTotal: 1
Providers:
1. Name: da6p1.eli
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 4096
   Mode: r1w1e0
Consumers:
1. Name: da6p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: gptid/aaaaaaaa-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 6
UsedKey: 0
Flags: (null)
KeysAllocated: 932
KeysTotal: 932
Providers:
1. Name: gptid/aaaaaaaa-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
   Mediasize: 3998639456256 (3.6T)
   Sectorsize: 4096
   Mode: r1w1e1
Consumers:
1. Name: gptid/aaaaaaaa-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: gptid/bbbbbbbb-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 6
UsedKey: 0
Flags: (null)
KeysAllocated: 932
KeysTotal: 932
Providers:
1. Name: gptid/bbbbbbbb-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
   Mediasize: 3998639456256 (3.6T)
   Sectorsize: 4096
   Mode: r1w1e1
Consumers:
1. Name: gptid/bbbbbbbb-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: gptid/cccccccc-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 6
UsedKey: 0
Flags: (null)
KeysAllocated: 932
KeysTotal: 932
Providers:
1. Name: gptid/cccccccc-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
   Mediasize: 3998639456256 (3.6T)
   Sectorsize: 4096
   Mode: r1w1e1
Consumers:
1. Name: gptid/cccccccc-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: gptid/dddddddd-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 7
UsedKey: 0
Flags: NONE
KeysAllocated: 932
KeysTotal: 932
Providers:
1. Name: gptid/dddddddd-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
   Mediasize: 3998639456256 (3.6T)
   Sectorsize: 4096
   Mode: r1w1e1
Consumers:
1. Name: gptid/dddddddd-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: gptid/eeeeeeee-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 6
UsedKey: 0
Flags: (null)
KeysAllocated: 932
KeysTotal: 932
Providers:
1. Name: gptid/eeeeeeee-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
   Mediasize: 3998639456256 (3.6T)
   Sectorsize: 4096
   Mode: r1w1e1
Consumers:
1. Name: gptid/eeeeeeee-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1

Geom name: gptid/ffffffff-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
State: ACTIVE
EncryptionAlgorithm: AES-XTS
KeyLength: 128
Crypto: hardware
Version: 6
UsedKey: 0
Flags: (null)
KeysAllocated: 932
KeysTotal: 932
Providers:
1. Name: gptid/ffffffff-xxxx-xxxx-xxxx-xxxxxxxxxxxx.eli
   Mediasize: 3998639456256 (3.6T)
   Sectorsize: 4096
   Mode: r1w1e1
Consumers:
1. Name: gptid/ffffffff-xxxx-xxxx-xxxx-xxxxxxxxxxxx
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
 
Last edited:
D

dlavigne

Guest
What is your current build version (System -> Information)? You may want to wait until 11.1-RELEASE (ETA next Monday) as it fixed a bug importing encrypted pools.
 

Phobos

Dabbler
Joined
Sep 8, 2014
Messages
25
What is your current build version (System -> Information)? You may want to wait until 11.1-RELEASE (ETA next Monday) as it fixed a bug importing encrypted pools.

9.10.2-U6 (561f0d7a1)

This Monday, the 4th? Or the 11th?
 

Phobos

Dabbler
Joined
Sep 8, 2014
Messages
25
Looks like RC3 (which has the fix) will be the 4th with RELEASE on the 11th.

Thanks, I’ll try to sit tight until then. I’ll try importing the backup pool on a fresh install of 11.1, and go from there.

On a side note, the drives in question passed badblocks and seem to have nominal SMART reports.
 

Phobos

Dabbler
Joined
Sep 8, 2014
Messages
25
Interesting development: switched ada0 and ada2’s positions in my hot swap bay, verified that the disk serials for ada0 and ada2 were swapped, but the import GUI still only presents ada0 and ada1 (if the disk was at fault, I would’ve expected this to switch to ada1 and ada2).
 
Status
Not open for further replies.
Top