Issues after losing a device from my boot pool

Shiunbird

Cadet
Joined
Feb 2, 2019
Messages
9
Hello everyone,
I've looked around, but I am wondering what is the correct procedure to recover access to my data.

I have a very stable system, having seen major upgrades and never losing any data. I also have cloud sync tasks sending my data to S3, so I am not too worried (besides downtime). I also have a backup of the keyfile and of my configuration, both done after my last configuration change.

I run FreeNAS 11.3-U4.1 and I boot from 2 USB devices (spinning disks). A month ago the system lost access to one of them so I planned today to restore my boot volume and upgrade.

My last change to my setup was adding a SSD cache to my 4 disk array. After that I was issued a new geli.key that I tested more than once (the system has been rebooted 3 times since I added the SSD cache, and I always could unlock my pool).

Today when I was trying to restore my system, I noticed that reconnecting the USB ports made the system not boot but then I could boot with one of the USB drives connected instead of both. After the reboot, whenever I try to unlock my pool, I get a message saying that 2 devices can't be decrypted.

If I try to use the key I had before adding the SSD cache, I get a message saying that 3 devices failed to decrypt.

My questions are:
1. What would be the recommended protocol to try to retrieve the data? I'm not very familiar to trying to unlock the devices from the console.
2. My 2 USB boot devices are up, but I still see that the boot pool is degraded. How can I find the culprit?

And the biggest question:
1. If it comes that I will must need to restore from backup, should I give up on using my SSD cache and use it as a boot volume instead?
(I'm on a MicroServer Gen8)

I've always had minor issues with USB boot volumes, so I guess this was bond to happen eventually. =)

Thank you! And happy holidays!

PS: I tried the keyfile included with a full backup that I took only a couple of weeks ago (after that, no system changes), and when I try to unlock from that I also get a message saying that 2 devices can't be decrypted. Can I somehow try to use a key for some disks and a different key from others?
 

Shiunbird

Cadet
Joined
Feb 2, 2019
Messages
9
All right - after some digging, I found out that ada0p2 and ada2p2 unlock with my old key and 1, 3 and 4 use the new key.

Any idea on how I could import a pool when the members have different keys?
 
Top