Pool degraded, cannot replace device

[joe776]

I tried to remove encryption from a pool by using this guide: https://forums.freenas.org/index.ph...om-a-zfs-volume-while-keeping-the-data.16467/
(Basically taking the device offline, detach from GELI, replace, resilver, repeat)

I did this for the first drive and everything looked fine. All devices and the pool were online after the resilvering. However, after a reboot the resilvered disk without encryption is marked as unavailable and the pool is degraded.

freenas# zpool status

datengrab DEGRADED

raidz2-0 DEGRADED

8636046042145075812 UNAVAIL was /dev/gptid/d7f1c09c-da08-11e3-87a0-38eaa7a49a3c
gptid/d8c98d9d-da08-11e3-87a0-38eaa7a49a3c.eli ONLINE
gptid/d9991265-da08-11e3-87a0-38eaa7a49a3c.eli ONLINE
gptid/da733091-da08-11e3-87a0-38eaa7a49a3c.eli ONLINE
gptid/db4bf754-da08-11e3-87a0-38eaa7a49a3c.eli ONLINE
gptid/ee3135f2-da08-11e3-87a0-38eaa7a49a3c.eli ONLINE​

Does anybody have an idea how to get the disk online again?

Things tried so far:

• freenas# zpool replace datengrab 8636046042145075812 gptid/d7f1c09c-da08-11e3-87a0-38eaa7a49a3c
  invalid vdev specification
  /dev/gptid/d7f1c09c-da08-11e3-87a0-38eaa7a49a3c is part of active pool 'datengrab'
  
  So this did not work...
  
  
• freenas# zpool export datengrab
  freenas# zpool import datengrab
  
  This did not change anything

I'm thankful for any help or pointers on how to get the device online.

Cheers

 

[Robert Trevellyan]

The directions you referenced don't mention rebooting until encryption has been removed from all disks. Maybe you need to start over.

 

[joe776]

Thanks, I'll try that in the evening. However, I fear that the zpool replace still will be the problem, as the disk is already decrypted and resilvered and that would be the next step.

 

[joe776]

The reboot really seemed to screw something up. Starting up did not work either. I wiped the disk and the pool is resilvering now (with encryption).

 

[Robert Trevellyan]

I bet you're happy you went with RAIDZ2!

Can you devise a solution that allows you to copy the data elsewhere and then destroy and recreate the pool? For example, an external mirror of large hard drives in a drive dock connected via eSATA? That's what I've used a couple of times when I wanted to reconfigure my storage.

 

[hugovsky]

FYI, I've used that guide and ended successfully. It was just sample data, but it worked as advertised.