New disc failure while applying new encryp keys to pool

[ender.v]

I was following this document: http://doc.freenas.org/index.php/Volumes#Replacing_a_Failed_Drive_in_an_Encrypted_Pool

I am replacing a 1tb drive with a 3tb drive, ada0. The pool contains 3 zfs raid 1 equivalents.
I replaced the drive last night and allowed silvering to occur over night. Checked this morning and no errors reported. I turned my plugins back on (I turned them off during the silvering to reduce load, not sure if necessary but why not.)

I turn on my plugins and begin the process of restoring the encryption keys to the pool.

I get through the first 3 steps of "restoring the encryption keys to the pool" okay but step 4 is a problem. It says ada0 is unreadable, I look in the logs and it see this:

Code:

Jul 21 07:04:50 freenas kernel: (ada0:ahcich2:0:0:0): lost device
Jul 21 07:04:50 freenas kernel: GEOM_ELI: g_eli_read_done() failed gptid/80f3426e-107f-11e4-8b6a-c86000c0c010.eli[READ(offset=91352485888, length=4096)]
Jul 21 07:04:50 freenas kernel: GEOM_ELI: g_eli_read_done() failed gptid/80f3426e-107f-11e4-8b6a-c86000c0c010.eli[READ(offset=833232797696, length=4096)]
Jul 21 07:04:50 freenas kernel: GEOM_ELI: g_eli_read_done() failed gptid/80f3426e-107f-11e4-8b6a-c86000c0c010.eli[READ(offset=833249378304, length=8192)]
Jul 21 07:04:50 freenas kernel: GEOM_ELI: g_eli_read_done() failed gptid/80f3426e-107f-11e4-8b6a-c86000c0c010.eli[READ(offset=833250643968, length=8192)]
Jul 21 07:04:50 freenas kernel: GEOM_ELI: Device gptid/80f3426e-107f-11e4-8b6a-c86000c0c010.eli destroyed.
Jul 21 07:04:50 freenas kernel: GEOM_ELI: Detached gptid/80f3426e-107f-11e4-8b6a-c86000c0c010.eli on last close.
Jul 21 07:04:52 freenas avahi-daemon[3299]: server.c: Packet too short or invalid while reading known answer record. (Maybe a UTF-8 problem?) !!!!!comment (this happens all the time, havent gotten to research why yet ~ ender.v !!!!!!
Jul 21 07:04:56 freenas last message repeated 2 times
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): CAM status: ATA Status Error
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): ATA status: d1 (BSY DRDY SERV ERR), error: 04 (ABRT )
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): RES: d1 04 ff ff ff ff ff ff ff ff ff
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): Error 5, Retries exhausted
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): NOP. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): CAM status: ATA Status Error
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): ATA status: d1 (BSY DRDY SERV ERR), error: 04 (ABRT )
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): RES: d1 04 ff ff ff ff ff ff ff ff ff
Jul 21 07:04:56 freenas kernel: (aprobe0:ahcich2:0:0:0): Error 5, Retries exhausted

So it looks like drive failed about 10minutes before I started the rekeying process and I didnt notice.
But now I have started and cannot finish because it errors out on the missing drive.

Can I shutdown the drive and replace ada0 with another 3tb hdd? I ask this because in the volumes document: If the following additional steps are not performed before the next reboot, you may lose access to the pool permanently.

/scary

P.S. This is my first post, if I broke any forum rules please let me know and I fix them. Also if I am in the wrong spot please point me in the right direction. Also I did do forum and google searches and wasnt successful in finding anything, if your googlefu is better than mine please link to me other threads and I will do my homework there. And I am a novice at freebsd/freenas, slightly better at linux. My specialty lies in the network side of things.

Thank you for your time reading.

 

[dlavigne]

Did you figure this out?

 

[ender.v]

No, because of this strange predicament I started copying my files out to standard hdds. Literally within 4 hours of completing the ~4TB of data transfer I had a power outage that was longer than my UPS could last. I just assumed I wouldnt be able to unlock the pool, so I just rebuilt from scratch and copied the data back over.