Problem after replacing Disk

Status
Not open for further replies.
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
Hi together,

I'm new to Freenas and have running a small Server for some time now.

My Setup is one pool with multiple mirrors and it is encrypted. My setup got degrated, because one disk failed. I replaced it via the web-interface and it is resilvering now. I directly tried to create a new recovery key, to ensure i can re-import my pool. But when I try to create the key I get the error:

Code:
Error: Unable to set recovery key: geli: Cannot read metadata from gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23: Device not configured.


This gptid should be the removed drive (not totaly sure, but it is NOT part of the actual pool). How can i get it working again?

Edit:
FreeNAS Version: 9.2.0-RELEASE-x64
General System Info: FreeNAS is running as VM on a ESXi 5.1.0 Server using two LSI Raid controllers in pathrough, the vm has access to 3 Cores of an Intel Core I5 2400, and 16GB of RAM

Edit2 (some more system info):

actual status of my pool:
Code:
[root@freenas] ~# zpool status -v pool_1
  pool: pool_1
state: ONLINE
  scan: resilvered 36.9G in 0h32m with 0 errors on Tue Jan 21 20:00:57 2014
config:
 
        NAME                                                STATE    READ WRITE CKSUM
        pool_1                                              ONLINE      0    0    0
          mirror-0                                          ONLINE      0    0    0
            gptid/c6b6694b-7a35-11e3-b437-000c29dc8e23.eli  ONLINE      0    0    0
            gptid/caa83c1f-7a35-11e3-b437-000c29dc8e23.eli  ONLINE      0    0    0
          mirror-1                                          ONLINE      0    0    0
            gptid/1222f085-7a36-11e3-b437-000c29dc8e23.eli  ONLINE      0    0    0
            gptid/15ff24e7-7a36-11e3-b437-000c29dc8e23.eli  ONLINE      0    0    0
          mirror-2                                          ONLINE      0    0    0
            gptid/89b23f80-8215-11e3-9e30-000c29dc8e23.eli  ONLINE      0    0    0
            gptid/ca95bd9a-82c9-11e3-9e30-000c29dc8e23.eli  ONLINE      0    0    0
 
errors: No known data errors


The disk that failed was in mirror-2
 
C

cyberjock

Inactive Account
Joined
Mar 25, 2012
Messages
19,526
Can you post all that info that the forum rules ask for when asking a question?
 
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
I'm so sorry about that, I've edited my opening post!
 
C

cyberjock

Inactive Account
Joined
Mar 25, 2012
Messages
19,526
Yeah, I'd have to help you one-on-one as I don't know what is going wrong.
 
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
Did I understand you correct, that you need to help me "face to face"? Are you willing to help me?
 
C

cyberjock

Inactive Account
Joined
Mar 25, 2012
Messages
19,526
I offer consultation services on request. PM me if you want to go this route.
 
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
I atm can't afford cyberjock's consultation service for my hobby project, so my problem is still there. Hopefully one of you can help me solving it?
 
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
I checked dmesg and found a lot of more errors there, mybe that will help solving the problem:
Code:
GEOM_ELI: Crypto WRITE request failed (error=6). gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[WRITE(offset=139264, length=4096)]
GEOM_ELI: Crypto WRITE request failed (error=6). gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[WRITE(offset=401408, length=4096)]
GEOM_ELI: Crypto WRITE request failed (error=6). gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[WRITE(offset=1998250975232, length=4096)]
GEOM_ELI: Crypto WRITE request failed (error=6). gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[WRITE(offset=1998251237376, length=4096)]
GEOM_ELI: Crypto WRITE request failed (error=6). gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[WRITE(offset=70571589632, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250835968, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251098112, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251352064, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251102208, length=16384)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251352064, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=4096, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=65536, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=8192, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=65536, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=8192, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=32768, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=8192, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=65536, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=2146959360, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=2147221504, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250835968, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251098112, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: Device da5p1.eli destroyed.
GEOM_ELI: Detached da5p1.eli on last close.
GEOM_ELI: Device da6p1.eli destroyed.
GEOM_ELI: Detached da6p1.eli on last close.
GEOM_ELI: Device gptid/dfc22327-7f01-11e3-a325-000c29dc8e23.eli destroyed.
GEOM_ELI: Device gptid/e2012bd6-7f01-11e3-a325-000c29dc8e23.eli destroyed.
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: Device gptid/89813dfc-82be-11e3-9e30-000c29dc8e23.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:    Crypto: hardware
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=2146959360, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=2147221504, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250835968, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251098112, length=131072)]
GEOM_ELI: Device da6p1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:    Crypto: hardware
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: Device da6p1.eli destroyed.
GEOM_ELI: Device gptid/89813dfc-82be-11e3-9e30-000c29dc8e23.eli destroyed.
GEOM_ELI: Device gptid/ca95bd9a-82c9-11e3-9e30-000c29dc8e23.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:    Crypto: hardware
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=2146959360, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=2147221504, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250835968, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251098112, length=131072)]
GEOM_ELI: Device da6p1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:    Crypto: hardware


The device da8p1 should be the failed drive that i have replaced! It seems like there are parts of the drive left in the system and freenas tries to change the key on the gone drive as well as on the actual used drives...

EDTI:
I found out, that the corresponding .eli in /dev/gptid of the gone drive is still there. I tried to reattach the "drive" with the gptid to the mirror to check if this could solve the problem but i just got the following error:

Code:
[root@freenas] ~# zpool attach pool_1 /dev/gptid/89b23f80-8215-11e3-9e30-000c29dc8e23.eli  /dev/gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli
cannot attach /dev/gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli to /dev/gptid/89b23f80-8215-11e3-9e30-000c29dc8e23.eli: one or more devices is currently unavailable


This action also created new errors in dmesg:
Code:
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250835968, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251098112, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250835968, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251098112, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=2146959360, length=131072)]
GEOM_ELI: g_eli_read_done() failed da8p1.eli[READ(offset=2147221504, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250835968, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251098112, length=131072)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=270336, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998250844160, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251106304, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251352064, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251102208, length=16384)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251352064, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=4096, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=65536, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=8192, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=65536, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=8192, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=262144, length=8192)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=32768, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=8192, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=65536, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=0, length=4096)]
GEOM_ELI: g_eli_read_done() failed gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli[READ(offset=1998251356160, length=4096)]
 
Dusan

Dusan

Guru
Joined
Jan 29, 2013
Messages
1,165
Could you please provide output of:
geli status
camcontrol devlist
zpool status
sqlite3 /data/freenas-v1.db "select * from storage_encrypteddisk;"
Also, what version of FreeNAS are you running?
 
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
Sure!

Code:
:
[root@freenas] ~# geli status
                                          Name  Status  Components
gptid/c6b6694b-7a35-11e3-b437-000c29dc8e23.eli  ACTIVE  gptid/c6b6694b-7a35-11e3-b437-000c29dc8e23
gptid/caa83c1f-7a35-11e3-b437-000c29dc8e23.eli  ACTIVE  gptid/caa83c1f-7a35-11e3-b437-000c29dc8e23
gptid/1222f085-7a36-11e3-b437-000c29dc8e23.eli  ACTIVE  gptid/1222f085-7a36-11e3-b437-000c29dc8e23
gptid/15ff24e7-7a36-11e3-b437-000c29dc8e23.eli  ACTIVE  gptid/15ff24e7-7a36-11e3-b437-000c29dc8e23
gptid/89b23f80-8215-11e3-9e30-000c29dc8e23.eli  ACTIVE  gptid/89b23f80-8215-11e3-9e30-000c29dc8e23
gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23.eli  ACTIVE  gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23
                                    da1p1.eli  ACTIVE  da1p1
                                    da2p1.eli  ACTIVE  da2p1
                                    da3p1.eli  ACTIVE  da3p1
                                    da4p1.eli  ACTIVE  da4p1
                                    da7p1.eli  ACTIVE  da7p1
                                    da8p1.eli  ACTIVE  da8p1
gptid/ca95bd9a-82c9-11e3-9e30-000c29dc8e23.eli  ACTIVE  gptid/ca95bd9a-82c9-11e3-9e30-000c29dc8e23
                                    da6p1.eli  ACTIVE  da6p1


Code:
[root@freenas] ~# camcontrol devlist
<NECVMWar VMware IDE CDR10 1.00>  at scbus1 target 0 lun 0 (cd0,pass0)
<VMware Virtual disk 1.0>          at scbus2 target 0 lun 0 (da0,pass1)
<ATA Hitachi HDS72404 A3B0>        at scbus3 target 8 lun 0 (da1,pass2)
<ATA HGST HDS724040AL A580>        at scbus3 target 9 lun 0 (da2,pass3)
<ATA HGST HDS724040AL A580>        at scbus3 target 10 lun 0 (da3,pass4)
<ATA HGST HDS724040AL A580>        at scbus3 target 11 lun 0 (da4,pass5)
<ATA SAMSUNG HD204UI 0001>        at scbus3 target 12 lun 0 (da5,pass6)
<ATA SAMSUNG HD204UI 0001>        at scbus3 target 13 lun 0 (da6,pass7)
<ATA SAMSUNG HD204UI 0001>        at scbus3 target 14 lun 0 (da7,pass8)
<ATA SAMSUNG HD204UI 0001>        at scbus3 target 15 lun 0 (da8,pass9)


Code:
[root@freenas] ~# zpool status
  pool: pool_1
state: ONLINE
  scan: resilvered 36.9G in 0h32m with 0 errors on Tue Jan 21 20:00:57 2014
config:
 
        NAME                                                STATE    READ WRITE CKSUM
        pool_1                                              ONLINE      0    0    0
          mirror-0                                          ONLINE      0    0    0
            gptid/c6b6694b-7a35-11e3-b437-000c29dc8e23.eli  ONLINE      0    0    0
            gptid/caa83c1f-7a35-11e3-b437-000c29dc8e23.eli  ONLINE      0    0    0
          mirror-1                                          ONLINE      0    0    0
            gptid/1222f085-7a36-11e3-b437-000c29dc8e23.eli  ONLINE      0    0    0
            gptid/15ff24e7-7a36-11e3-b437-000c29dc8e23.eli  ONLINE      0    0    0
          mirror-2                                          ONLINE      0    0    0
            gptid/89b23f80-8215-11e3-9e30-000c29dc8e23.eli  ONLINE      0    0    0
            gptid/ca95bd9a-82c9-11e3-9e30-000c29dc8e23.eli  ONLINE      0    0    0
 
errors: No known data errors


Code:
[root@freenas] ~# sqlite3 /data/freenas-v1.db "select * from storage_encrypteddisk;"
3|1|gptid/c6b6694b-7a35-11e3-b437-000c29dc8e23|2
3|2|gptid/caa83c1f-7a35-11e3-b437-000c29dc8e23|4
3|3|gptid/1222f085-7a36-11e3-b437-000c29dc8e23|3
3|4|gptid/15ff24e7-7a36-11e3-b437-000c29dc8e23|5
3|7|gptid/89b23f80-8215-11e3-9e30-000c29dc8e23|8
3|8|gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23|9
3|9|gptid/ca95bd9a-82c9-11e3-9e30-000c29dc8e23|7


As mentioned in the starting thread I'm running FreeNAS-9.2.0-RELEASE-x64 (ab098f4)

Thank you for your help!
 
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
Sorry, oversaw that!

Here it is:
Code:
[root@freenas] ~# gpart list
Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 41943039
first: 63
entries: 4
scheme: MBR
Providers:
1. Name: da0s1
   Mediasize: 988291584 (942M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 32256
   Mode: r1w0e1
   attrib: active
   rawtype: 165
   length: 988291584
   offset: 32256
   type: freebsd
   index: 1
   end: 1930319
   start: 63
2. Name: da0s2
   Mediasize: 988291584 (942M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 988356096
   Mode: r0w0e0
   rawtype: 165
   length: 988291584
   offset: 988356096
   type: freebsd
   index: 2
   end: 3860639
   start: 1930383
3. Name: da0s3
   Mediasize: 1548288 (1.5M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 1976647680
   Mode: r0w0e0
   rawtype: 165
   length: 1548288
   offset: 1976647680
   type: freebsd
   index: 3
   end: 3863663
   start: 3860640
4. Name: da0s4
   Mediasize: 21159936 (20M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 1978195968
   Mode: r1w1e2
   rawtype: 165
   length: 21159936
   offset: 1978195968
   type: freebsd
   index: 4
   end: 3904991
   start: 3863664
Consumers:
1. Name: da0
   Mediasize: 21474836480 (20G)
   Sectorsize: 512
   Mode: r2w1e4

Geom name: da0s1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1930256
first: 0
entries: 8
scheme: BSD
Providers:
1. Name: da0s1a
   Mediasize: 988283392 (942M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 40448
   Mode: r1w0e1
   rawtype: 0
   length: 988283392
   offset: 8192
   type: !0
   index: 1
   end: 1930256
   start: 16
Consumers:
1. Name: da0s1
   Mediasize: 988291584 (942M)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 32256
   Mode: r1w0e1

Geom name: da1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da1p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: c4edfd76-7a35-11e3-b437-000c29dc8e23
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da1p2
   Mediasize: 3998639460352 (3.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: c6b6694b-7a35-11e3-b437-000c29dc8e23
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da1
   Mediasize: 4000787030016 (3.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da2
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 10468a2d-7a36-11e3-b437-000c29dc8e23
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da2p2
   Mediasize: 3998639460352 (3.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 1222f085-7a36-11e3-b437-000c29dc8e23
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da2
   Mediasize: 4000787030016 (3.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da3
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da3p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: c8cee5fe-7a35-11e3-b437-000c29dc8e23
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da3p2
   Mediasize: 3998639460352 (3.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: caa83c1f-7a35-11e3-b437-000c29dc8e23
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da3
   Mediasize: 4000787030016 (3.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da4
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da4p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 1424ab9f-7a36-11e3-b437-000c29dc8e23
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da4p2
   Mediasize: 3998639460352 (3.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 15ff24e7-7a36-11e3-b437-000c29dc8e23
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: da4
   Mediasize: 4000787030016 (3.7T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da5
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da5p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: df20d8bc-7f01-11e3-a325-000c29dc8e23
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da5p2
   Mediasize: 1998251364352 (1.8T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0
   rawuuid: dfc22327-7f01-11e3-a325-000c29dc8e23
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 1998251364352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 3907029127
   start: 4194432
Consumers:
1. Name: da5
   Mediasize: 2000398934016 (1.8T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r0w0e0

Geom name: da7
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da7p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 890cdca3-8215-11e3-9e30-000c29dc8e23
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da7p2
   Mediasize: 1998251364352 (1.8T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 89b23f80-8215-11e3-9e30-000c29dc8e23
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 1998251364352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 3907029127
   start: 4194432
Consumers:
1. Name: da7
   Mediasize: 2000398934016 (1.8T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da8
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da8p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 8b71a96f-8215-11e3-9e30-000c29dc8e23
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da8p2
   Mediasize: 1998251364352 (1.8T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 8c0e0438-8215-11e3-9e30-000c29dc8e23
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 1998251364352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 3907029127
   start: 4194432
Consumers:
1. Name: da8
   Mediasize: 2000398934016 (1.8T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da6
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da6p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: ca140324-82c9-11e3-9e30-000c29dc8e23
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: da6p2
   Mediasize: 1998251364352 (1.8T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: ca95bd9a-82c9-11e3-9e30-000c29dc8e23
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 1998251364352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 3907029127
   start: 4194432
Consumers:
1. Name: da6
   Mediasize: 2000398934016 (1.8T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5
 
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
I'm not totaly sure I followed the steps 1-3 100% correctly. I think I forgot getting the device offline first. I think i replaced ist and detached it afterward (shame on me :( ). What I wondered about is, that I got no prompt to enter my password or anything.

I tried to to re-key, but this results in the same error like creating a new recovery key!
 
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
Yes, I created a passphrase!

Edit: Correction, I created the passphrase before the disk replacement ;).
 
H

Harsesis

Explorer
Joined
Jan 21, 2014
Messages
95
Hi panz,

thank you for your response, really nice explaination of the encryption used in FreeNAS and it helped me to get clear about some things I could not find out using the wiki!

But this will not help me with my problem, or am i wrong?
 
Dusan

Dusan

Guru
Joined
Jan 29, 2013
Messages
1,165
Please run:
Code:
sqlite3 /data/freenas-v1.db "delete from storage_encrypteddisk where encrypted_provider = 'gptid/8c0e0438-8215-11e3-9e30-000c29dc8e23';"

Then do the Encryption Re-key again. Be careful, it asks you for your root password and the passphrase. It does verify the root password, but the passphrase will be set as the new passphrase. To be 100% sure also run Change passphrase -- the form asks for the passphrase twice to verify that you did not mistype it. Then also create a new recovery key.
 
panz

panz

Guru
Joined
May 24, 2013
Messages
556
Now you should tell us at which point of time (sorry for my bad English) you set/changed the password.
 
Status
Not open for further replies.

Similar threads

J
  • Locked
Raid10 - is this how it should look like?
Replies
5
Views
2K
Dusan
Dusan
iainc
  • Locked
import fails after adding RocketRaid controller
Replies
1
Views
1K
cyberjock
C
F
  • Locked
Error: Disk replacement failed: "invaild vdev specs"... but can't see "used" ID
Replies
1
Views
1K
joeschmuck
joeschmuck
T
  • Locked
CPU Utilization 100% For Several Days
Replies
12
Views
2K
HoneyBadger
HoneyBadger
bsodmike
Trying to replace failed disk "UNIQUE constraint failed: storage_encrypteddisk.encrypted_provider"
Replies
1
Views
997
bsodmike
bsodmike
Top