Urgent Zpool Degraded Help

[schwartznet]

So im new to zfs as a whole and just had two drives decided to not like me so i swapped them out just fine but in the process i cant seem to understand whats going on now or what i need to do to restore the zfs pool back to normal. Here is the status log


NAS DEGRADED 0 0 0
raidz2 DEGRADED 0 0 0
gptid/f2f5d8da-cf73-11e1-8115-0008a137b43a ONLINE 0 0 0
gptid/f3bfa67b-cf73-11e1-8115-0008a137b43a ONLINE 0 0 0
gptid/f4812ecd-cf73-11e1-8115-0008a137b43a ONLINE 0 0 0
gptid/f5632dc2-cf73-11e1-8115-0008a137b43a ONLINE 0 0 0
replacing UNAVAIL 0 0 0 insufficient replicas
10919265551434587412 UNAVAIL 0 0 0 was /dev/gptid/f62df724-cf73-11e1-8115-0008a137b43a
16747772415496127032 UNAVAIL 0 0 0 was /dev/ada4
replacing DEGRADED 0 0 0
3536879380551895412 UNAVAIL 0 0 0 was /dev/gptid/f694fc1a-cf73-11e1-8115-0008a137b43a
ada5 ONLINE 0 0 0 397G resilvered
gptid/f7667fc2-cf73-11e1-8115-0008a137b43a ONLINE 0 0 0
gptid/f843e4f0-cf73-11e1-8115-0008a137b43a ONLINE 0 0 0
gptid/f94f6051-cf73-11e1-8115-0008a137b43a ONLINE 0 0 0
gptid/fa4b54f4-cf73-11e1-8115-0008a137b43a ONLINE 0 0 1
gptid/fb2aa8e8-cf73-11e1-8115-0008a137b43a ONLINE 0 0 0


i cant really understand what this means and what i need to do to fix it short of xfering all the data off and starting over lol please help!

 

[ProtoSD]

What instructions did you follow?

Did you replace both drives at the same time?

EDIT: Post the output from the two command below also.

zpool status -v

gpart show

 

[schwartznet]

That is the zpool status -v and yes we replaced them at the same time. Im guessing that was a mistake lol.

[root@freenas] ~# gpart show
=> 34 1953525101 da0 GPT (932G)
34 94 - free - (47K)
128 4194304 1 freebsd-swap (2.0G)
4194432 1949330703 2 freebsd-zfs (930G)

=> 34 1953525101 da1 GPT (932G)
34 94 - free - (47K)
128 4194304 1 freebsd-swap (2.0G)
4194432 1949330703 2 freebsd-zfs (930G)

=> 34 1953525101 da3 GPT (932G)
34 94 - free - (47K)
128 4194304 1 freebsd-swap (2.0G)
4194432 1949330703 2 freebsd-zfs (930G)

=> 34 1953525101 da4 GPT (932G)
34 94 - free - (47K)
128 4194304 1 freebsd-swap (2.0G)
4194432 1949330703 2 freebsd-zfs (930G)

=> 63 7831467 da5 MBR (3.7G)
63 1930257 1 freebsd [active] (943M)
1930320 63 - free - (32K)
1930383 1930257 2 freebsd (943M)
3860640 3024 3 freebsd (1.5M)
3863664 41328 4 freebsd (20M)
3904992 3926538 - free - (1.9G)

=> 34 5860533101 ada0 GPT (2.7T)
34 94 - free - (47K)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338703 2 freebsd-zfs (2.7T)

=> 34 5860533101 ada1 GPT (2.7T)
34 94 - free - (47K)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338703 2 freebsd-zfs (2.7T)

=> 34 5860533101 ada2 GPT (2.7T)
34 94 - free - (47K)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338703 2 freebsd-zfs (2.7T)

=> 34 5860533101 ada3 GPT (2.7T)
34 94 - free - (47K)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338703 2 freebsd-zfs (2.7T)

=> 34 5860533101 ada4 GPT (2.7T) [CORRUPT]
34 94 - free - (47K)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338703 2 freebsd-zfs (2.7T)

=> 0 1930257 da5s1 BSD (943M)
0 16 - free - (8.0K)
16 1930241 1 !0 (943M)

[root@freenas] ~#

 

[ProtoSD]

That is the zpool status -v and yes we replaced them at the same time. Im guessing that was a mistake lol.

Yes, it was a mistake. I'm not sure there's much you can do. Do you have a backup?

ZFS uses data from all the other drives in the pool to rebuild the ONE that is being replaced. It's telling you it's missing the data it needs to rebuild the data for either drive.

 

[praecorloth]

I would say try putting one of those drives back in and see if it gets picked up again. Couldn't hurt, right? :)

 

[cyberjock]

I don't think that would work. Once you pull a drive from an operating zpool you can't just "readd" it. Just like if you pull a drive from a RAID5 you can't just plug it back in and it will work.

 

[ProtoSD]

I don't think that would work. Once you pull a drive from an operating zpool you can't just "readd" it. Just like if you pull a drive from a RAID5 you can't just plug it back in and it will work.

Yes, you're right. I've seen this happen here a couple of times before and re-adding the drive(s) didn't help. Of course if you're desperate it never hurts to give it a try.

 

[ProtoSD]

I don't think that would work. Once you pull a drive from an operating zpool you can't just "readd" it. Just like if you pull a drive from a RAID5 you can't just plug it back in and it will work.

Yes, you're right. I've seen this happen here a couple of times before and re-adding the drive(s) didn't help. Of course if you're desperate it never hurts to give it a try.

 

[William Grzybowski]

Use:

# zpool detach NAS 16747772415496127032
# zpool detach NAS 3536879380551895412