How to finish drive replacement/spare setup?

[Jeremy Zawodny]

I recently had a disk fail in my 3 disk RAIDZ setup.

I ended up using a mix of command-line and the GUI to do it (I prefer the command-line) and managed to add the new drive as a spare and it's now be used as a member of the array. The resilvering process completed and my data appears safe.

HOWEVER, the flashing red icon in the GUI and the output of zpool status indicates that I'm not done yet:

Code:

[jzawodn@freenas] /mnt/vol0/jzawodn# zpool status
  pool: vol0
 state: DEGRADED
status: One or more devices has been taken offline by the administrator.
        Sufficient replicas exist for the pool to continue functioning in a
        degraded state.
action: Online the device using 'zpool online' or replace the device with
        'zpool replace'.
  scan: resilvered 2.02T in 25h44m with 0 errors on Sat Oct 17 22:15:49 2015
config:

        NAME                                              STATE     READ WRITE CKSUM
        vol0                                              DEGRADED     0     0     0
          raidz1-0                                        DEGRADED     0     0     0
            gptid/1f48a3c2-94fd-11e2-abbb-00241d279345    ONLINE       0     0     0
            gptid/1fcf4682-94fd-11e2-abbb-00241d279345    ONLINE       0     0     0
            spare-2                                       DEGRADED     0     0     0
              14418045192352924852                        OFFLINE      0     0     0  was /dev/gptid/204b99a0-94fd-11e2-abbb-00241d279345
              gptid/3141637e-747f-11e5-b201-00241d279345  ONLINE       0     0     0
        spares
          1406125605076481332                             INUSE     was /dev/gptid/3141637e-747f-11e5-b201-00241d279345

errors: No known data errors

The documentation I've read has slightly confused me about what to do next. Do I need to simply add a new spare drive and then "replace" the OFFLINE one? Or do I somehow need to promote the INUSE spare to being a full-fledged member of the raidz group? Or both?

If it matters, I'm running:

FreeBSD 9.2-RELEASE-p12 (FREENAS.amd64) #0 r262572+b043649: Sun Sep 28 23:03:31 PDT 2014

which is:

FreeNAS-9.2.1.8-RELEASE-x64 (e625626)

Thanks in advance for any advice...

Jeremy

 

[nightshade00013]

I ended up using a mix of command-line and the GUI to do it (I prefer the command-line) and managed to add the new drive as a spare and it's now be used as a member of the array.

That is possibly part of the problem. If FreeNAS has an option to do something via the web GUI it should be done that way.

 

[Jeremy Zawodny]

That is possibly part of the problem. If FreeNAS has an option to do something via the web GUI it should be done that way.

OK, let's call it a lesson learned or a mistake I won't repeat.

However, that doesn't really address the underlying issue: there's something that remains to be done in other to make ZFS happy on this box. And I'm not quite sure where to begin, since I haven't found a chunk of documentation that appears to deal with this. Of course, I'm happy to read docs if someone has a relevant section to point me that which I may have overlooked.

Jeremy

 

[depasseg]

It looks like you have a stripe under Spares-2, one of which is offline which is degrading your whole pool. My guess is that you will need to remove Spares-2 and then add in the 3rd disk properly. Of course, if you lose one of the other 2 drives until this is resolved you will lose that pool, so I hope you have backups.

Also, unless you have multiple vdevs being serviced by a spare, it usually makes more sense to include the drive in the RAID-Z group (making it RAID-Z2).

PS - Welcome to FreeNAS. I was a fan of yours back in the early days at Yahoo and RSS.

 

[Jeremy Zawodny]

It looks like you have a stripe under Spares-2, one of which is offline which is degrading your whole pool. My guess is that you will need to remove Spares-2 and then add in the 3rd disk properly. Of course, if you lose one of the other 2 drives until this is resolved you will lose that pool, so I hope you have backups.

Also, unless you have multiple vdevs being serviced by a spare, it usually makes more sense to include the drive in the RAID-Z group (making it RAID-Z2).

PS - Welcome to FreeNAS. I was a fan of yours back in the early days at Yahoo and RSS. :)

Ah, ok. My interpretation was somewhat off but this helps clarify why I'm seeing--thanks.

As for backups, I'm in the process of rsync'ing everything to a 5TB disk on another box Just In Case. Once that's done, I'll make those changes. And, if I'm lucky, the other 2 WD Reds that I ordered will be here by then.

Hopefully I can figure how to do that with the docs. I suspect so. The big part was knowing WHAT to do more than HOW to do it.

Thanks!

Jeremy

 

[Robert Trevellyan]

I'm happy to read docs if someone has a relevant section to point me

Look for "Replacing a Failed Drive."

The big part was knowing WHAT to do more than HOW to do it.

The WHAT is to Offline the bad drive, then Replace it with the good drive, or go directly to Replace if you have a spare drive port.

managed to add the new drive as a spare

This is not what do to.