FreeNAS 9.2.1 to 11.2 U7 on ASRock Rack C3758D4I-4L

[scummings]

Hi all,

I had FreeNAS 9.2.1 running on a SuperMicro X7SPA-HF board, running ZFS (4 disks) a couple of disks failed, but it still worked in a degraded state with 2 disks. Then, with major house renovation... it got powered off for about 18 months!

When I brought it back online.... it worked (amazingly). So I bought the ASRock Rack C3758D4I-4L board, new case 32gb RAM new disks with a view to migrating everything to the new device...... this is where the problems started.

My plan was to disconnect the drives from the old unit (9.2.1), stick them in the new case and bring them online in 11.2. Then, add 2 new disks to the pool, and then once everything had settled across the ZFS pool replace one of the older disk with a new one, then do the same for the last disk.

It failed at the first hurdle in that when I connected the 2 disks from the old box, I could not see or import the ZFS pool, nor could I apply the config I'd save from 9.2.1 to the 11.2 box.

So, I thought I'll put them back into the old box, boot up and manually recreate the config, then copy the data over the LAN. Unfortunately, the old box now fails to power up :(

So I'm a bit stuck with how to proceed. I think I need a two step process.
1. I need to get the config upgraded from 9.2.1 to 11.2. This may involve a couple of VMs to allow give me an upgrade path - even if the data disks are not visible.
2. I should be able to try my initial idea of plugging the drives into the new case, but could probably do with some advice on how to import a degraded ZFS and how I might be able to do this via CLI (if necessary).

All ideas very welcome..... I really don't want to loose all of my data.

Many thanks,

Simon.

 

[sretalla]

Let's start with the output from zpool import on the new box with the disks attached.

 

[scummings]

Ok, will give it a go when I get home later and post the result.

 

[scummings]

This is the output with just the two old disks inserted into the new host. I think I already know the next response.

Code:

root@freenas2[~]# zpool import
   pool: DATA
     id: 34254
  state: UNAVAIL
 status: The pool was last accessed by another system.
 action: The pool cannot be imported due to damaged devices or data.
   see: http://illumos.org/msg/ZFS-8000-EY
 config:

        DATA                                            UNAVAIL  insufficient replicas
          raidz1-0                                      UNAVAIL  insufficient replicas
            4511200244067524105                         UNAVAIL  cannot open
            2560993263708433568                         UNAVAIL  cannot open
            gptid/9e63ff90-946c-11e5-9886-002590046cea  ONLINE
            gptid/9a2489fc-9535-11e5-9886-002590046cea  ONLINE
root@freenas2[~]#

 

[scummings]

I do have the other damaged disks..... somewhere... so will dig them out and see if either of the will give me the miracle I hope for.

 

[scummings]

I've managed to find only one of the disks...... and this is the result. I'm not hopeful.

Code:

root@freenas2[~]# zpool import
   pool: DATA
     id: 34254
  state: FAULTED
 status: The pool was last accessed by another system.
 action: The pool cannot be imported due to damaged devices or data.
        The pool may be active on another system, but can be imported using
        the '-f' flag.
   see: http://illumos.org/msg/ZFS-8000-EY
 config:

        DATA                                            FAULTED  corrupted data
          raidz1-0                                      DEGRADED
            gptid/ff2088cd-6980-11e2-86c8-002590046cea  ONLINE
            2560993263708433568                         UNAVAIL  cannot open
            gptid/9e63ff90-946c-11e5-9886-002590046cea  ONLINE
            gptid/9a2489fc-9535-11e5-9886-002590046cea  ONLINE

 

[PhiloEpisteme]

It failed at the first hurdle in that when I connected the 2 disks from the old box, I could not see or import the ZFS pool, nor could I apply the config I'd save from 9.2.1 to the 11.2 box.

This isn't hugely surprising to me; your pool is expecting there to be 4 disks, but you only gave it two. The standard import functionality will want all of the disks.

I had FreeNAS 9.2.1 running on a SuperMicro X7SPA-HF board, running ZFS (4 disks) a couple of disks failed, but it still worked in a degraded state with 2 disks. Then, with major house renovation... it got powered off for about 18 months!

This may be clear to you now, but leaving pools in a degraded state increases the likelihood of losing the pool and if you have an inadequate backup strategy this could lead to data loss.

1. I need to get the config upgraded from 9.2.1 to 11.2. This may involve a couple of VMs to allow give me an upgrade path - even if the data disks are not visible.

To me, the config is secondary; it contains share data etc. The config is not required to recover your pool's data etc. =

2. I should be able to try my initial idea of plugging the drives into the new case, but could probably do with some advice on how to import a degraded ZFS and how I might be able to do this via CLI (if necessary).

I think it is likely that you will need to import the pool in a degraded state. Once you get it imported; you will want to either immediately replace the failed disks or create a backup of the data. You're in a risky spot here if you have no backup.

I've managed to find only one of the disks...... and this is the result. I'm not hopeful.

So, it looks like the disk you found is in a good enough state that you can import the pool. You'll note that the advice from zpool import suggests forcing the import. If you're unable to do this via the GUI you can attempt it via the CLI. I stress again the importance of prioritizing fixing your pool and backing up your data; failure to do so increases risk to your data.

Then, add 2 new disks to the pool,

How do you plan to do this? Currently the methods for expanding a pool are to either add a new vdev to a pool or resilver every disk in a vdev with a larger disk.

 

[scummings]

Thanks for the input so far....

I'll try the import via GUI / CLI when I get home.

As far as replacing the disks. I thought I'd place a new drive in currently empty slot 3 (0-3) and attempt a 'replace' via the GUI on the disk currently showing as 2560993263708433568 UNAVAIL cannot open, then wait for the resilvering process to complete.
I then plan to replace the disk showing as gptid/ff2088cd-6980-11e2-86c8-002590046cea ONLINE, and again wait for the process to complete.

Before all that though, if I am able to successfully import the pool, is it worth running a scrub of the pool before attempting the replacements?

Any advice on the CLI commands such as zpool import -f I might require to import the pool if the initial attempts fail would be much appreciated.

Thanks,

Simon.

 

[PhiloEpisteme]

Before all that though, if I am able to successfully import the pool, is it worth running a scrub of the pool before attempting the replacements?

My guess is no, you want to resilver or backup first. A scrub will put extra stress on the pool and being in a degraded state already you risk losing another disk, if you do so you'll lose everything since it is RAIDZ1. Resilvering will do it's best to preserve data. Once you get the pool out of the degraded state run the scrub and make sure your backup is up-to-date.

Just my thoughts there, if someone strongly disagrees perhaps go with their advice.

 

[scummings]

Thanks for the updates so far.

I've attempted to import the pool, but it failed.

Code:

root@freenas2[~]# zpool import -f
   pool: DATA
     id: 34254
  state: FAULTED
 status: The pool was last accessed by another system.
 action: The pool cannot be imported due to damaged devices or data.
        The pool may be active on another system, but can be imported using
        the '-f' flag.
   see: http://illumos.org/msg/ZFS-8000-EY
 config:

        DATA                                            FAULTED  corrupted data
          raidz1-0                                      DEGRADED
            gptid/ff2088cd-6980-11e2-86c8-002590046cea  ONLINE
            2560993263708433568                         UNAVAIL  cannot open
            gptid/9e63ff90-946c-11e5-9886-002590046cea  ONLINE
            gptid/9a2489fc-9535-11e5-9886-002590046cea  ONLINE

I also tried to view the pool in the new GUI, but all of the disks a listed as disabled, even though the zpool import -f shows as ONLINE So somehow I need to either replace the disk 2560993263708433568 UNAVAIL via CLI, or make the pool enabled in the GUI.

Any ideas?? I look forward to any help!

Thanks,

Simon.

 

[PhiloEpisteme]

Hmm, it is possible that it has something to do with the different versions of FreeNAS, but I am not sure.

I've attempted to import the pool, but it failed.

Could you please provide the exact command and exact output the system gave?

 

[scummings]

Hi,

Sorry for the delay, here's what I've tried.

Code:

root@freenas2[~]# zpool import
   pool: Data_Pool
     id: 799192232307745084
  state: UNAVAIL
 status: One or more devices are missing from the system.
 action: The pool cannot be imported. Attach the missing
        devices and try again.
   see: http://illumos.org/msg/ZFS-8000-3C
 config:

        Data_Pool                                       UNAVAIL  insufficient replicas
          raidz2-0                                      UNAVAIL  insufficient replicas
            gptid/c8916e03-959c-11e9-9df4-d05099d08c72  ONLINE
            882018059215718758                          UNAVAIL  cannot open
            17230219537770186878                        UNAVAIL  cannot open
            5283596293456566603                         UNAVAIL  cannot open

   pool: DATA
     id: 34254
  state: FAULTED
 status: The pool was last accessed by another system.
 action: The pool cannot be imported due to damaged devices or data.
        The pool may be active on another system, but can be imported using
        the '-f' flag.
   see: http://illumos.org/msg/ZFS-8000-EY
 config:

        DATA                                            FAULTED  corrupted data
          raidz1-0                                      DEGRADED
            gptid/ff2088cd-6980-11e2-86c8-002590046cea  ONLINE
            2560993263708433568                         UNAVAIL  cannot open
            gptid/9e63ff90-946c-11e5-9886-002590046cea  ONLINE
            gptid/9a2489fc-9535-11e5-9886-002590046cea  ONLINE

root@freenas2[~]# zpool import 34254 -f
cannot import 'DATA': I/O error
        Destroy and re-create the pool from
        a backup source.

I'd like to try and replace disk 2560993263708433568 with disk gptid/c8916e03-959c-11e9-9df4-d05099d08c72, how would I go about this via the command line?