Can't Import RAIDZ Pool

ta2 · Mar 26, 2014

Hi,

I recently had a failure of the boot drive of FreeNAS and had to reinstall it from scratch. The configuration of the machine was the following:

2x4TB - MIRROR, encrypted, "PRIVATE"
4x2TB - RAIDZ, not encrypted, "LIBRARY"

I was able to import the PRIVATE volume using the "Auto Import Volume" feature, however I am unable to import the LIBRARY volume. I've searched quite thoroughly on the internet but I can't seem to figure out anything that could help get the LIBRARY volume back. To my understanding, "zpool status" should at least show some information about the LIBRARY volume. The partitions are still there on the 2TB drives, so I should be able to get my data back somehow, right? Please see the output of a bunch of commands below.

Many thanks for any assistance you can offer,
ta2

Code:

[root@freenas] ~# gpart show
=>        34  7814037101  ada0  GPT  (3.7T)
          34          94        - free -  (47k)
        128    4194304    1  freebsd-swap  (2.0G)
    4194432  7809842696    2  freebsd-zfs  (3.7T)
  7814037128          7        - free -  (3.5k)
 
=>        34  7814037101  ada1  GPT  (3.7T)
          34          94        - free -  (47k)
        128    4194304    1  freebsd-swap  (2.0G)
    4194432  7809842696    2  freebsd-zfs  (3.7T)
  7814037128          7        - free -  (3.5k)
 
=>        34  3907029101  ada2  GPT  (1.8T)
          34          94        - free -  (47k)
        128    4194304    1  freebsd-swap  (2.0G)
    4194432  3902834696    2  freebsd-zfs  (1.8T)
  3907029128          7        - free -  (3.5k)
 
=>        34  3907029101  ada3  GPT  (1.8T)
          34          94        - free -  (47k)
        128    4194304    1  freebsd-swap  (2.0G)
    4194432  3902834696    2  freebsd-zfs  (1.8T)
  3907029128          7        - free -  (3.5k)
 
=>        34  3907029101  ada4  GPT  (1.8T)
          34          94        - free -  (47k)
        128    4194304    1  freebsd-swap  (2.0G)
    4194432  3902834696    2  freebsd-zfs  (1.8T)
  3907029128          7        - free -  (3.5k)
 
=>        34  3907029101  ada5  GPT  (1.8T)
          34          94        - free -  (47k)
        128    4194304    1  freebsd-swap  (2.0G)
    4194432  3902834696    2  freebsd-zfs  (1.8T)
  3907029128          7        - free -  (3.5k)
 
=>      63  15633345  da0  MBR  (7.5G)
        63  1930257    1  freebsd  [active]  (942M)
  1930320        63      - free -  (31k)
  1930383  1930257    2  freebsd  (942M)
  3860640      3024    3  freebsd  (1.5M)
  3863664    41328    4  freebsd  (20M)
  3904992  11728416      - free -  (5.6G)
 
=>      0  1930257  da0s1  BSD  (942M)
        0      16        - free -  (8.0k)
      16  1930241      1  !0  (942M)

Code:

[root@freenas] ~# gpart list
Geom name: ada0
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada0p1
  Mediasize: 2147483648 (2.0G)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e1
  rawuuid: d4fbf549-d7d8-11e2-99f0-60a44cb2b110
  rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2147483648
  offset: 65536
  type: freebsd-swap
  index: 1
  end: 4194431
  start: 128
2. Name: ada0p2
  Mediasize: 3998639460352 (3.7T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e2
  rawuuid: d5185b73-d7d8-11e2-99f0-60a44cb2b110
  rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 3998639460352
  offset: 2147549184
  type: freebsd-zfs
  index: 2
  end: 7814037127
  start: 4194432
Consumers:
1. Name: ada0
  Mediasize: 4000787030016 (3.7T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r2w2e5
 
Geom name: ada1
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada1p1
  Mediasize: 2147483648 (2.0G)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e1
  rawuuid: d59085cd-d7d8-11e2-99f0-60a44cb2b110
  rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2147483648
  offset: 65536
  type: freebsd-swap
  index: 1
  end: 4194431
  start: 128
2. Name: ada1p2
  Mediasize: 3998639460352 (3.7T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e2
  rawuuid: d5af9f99-d7d8-11e2-99f0-60a44cb2b110
  rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 3998639460352
  offset: 2147549184
  type: freebsd-zfs
  index: 2
  end: 7814037127
  start: 4194432
Consumers:
1. Name: ada1
  Mediasize: 4000787030016 (3.7T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r2w2e5
 
Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 3907029134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
  Mediasize: 2147483648 (2.0G)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e1
  rawuuid: 63467859-da3b-11e2-884a-60a44cb2b110
  rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2147483648
  offset: 65536
  type: freebsd-swap
  index: 1
  end: 4194431
  start: 128
2. Name: ada2p2
  Mediasize: 1998251364352 (1.8T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
  rawuuid: 63519af1-da3b-11e2-884a-60a44cb2b110
  rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 1998251364352
  offset: 2147549184
  type: freebsd-zfs
  index: 2
  end: 3907029127
  start: 4194432
Consumers:
1. Name: ada2
  Mediasize: 2000398934016 (1.8T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e2
 
Geom name: ada3
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 3907029134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada3p1
  Mediasize: 2147483648 (2.0G)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e1
  rawuuid: 63af36d9-da3b-11e2-884a-60a44cb2b110
  rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2147483648
  offset: 65536
  type: freebsd-swap
  index: 1
  end: 4194431
  start: 128
2. Name: ada3p2
  Mediasize: 1998251364352 (1.8T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
  rawuuid: 63b9a22c-da3b-11e2-884a-60a44cb2b110
  rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 1998251364352
  offset: 2147549184
  type: freebsd-zfs
  index: 2
  end: 3907029127
  start: 4194432
Consumers:
1. Name: ada3
  Mediasize: 2000398934016 (1.8T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e2
 
Geom name: ada4
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 3907029134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada4p1
  Mediasize: 2147483648 (2.0G)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
  rawuuid: 64398cf4-da3b-11e2-884a-60a44cb2b110
  rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2147483648
  offset: 65536
  type: freebsd-swap
  index: 1
  end: 4194431
  start: 128
2. Name: ada4p2
  Mediasize: 1998251364352 (1.8T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
  rawuuid: 6444dc8c-da3b-11e2-884a-60a44cb2b110
  rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 1998251364352
  offset: 2147549184
  type: freebsd-zfs
  index: 2
  end: 3907029127
  start: 4194432
Consumers:
1. Name: ada4
  Mediasize: 2000398934016 (1.8T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
 
Geom name: ada5
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 3907029134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada5p1
  Mediasize: 2147483648 (2.0G)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
  rawuuid: 64ac4637-da3b-11e2-884a-60a44cb2b110
  rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2147483648
  offset: 65536
  type: freebsd-swap
  index: 1
  end: 4194431
  start: 128
2. Name: ada5p2
  Mediasize: 1998251364352 (1.8T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
  rawuuid: 64b7e5e0-da3b-11e2-884a-60a44cb2b110
  rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 1998251364352
  offset: 2147549184
  type: freebsd-zfs
  index: 2
  end: 3907029127
  start: 4194432
Consumers:
1. Name: ada5
  Mediasize: 2000398934016 (1.8T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
 
Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 15633407
first: 63
entries: 4
scheme: MBR
Providers:
1. Name: da0s1
  Mediasize: 988291584 (942M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 32256
  Mode: r1w0e1
  attrib: active
  rawtype: 165
  length: 988291584
  offset: 32256
  type: freebsd
  index: 1
  end: 1930319
  start: 63
2. Name: da0s2
  Mediasize: 988291584 (942M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 988356096
  Mode: r0w0e0
  rawtype: 165
  length: 988291584
  offset: 988356096
  type: freebsd
  index: 2
  end: 3860639
  start: 1930383
3. Name: da0s3
  Mediasize: 1548288 (1.5M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 1976647680
  Mode: r0w0e0
  rawtype: 165
  length: 1548288
  offset: 1976647680
  type: freebsd
  index: 3
  end: 3863663
  start: 3860640
4. Name: da0s4
  Mediasize: 21159936 (20M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 1978195968
  Mode: r1w1e2
  rawtype: 165
  length: 21159936
  offset: 1978195968
  type: freebsd
  index: 4
  end: 3904991
  start: 3863664
Consumers:
1. Name: da0
  Mediasize: 8004304896 (7.5G)
  Sectorsize: 512
  Mode: r2w1e4
 
Geom name: da0s1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1930256
first: 0
entries: 8
scheme: BSD
Providers:
1. Name: da0s1a
  Mediasize: 988283392 (942M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 40448
  Mode: r1w0e1
  rawtype: 0
  length: 988283392
  offset: 8192
  type: !0
  index: 1
  end: 1930256
  start: 16
Consumers:
1. Name: da0s1
  Mediasize: 988291584 (942M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 32256
  Mode: r1w0e1

Code:

[root@freenas] ~# zpool list
NAME      SIZE  ALLOC  FREE    CAP  DEDUP  HEALTH  ALTROOT
PRIVATE  3.62T  1.81T  1.81T    50%  1.00x  ONLINE  /mnt

Code:

[root@freenas] ~# zpool status
  pool: PRIVATE
state: ONLINE
  scan: scrub repaired 0 in 5h49m with 0 errors on Sun Feb 16 05:49:49 2014
config:
 
        NAME                                                STATE    READ WRITE CKSUM
        PRIVATE                                            ONLINE      0    0    0
          mirror-0                                          ONLINE      0    0    0
            gptid/d5185b73-d7d8-11e2-99f0-60a44cb2b110.eli  ONLINE      0    0    0
            gptid/d5af9f99-d7d8-11e2-99f0-60a44cb2b110.eli  ONLINE      0    0    0
 
errors: No known data errors

cyberjock · Mar 28, 2014

Can you post the output of "zpool import"?

joeschmuck · Mar 28, 2014

Now these are the kinds of posts I like to see. First the user has only 2 posts on this forum. Second the user did their own research before asking for help. Third they actually posted data in order to help solicit a good quick answer.

cyberjock · Mar 28, 2014

Yeah. I hadn't been on the forums in 4 days, so I saw this unanswered post and figured I should try to help. ;)

ta2 · Mar 28, 2014

Hi cyberjock and joeschumck,

Thanks very much for your replies. The command "zpool import" has no output at all, which I understand it is very bad for me... Here's the output another command I found, but I gather that it's also not useful:

Many thanks,
ta2

Code:

[root@freenas] /dev# zpool import
[root@freenas] /dev#

Code:

[root@freenas] /dev# zdb
PRIVATE:
    version: 28
    name: 'PRIVATE'
    state: 0
    txg: 4829020
    pool_guid: 16493043475259856280
    hostid: 707448102
    hostname: 'freenas.local'
    vdev_children: 1
    vdev_tree:
        type: 'root'
        id: 0
        guid: 16493043475259856280
        children[0]:
            type: 'mirror'
            id: 0
            guid: 3153745964821664585
            metaslab_array: 31
            metaslab_shift: 35
            ashift: 12
            asize: 3998634737664
            is_log: 0
            create_txg: 4
            children[0]:
                type: 'disk'
                id: 0
                guid: 10370779451419851624
                path: '/dev/gptid/d5185b73-d7d8-11e2-99f0-60a44cb2b110.eli'
                phys_path: '/dev/gptid/d5185b73-d7d8-11e2-99f0-60a44cb2b110.eli'
                whole_disk: 1
                DTL: 150
                create_txg: 4
            children[1]:
                type: 'disk'
                id: 1
                guid: 8894017548274220204
                path: '/dev/gptid/d5af9f99-d7d8-11e2-99f0-60a44cb2b110.eli'
                phys_path: '/dev/gptid/d5af9f99-d7d8-11e2-99f0-60a44cb2b110.eli'
                whole_disk: 1
                DTL: 149
                create_txg: 4

cyberjock · Mar 29, 2014

yeah.. you did whole disks so clearly you didn't format then the proper way (aka via FreeNAS WebGUI). Not sure about public, but if all of your disks show up in "camcontrol devlist" then your pool is gone. :(

I'd seriously consider making your pool per the manual and NOT per the CLI.

ta2 · Mar 29, 2014

All the disks do show up in camcontrol devlist, but I did format them via the FreeNAS WebGUI.

They were originally formatted via the FreeNAS WebGUI as 2x 2x2TB MIRROR on another box, then I moved the disks and reformatted them into a 4x2TB RAIDZ (again via the WebGUI).

One thing I did notice that may be of significance is that even though the LIBRARY pool is not encrypted, when I did the auto import of the PRIVATE pool, FreeNAS added all 4 of the non-encrypted RAIDZ disks to GELI. Could that have killed it?

Many thanks,
ta2

cyberjock · Mar 29, 2014

ta2 said:
All the disks do show up in camcontrol devlist, but I did format them via the FreeNAS WebGUI.

They were originally formatted via the FreeNAS WebGUI as 2x 2x2TB MIRROR on another box, then I moved the disks and reformatted them into a 4x2TB RAIDZ (again via the WebGUI).

Actually, you are probably right. If I'm not mistaken geli devices are detected as whole disks. So my assessment that you had created the pool from the CLI is possibly in error.

ta2 said:
One thing I did notice that may be of significance is that even though the LIBRARY pool is not encrypted, when I did the auto import of the PRIVATE pool, FreeNAS added all 4 of the non-encrypted RAIDZ disks to GELI. Could that have killed it?

I have no idea what you are trying to say, but your PRIVATE pool clearly has only 2 disks in the pool. So FreeNAS didn't "add" all 4 of the disks to GELI. Your zdb output confirms this.

Now if you are talking about the first partition on the disks that's different. If your swap space was left at the default then partition 1 is your swap space, and swapspace is always encrypted for security reasons.

ta2 · Mar 29, 2014

Now if you are talking about the first partition on the disks that's different. If your swap space was left at the default then partition 1 is your swap space, and swapspace is always encrypted for security reasons.

Ah okay, that's what happened then... Because I have ada[2-5]p1.eli in /dev.

Any further ideas? I find it really strange that this could happen just from the boot drive dying and/or Auto Importing via the WebGUI. I read that some "seemingly harmless" commands can destroy a zpool, could the WebGUI have done any of those during Auto Import?

cyberjock · Mar 29, 2014

Not likely. My guess is something else happened(either directly from you or something indirect you aren't realizing) is responsible for your problems.

You also never posted your hardware specs....

ta2 · Mar 29, 2014

That's a shame. Here's the spec from the WebGUI.

System Information

Hostname freenas.local
Build FreeNAS-8.3.1-RELEASE-p2-x64 (r12686+b770da6_dirty)
Platform Intel(R) Core(TM) i5-3470 CPU @ 3.20GHz
Memory 7863MB
System Time Sat Mar 29 11:30:52 PDT 2014
Uptime 11:30AM up 12:14, 1 user
Load Average 0.02, 0.09, 0.07
Connected through 192.168.1.101

cyberjock · Mar 29, 2014

What motherboard are you using? Are you using the onboard SATA?

Choosing to use non-ECC RAM(which I know you are using since no i5s support ECC) isn't a very good choice. It's not necessarily your problem, but it's not the most ideal.

ta2 · Mar 29, 2014

It's an Asus P8H77-I. I have 1 8GB stick of memory since the other 8GB stick died very shortly after purchase, haven't got round to RMA'ing it yet. I have a HP MicroServer as my backup server, which has never had an issue. I'll probably take your advice and go with ECC in future.

So my zpool is completely dead?

cyberjock · Mar 29, 2014

Well, its like this...

1. If "zpool import" doesn't list anything, then it doesn't find any zpool metadata from your disks. This pretty much means FreeNAS sees no zpool at all on the disks.
2. Your choice of hardware isn't ideal. Consumer grade products like your motherboard are not always 100% compatible with FreeBSD(and therefore FreeBSD). They can work, and then suddenly stop working, for no apparent reason. This is why we recommend server-grade hardware. Server-grade has many benefits, with the most important being fairly assured compatibility with "exotic" operating systems like FreeBSD.
3. You could try upgrading to 9.2.0(or installing it temporarily on another USB stick) to see if it finds your missing pool. But if you are using the same version that you were before and it's not working now, that's not something I'd put a lot of faith on it.
4. Your reasons for losing the pool are not clear. You haven't provided any indication of what could be to blame, but there's potential risks in your hardware choice. Unfortunately, quite often people who aren't hardcore file server geeks make what they consider to be small minor changes that actually have serious consequences. As such, sometimes the answer isn't clear because you may have done something innocuous like change some BIOS setting you aren't thinking anything about, but that's the actual problem. There's too many variables and too many things you could do to make the pool appear unavailable even though your data is there. But unless you know what you did, your options are about nil. :( You could try FreeNAS on another machine to see if your drives work on a different box. But other than that, unless you can provide information on what else has changed besides your USB stick going bad(because CLEARLY something HAS changed) you don't have much for options.

Important Announcement for the TrueNAS Community.

Can't Import RAIDZ Pool

ta2

Cadet

cyberjock

Inactive Account

joeschmuck

Old Man

cyberjock

Inactive Account

ta2

Cadet

cyberjock

Inactive Account

ta2

Cadet

cyberjock

Inactive Account

ta2

Cadet

cyberjock

Inactive Account

ta2

Cadet

cyberjock

Inactive Account

ta2

Cadet

cyberjock

Inactive Account

Similar threads