Please help! Started up FreeNAS, suddenly voluime storage (ZFS) status unknown?!

[HHawk]

Here are the results:

Code:

[root@freenas] ~# zpool import -f -R /mnt -o rdonly=on storage
cannot import 'storage': I/O error
        Destroy and re-create the pool from
        a backup source.

This message I have seen the past day or so, many, many times. :(


The long smart tests are now running and according to the feedback from the system it will take up to 6 or 7 hours.

Code:

[root@freenas] ~# zdb -e storage

Configuration for import:
        vdev_children: 1
        version: 28
        pool_guid: 17472259698871586545
        name: 'storage'
        state: 0
        hostid: 1822453256
        hostname: ''
        vdev_tree:
            type: 'root'
            id: 0
            guid: 17472259698871586545
            children[0]:
                type: 'raidz'
                id: 0
                guid: 9407558217227431842
                nparity: 2
                metaslab_array: 31
                metaslab_shift: 36
                ashift: 12
                asize: 11989479849984
                is_log: 0
                create_txg: 4
                children[0]:
                    type: 'disk'
                    id: 0
                    guid: 16068408191032711512
                    phys_path: '/dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a'
                    whole_disk: 1
                    DTL: 41
                    create_txg: 4
                    path: '/dev/dsk/gptid/19177fb9-25fa-11e2-9ab0-00151736994a'
                children[1]:
                    type: 'disk'
                    id: 1
                    guid: 9922754965837443026
                    phys_path: '/dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a'
                    whole_disk: 1
                    DTL: 40
                    create_txg: 4
                    path: '/dev/dsk/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a'
                children[2]:
                    type: 'disk'
                    id: 2
                    guid: 6490578919254224179
                    phys_path: '/dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a'
                    whole_disk: 1
                    DTL: 118
                    create_txg: 4
                    path: '/dev/dsk/gptid/3dc2f956-3de6-11e2-8af1-00151736994a'
                children[3]:
                    type: 'disk'
                    id: 3
                    guid: 12000046156850729353
                    phys_path: '/dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a'
                    whole_disk: 1
                    DTL: 38
                    create_txg: 4
                    path: '/dev/dsk/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a'
                children[4]:
                    type: 'disk'
                    id: 4
                    guid: 5393521929904432319
                    phys_path: '/dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a'
                    whole_disk: 1
                    DTL: 37
                    create_txg: 4
                    path: '/dev/dsk/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a'
                children[5]:
                    type: 'disk'
                    id: 5
                    guid: 12367582447121855137
                    phys_path: '/dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a'
                    whole_disk: 1
                    DTL: 36
                    create_txg: 4
                    path: '/dev/dsk/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a'
zdb: can't open 'storage': No such file or directory

And here are the labels & uberblocks on the actual disks:

ada0.uber
ada1.uber
ada2.uber
ada3.uber
ada4.uber
ada5.uber

I hope I did everything correct. I never used pastebin before.


In regards to:

Last fire up mfsBSD, USB memstick - amd64/9/mfsbsd-9.1-RELEASE-amd64.img, and try these two commands.

That has to wait since it's running the long smart checks of course. I can do that in about 6 or 7 hours.

 

[HHawk]

Oh and one more thing; I mentioned this before, but I never received an answer on it, so I don't know if it's important or not (probably not).

One harddisk was bad and I had to replace it and resilver it. In the beginning I had problems with resilvering because I changed the following setting:

Code:

Swap size on each drive in GiB, affects new disks only. Setting this to 0 disables swap creation completely (STRONGLY DISCOURAGED).

Original thread here.
Post regarding this setting here.

(of course paleoN saved my ass back then also, so I am kinda counting on him now again... or hoping is the better word here).

After reading throuh that thread, I doubt it's the problem with the swap folders, but I am doing my best in providing any kind of information also.

With the previous USB stick and FreeNAS install, I was using 20 GiB swap sized files on each disk. This new USB stick with the fresh install of FreeNAS is showing the standard 2 GiB.
As previously mentioned; probably it hasn't anything to do with it, but I thought I would mention it once again, since I didn't got an answer on it.

Once again thank you all for your time and help so far. I really hope to safe some data at least... However I am really getting a bit desperate now.

//update

Long smartcl check done; all drives are error free and smartcl passed the tests without errors (on all drives).


Here are all the results: pastbin

I am now going to run the usb stick.

 

[HHawk]

Well same thing from that other FreeBSD:

Code:

   pool: storage
     id: 17472259698871586545
  state: ONLINE
 action: The pool can be imported using its name or numeric identifier.
 config:

        storage                                         ONLINE
          raidz2-0                                      ONLINE
            gptid/19177fb9-25fa-11e2-9ab0-00151736994a  ONLINE
            gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a  ONLINE
            gptid/3dc2f956-3de6-11e2-8af1-00151736994a  ONLINE
            gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a  ONLINE
            gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a  ONLINE
            gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a  ONLINE

Code:

cannot import 'storage': I/O error
        Destroy and re-create the pool from
        a backup source.

So it's saying the exact same thing as under Freenas. :(

 

[HHawk]

I have been searching myself in the meantime.

Wouldn't commands like these won't be of any use?

Code:

zpool clear -F storage
zpool import -F storage
zpool import -o readonly=on storage

? :(

 

[paleoN]

So it's saying the exact same thing as under Freenas. :(

Not surprising.

Reboot mfsBSD, hit <2>, Escape to loader prompt, at the FreeBSD menu and type the following:

Code:

set vfs.zfs.debug=1

boot

Then rerun the import:

Code:

zpool import storage

It will fail again, but this time we should get more than just I/O error. Then scp /var/log/messages off via SSH and post it.

After copying the log we need to setup swap before running the next command.

Code:

swapctl -a /dev/ada0p1 /dev/ada1p1 /dev/ada2p1

Finally this command will likely take longer than the -X import, but hopefully will be informative:

Code:

zdb -e -bcsvL storage

Wouldn't commands like these won't be of any use?

No, we've tried all of them already except the clear and that only works on imported pools.

 

[HHawk]

Thank you for your help again.

I am in mfsBSD entered the given debug setting and typed boot. Next I ran zpool import storage and as you mentioned it's showing way more stuff now.
But how do I SSH to mfsBSD and get this information?

//edit

Nevermind, I already found the IP so I can ssh to it instead

//update

Pffft... If I run zpool import storage from SSH it doesn't show the information which is showing locally... very annoying.


//update

Well I found this in the logs, hopefully this helps?

Code:

Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:118[1]: Created geom and consumer for gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19177fb9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19177fb9-25fa-11e2-9ab0-00151736994a is 16068408191032711512
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a is 9922754965837443026
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/3dc2f956-3de6-11e2-8af1-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/3dc2f956-3de6-11e2-8af1-00151736994a is 6490578919254224179
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a is 12000046156850729353
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a is 5393521929904432319
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a is 12367582447121855137
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:170[1]: Destroyed geom zfs::vdev.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:118[1]: Created geom and consumer for gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19177fb9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19177fb9-25fa-11e2-9ab0-00151736994a is 16068408191032711512
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a is 9922754965837443026
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/3dc2f956-3de6-11e2-8af1-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/3dc2f956-3de6-11e2-8af1-00151736994a is 6490578919254224179
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a is 12000046156850729353
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a is 5393521929904432319
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a is 12367582447121855137
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:170[1]: Destroyed geom zfs::vdev.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:118[1]: Created geom and consumer for gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19177fb9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19177fb9-25fa-11e2-9ab0-00151736994a is 16068408191032711512
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a is 9922754965837443026
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/3dc2f956-3de6-11e2-8af1-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/3dc2f956-3de6-11e2-8af1-00151736994a is 6490578919254224179
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a is 12000046156850729353
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a is 5393521929904432319
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a is 12367582447121855137
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:170[1]: Destroyed geom zfs::vdev.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:118[1]: Created geom and consumer for gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19177fb9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19177fb9-25fa-11e2-9ab0-00151736994a is 16068408191032711512
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a is 9922754965837443026
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/3dc2f956-3de6-11e2-8af1-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/3dc2f956-3de6-11e2-8af1-00151736994a is 6490578919254224179
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a is 12000046156850729353
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a is 5393521929904432319
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a is 12367582447121855137
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:170[1]: Destroyed geom zfs::vdev.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:118[1]: Created geom and consumer for gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19177fb9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19177fb9-25fa-11e2-9ab0-00151736994a is 16068408191032711512
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a is 9922754965837443026
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/3dc2f956-3de6-11e2-8af1-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/3dc2f956-3de6-11e2-8af1-00151736994a is 6490578919254224179
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a is 12000046156850729353
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a is 5393521929904432319
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a is 12367582447121855137
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:170[1]: Destroyed geom zfs::vdev.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:118[1]: Created geom and consumer for gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19177fb9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19177fb9-25fa-11e2-9ab0-00151736994a is 16068408191032711512
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a is 9922754965837443026
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/3dc2f956-3de6-11e2-8af1-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/3dc2f956-3de6-11e2-8af1-00151736994a is 6490578919254224179
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a is 12000046156850729353
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a is 5393521929904432319
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:386[1]: Found provider by name /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:97[1]: Attaching to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_attach:138[1]: Created consumer for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:241[1]: Reading guid from gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a...
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_read_guid:275[1]: guid for gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a is 12367582447121855137
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_open_by_path:401[1]: guid match for provider /dev/gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19177fb9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/3dc2f956-3de6-11e2-8af1-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:158[1]: Closing access to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:162[1]: Destroyed consumer to gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a.
Mar 17 17:03:31 mfsbsd kernel: vdev_geom_detach:170[1]: Destroyed geom zfs::vdev.

 

[HHawk]

I am now setting up the swapfiles and running the other command as you mentioned.

It's now busy:

Code:

Traversing all blocks to verify checksums ...

 

[paleoN]

Well I found this in the logs, hopefully this helps?

Was that all of it? I was hoping it was going to say something about the import failure. Oh well.

Code:

Traversing all blocks to verify checksums ...

This will take some hours assuming it doesn't error out earlier.

 

[HHawk]

Here is a more complete log: pastebin

Probably still not what you expected, but there is nothing more than that.

Okay I will wait, hopefully it will be before I go to bed though.

 

[HHawk]

Well you were right...

An error:

Code:

Traversing all blocks to verify checksums ...
zdb_blkptr_cb: Got error 122 reading <21, 0, 0, 860> DVA[0]=<0:5504e13e000:3000> DVA[1]=<0:33053c25000:3000> [L0 DMU dnode] fletcher4 lzjb LE contiguous unique double size=4000L/600P birth=7504010215231962958L/6759058615752982527P fill=5646894353326886812 cksum=202020280065cdbf:2020202020202020:2020202020202020:2020202020202020 -- skipping
Segmentation fault (core dumped)
root@mfsbsd:/root # 

 

[HHawk]

Well you were right...

An error:

Code:

Traversing all blocks to verify checksums ...
zdb_blkptr_cb: Got error 122 reading <21, 0, 0, 860> DVA[0]=<0:5504e13e000:3000> DVA[1]=<0:33053c25000:3000> [L0 DMU dnode] fletcher4 lzjb LE contiguous unique double size=4000L/600P birth=7504010215231962958L/6759058615752982527P fill=5646894353326886812 cksum=202020280065cdbf:2020202020202020:2020202020202020:2020202020202020 -- skipping
Segmentation fault (core dumped)
root@mfsbsd:/root # 

I am now doing that command again after doing:

Code:

set zfs_recover=1
set aok=1

Don't know if it works, but saw it here: http://sigtar.com/2009/10/19/opensolaris-zfs-recovery-after-kernel-panic/

 

[HHawk]

Same error again...

 

[paleoN]

Don't know if it works, but saw it here: http://sigtar.com/2009/10/19/opensolaris-zfs-recovery-after-kernel-panic/

Well, those commands are for Solaris based OSes.

Same error again...

The exact same error or similar?

Do you have another machine you can temporarily stick the drives in, even e.g. your desktop? The disks do not appear to be in ill-health and with the scenario you described I don't know when garbage could have been scribbled over the pool. Moving the disks essential would rule out any other hardware issues with the current machine. If you did get the same error then you can just move everything back.

 

[HHawk]

Well, those commands are for Solaris based OSes.

The exact same error or similar?

Do you have another machine you can temporarily stick the drives in, even e.g. your desktop? The disks do not appear to be in ill-health and with the scenario you described I don't know when garbage could have been scribbled over the pool. Moving the disks essential would rule out any other hardware issues with the current machine. If you did get the same error then you can just move everything back.

Exactly the same as this one:

Code:

Traversing all blocks to verify checksums ...
zdb_blkptr_cb: Got error 122 reading <21, 0, 0, 860> DVA[0]=<0:5504e13e000:3000> DVA[1]=<0:33053c25000:3000> [L0 DMU dnode] fletcher4 lzjb LE contiguous unique double size=4000L/600P birth=7504010215231962958L/6759058615752982527P fill=5646894353326886812 cksum=202020280065cdbf:2020202020202020:2020202020202020:2020202020202020 -- skipping
Segmentation fault (core dumped)
root@mfsbsd:/root #

Do you have another machine you can temporarily stick the drives in, even e.g. your desktop?

No not really, I just finished my watercooled desktop PC, so that's not an option. And the HTPC I have is mini-itx and has absolutely no room for 6 HD's.
I even think my work PC at work doesn't have the space for 6 hd's.

Well, those commands are for Solaris based OSes.

The command you gave me on the previous page:

Code:

zdb -e -bcsvL storage

Was also on that page, so that's why I tried it anyways.

Guess we are out of options right?

Than I will have tell my wife that we also lost our wedding pictures (amongst other valuable stuff). I was postponing this, because I still had hope we could rescue at least some stuff.

Anyways, guess I will call this a final regarding FreeNAS. I never, ever experienced a loss of data like this. Not even in Windows with several crashes in RAID 0 over the past few years.
Come to think; I could have run Freenas in RAID 0 with 2 disks or so. If I had a crash (or whatever) like this, I would also have lost all my data. Not much change with situation.

If you have any other way to secure any data, please share, but I am guessing I am out of options now...

 

[paleoN]

No not really, I just finished my watercooled desktop PC, so that's not an option. And the HTPC I have is mini-itx and has absolutely no room for 6 HD's.
I even think my work PC at work doesn't have the space for 6 hd's.

How about 4 HDs, ada0-ada3? It's less than ideal, but would still allow a possible import. At this point anything with enough free SATA ports will do.

Guess we are out of options right?

No, I would prefer to rule out e.g. a controller problem before continuing though. If there is a hardware issue with the current machine the less writing attempted the better.

 

[ProtoSD]

I'm just trying to get caught up here, but why not temporarily buy a controller if you have an open pci slot, and then return it depending on the outcome?

Surely its cheaper than other options at the moment.

 

[cyberjock]

I have still been watching this thread, and I really think that before you give up all hope you try to use the drives on another computer that you can connect them to. Even if you have to let a drive or 2 sit outside the case with the SATA and power cords, its better than giving up at this point. I think all of us trying to help are convince that something catastrophic happened, but are at a loss to understand what it would be. You said the loss of power isn't a potential cause and I can't think of anything else that could cause this kind of corruption except perhaps a broken SATA controller.

 

[ProtoSD]

For me, leaving a drive out of the pool is definitely not an option. We're dealing with unknown variables and I think its better to have as many *knowns* in the equation as possible. If it were me, and the data was important, I would go *rent* a controller from somewhere even if it meant spending $150-$200.

 

[HHawk]

Okay I will do a search tomorrow and see with what I can come up with. Maybe I can borrow one from work, if it's PCI or PCIe (not PCI-X).

But what is the chance that it's the onboard controller? And wouldn't I have noticed something weird before?
And more importantly, what are the chances of (partial) data recovery if it's the onboard controller (or not)...?

Anyways, I call it a day. Been spending all weekend on this NAS. :(

Thank you all once again for providing help so far.

 

[KMR]

I'm no expert but wouldn't it be easier to rip apart your new water cooled desktop than tell your wife you lost the wedding pictures? Most new higher end motherboards have 6 SATA ports, so why not yank out the hard drives from your desktop and stick in the FreeNAS drives along with the USB stick?