All my ZFS volumes crashed. Plse help.

[Thomas_VDB]

I have FreeNAS 8.3.1 running on my HP N40L Microserver for about 2 years. Now running version FreeNAS-8.3.1-RELEASE-p2-x64 (r12686+b770da6_dirty) for a few months with no issues.
I have 4 disks installed (JBOD) :
1. Data : ZFS
2. Backup1 : ZFS
3. Backup2 : ZFS
4. Movies : UFS

About a week ago, FreeNAS reported "Status : UNKNOWN" for all 3 ZFS volumes. I was still able to access all shares. So I made a backup from my Data to my local PC drive and thought "I should look into this asap." But now a week later, I can't access the shares anymore and FreeNAS now reports "error getting available space" and "error getting total space" for all ZFS volumes. Status is still UNKNOWN.
My UFS volume is still healthy and accessible.

When I open up Putty and ask for zpool status or zpool history, it returns 'bus error'.

Using the GUI, I detached the backup2 ZFS-volume, hoping to be able to auto-import it again. Detaching was succesfull, but when clicking "Auto import volumes, I shows no volumes.

I have also rebooted a few times but no luck.

Can anybody please advise?

 

[cyberjock]

Post the output of the following commands:

gpart list
gpart status
zpool import

Have you tried a new USB stick with a fresh install of FreeNAS? If not, you might want to, but keep 8.3.1 and don't import your config.

You may also want to do a RAM test...(www.memtest.org) 3 passes will take a few hours.

Also post your hardware specs.

 

[Thomas_VDB]

Hi,

thanks for your quick help!!

This is the output of the commands :

[root@freenas] ~# gpart list
Geom name: ada0
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada0p1
Mediasize: 1000204851712 (931G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 17408
Mode: r1w1e2
rawuuid: b0dbb717-1e84-11e0-b48e-0015f2a8dc54
rawtype: 516e7cb6-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 1000204851712
offset: 17408
type: freebsd-ufs
index: 1
end: 1953525134
start: 34
Consumers:
1. Name: ada0
Mediasize: 1000204886016 (931G)
Sectorsize: 512
Mode: r1w1e3

Geom name: ada1
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 1953525134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada1p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 65536
Mode: r1w1e1
rawuuid: 01986498-f151-11e1-bf4d-e4115b138a8e
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: ada1p2
Mediasize: 998057319936 (929G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r0w0e0
rawuuid: 01afbf1d-f151-11e1-bf4d-e4115b138a8e
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 998057319936
offset: 2147549184
type: freebsd-zfs
index: 2
end: 1953525134
start: 4194432
Consumers:
1. Name: ada1
Mediasize: 1000204886016 (931G)
Sectorsize: 512
Mode: r1w1e2

Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 625142414
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 65536
Mode: r1w1e1
rawuuid: 6a1556ac-f5b5-11e1-ac8e-e4115b138a8e
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: ada2p2
Mediasize: 317925367296 (296G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r0w0e0
rawuuid: 6a2fa4b3-f5b5-11e1-ac8e-e4115b138a8e
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 317925367296
offset: 2147549184
type: freebsd-zfs
index: 2
end: 625142414
start: 4194432
Consumers:
1. Name: ada2
Mediasize: 320072933376 (298G)
Sectorsize: 512
Mode: r1w1e2

Geom name: ada3
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 488397134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada3p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 65536
Mode: r1w1e1
rawuuid: 820b1140-f5b5-11e1-ac8e-e4115b138a8e
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: ada3p2
Mediasize: 247911783936 (230G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r0w0e0
rawuuid: 822011d3-f5b5-11e1-ac8e-e4115b138a8e
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 247911783936
offset: 2147549184
type: freebsd-zfs
index: 2
end: 488397134
start: 4194432
Consumers:
1. Name: ada3
Mediasize: 250059350016 (232G)
Sectorsize: 512
Mode: r1w1e2

Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 7819263
first: 63
entries: 4
scheme: MBR
Providers:
1. Name: da0s1
Mediasize: 988291584 (942M)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 32256
Mode: r1w0e1
attrib: active
rawtype: 165
length: 988291584
offset: 32256
type: freebsd
index: 1
end: 1930319
start: 63
2. Name: da0s2
Mediasize: 988291584 (942M)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 988356096
Mode: r0w0e0
rawtype: 165
length: 988291584
offset: 988356096
type: freebsd
index: 2
end: 3860639
start: 1930383
3. Name: da0s3
Mediasize: 1548288 (1.5M)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 1976647680
Mode: r0w0e0
rawtype: 165
length: 1548288
offset: 1976647680
type: freebsd
index: 3
end: 3863663
start: 3860640
4. Name: da0s4
Mediasize: 21159936 (20M)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 1978195968
Mode: r1w1e2
rawtype: 165
length: 21159936
offset: 1978195968
type: freebsd
index: 4
end: 3904991
start: 3863664
Consumers:
1. Name: da0
Mediasize: 4003463168 (3.7G)
Sectorsize: 512
Mode: r2w1e4

Geom name: da0s1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1930256
first: 0
entries: 8
scheme: BSD
Providers:
1. Name: da0s1a
Mediasize: 988283392 (942M)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 40448
Mode: r1w0e1
rawtype: 0
length: 988283392
offset: 8192
type: !0
index: 1
end: 1930256
start: 16
Consumers:
1. Name: da0s1
Mediasize: 988291584 (942M)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 32256
Mode: r1w0e1

[root@freenas] ~# gpart status
Name Status Components
ada0p1 OK ada0
ada1p1 OK ada1
ada1p2 OK ada1
ada2p1 OK ada2
ada2p2 OK ada2
ada3p1 OK ada3
ada3p2 OK ada3
da0s1 OK da0
da0s2 OK da0
da0s3 OK da0
da0s4 OK da0
da0s1a OK da0s1

[root@freenas] ~# zpool import
Bus error

I will look into a fresh install and RAM test...

 

[Thomas_VDB]

Solved by doing clean install and auto-import volumes.
thx,
Thomas.

 

[cyberjock]

Shoo. Glad it worked out for you.