Files / share gone after replacing motherboard

[ayotech]

About 8 months ago my motherboard died ( ASRock C2550D4I ) and had to wait some months for a warranty replacement.

Yesterday I finally took the time to reinstall the new board, updated BMC and firmware before connecting the data drives and the boot drive ( USB stick ).

The system boots up, but the user and share I created is gone. The volume is there, but I cant see any files. As I remember the volume was encrypted.

Any chance for getting the files back ?

 

[Ericloewe]

Your only hope is if you have the keys, that's the whole point of encryption.

 

[ayotech]

I have password and geli.key, but dont know which steps to take now

 

[Ericloewe]

The manual is your friend.

If you have the recovery key, don't enter a password. If you have the normal key, enter your password.

 

[ayotech]

So I need to detach the volume first and then import it again ?

 

[Ericloewe]

You're saying the pool is imported? What's the output of:
zpool status
geli status
zfs list -r

 

[ayotech]

Code:

pool: freenas-boot
 state: ONLINE
  scan: none requested
config:

		NAME		STATE	 READ WRITE CKSUM
		freenas-boot  ONLINE	   0	 0	 0
		  da0p2	 ONLINE	   0	 0	 0

errors: No known data errors

  pool: mainpool
 state: ONLINE
  scan: none requested
config:

		NAME											STATE	 READ WRITE CKSUM
		mainpool										ONLINE	   0	 0	 0
		  raidz2-0									  ONLINE	   0	 0	 0
			gptid/fc9c81cb-290a-11e7-a2c5-d05099c0c311  ONLINE	   0	 0	 0
			gptid/fe8f3196-290a-11e7-a2c5-d05099c0c311  ONLINE	   0	 0	 0
			gptid/0086bffa-290b-11e7-a2c5-d05099c0c311  ONLINE	   0	 0	 0
			gptid/0289d555-290b-11e7-a2c5-d05099c0c311  ONLINE	   0	 0	 0
			gptid/046bc5a9-290b-11e7-a2c5-d05099c0c311  ONLINE	   0	 0	 0
			gptid/06727917-290b-11e7-a2c5-d05099c0c311  ONLINE	   0	 0	 0
			gptid/07eb3705-290b-11e7-a2c5-d05099c0c311  ONLINE	   0	 0	 0
			gptid/09a97061-290b-11e7-a2c5-d05099c0c311  ONLINE	   0	 0	 0

errors: No known data errors

Code:

	  Name  Status  Components
ada0p1.eli  ACTIVE  ada0p1
ada1p1.eli  ACTIVE  ada1p1
ada2p1.eli  ACTIVE  ada2p1
ada3p1.eli  ACTIVE  ada3p1
ada4p1.eli  ACTIVE  ada4p1
ada5p1.eli  ACTIVE  ada5p1
ada6p1.eli  ACTIVE  ada6p1
ada7p1.eli  ACTIVE  ada7p1

Code:

NAME														USED  AVAIL  REFER  MOUNTPOINT
freenas-boot												647M  6.57G	64K  none
freenas-boot/ROOT										   640M  6.57G	29K  none
freenas-boot/ROOT/Initial-Install							 1K  6.57G   636M  legacy
freenas-boot/ROOT/Wizard-2017-04-24_13:14:04				  1K  6.57G   637M  legacy
freenas-boot/ROOT/default								   640M  6.57G   637M  legacy
freenas-boot/grub										  6.35M  6.57G  6.35M  legacy
mainpool												   22.3M  20.0T   188K  /mnt/mainpool
mainpool/.system										   20.5M  20.0T   205K  legacy
mainpool/.system/configs-7c35bc62b22f460fb3766e1c156d5c44   188K  20.0T   188K  legacy
mainpool/.system/cores									 1.15M  20.0T  1.15M  legacy
mainpool/.system/rrd-7c35bc62b22f460fb3766e1c156d5c44	  17.8M  20.0T  17.8M  legacy
mainpool/.system/samba4									 665K  20.0T   665K  legacy
mainpool/.system/syslog-7c35bc62b22f460fb3766e1c156d5c44	589K  20.0T   589K  legacy

 

[Ericloewe]

What's the output of zpool history mainpool | head and zpool history mainpool | tail?

 

[ayotech]

Code:

History for 'mainpool':
2017-04-24.18:28:26 zpool create -o cachefile=/data/zfs/zpool.cache -o failmode=continue -o autoexpand=on -O compression=lz4 -O aclmode=passthrough -O aclinherit=passthrough -f -m /mainpool -o altroot=/mnt mainpool raidz2 /dev/gptid/fc9c81cb-290a-11e7-a2c5-d05099c0c311 /dev/gptid/fe8f3196-290a-11e7-a2c5-d05099c0c311 /dev/gptid/0086bffa-290b-11e7-a2c5-d05099c0c311 /dev/gptid/0289d555-290b-11e7-a2c5-d05099c0c311 /dev/gptid/046bc5a9-290b-11e7-a2c5-d05099c0c311 /dev/gptid/06727917-290b-11e7-a2c5-d05099c0c311 /dev/gptid/07eb3705-290b-11e7-a2c5-d05099c0c311 /dev/gptid/09a97061-290b-11e7-a2c5-d05099c0c311
2017-04-24.18:28:31 zfs inherit mountpoint mainpool
2017-04-24.18:28:31 zpool set cachefile=/data/zfs/zpool.cache mainpool
2017-04-24.18:28:36 zfs create -o mountpoint=legacy mainpool/.system
2017-04-24.18:28:36 zfs create -o mountpoint=legacy mainpool/.system/cores
2017-04-24.18:28:36 zfs create -o mountpoint=legacy mainpool/.system/samba4
2017-04-24.18:28:37 zfs create -o mountpoint=legacy mainpool/.system/syslog-7c35bc62b22f460fb3766e1c156d5c44
2017-04-24.18:28:37 zfs create -o mountpoint=legacy mainpool/.system/rrd-7c35bc62b22f460fb3766e1c156d5c44
2017-04-24.18:28:41 zfs create -o mountpoint=legacy mainpool/.system/configs-7c35bc62b22f460fb3766e1c156d5c44

Code:

2017-04-24.18:28:36 zfs create -o mountpoint=legacy mainpool/.system/cores
2017-04-24.18:28:36 zfs create -o mountpoint=legacy mainpool/.system/samba4
2017-04-24.18:28:37 zfs create -o mountpoint=legacy mainpool/.system/syslog-7c35bc62b22f460fb3766e1c156d5c44
2017-04-24.18:28:37 zfs create -o mountpoint=legacy mainpool/.system/rrd-7c35bc62b22f460fb3766e1c156d5c44
2017-04-24.18:28:41 zfs create -o mountpoint=legacy mainpool/.system/configs-7c35bc62b22f460fb3766e1c156d5c44
2018-08-08.20:35:51 zpool import -c /data/zfs/zpool.cache.saved -o cachefile=none -R /mnt -f 18276615913544939020
2018-08-08.20:35:51 zpool set cachefile=/data/zfs/zpool.cache mainpool
2018-08-09.16:58:13 zpool import -c /data/zfs/zpool.cache.saved -o cachefile=none -R /mnt -f 18276615913544939020
2018-08-09.16:58:13 zpool set cachefile=/data/zfs/zpool.cache mainpool

 

[Ericloewe]

A few things:

• That pool of yours is basically empty. It's sitting at a couple of MB.
• It's also not encrypted.
• It's seen suspiciously little activity in the history between 2017-04-24 and 2018-08-09. You did not create a single dataset or take any snapshots or anything?

So... What's the output of gpart list?

 

[ayotech]

Code:

Geom name: ada0
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada0p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: fc7043a1-290a-11e7-a2c5-d05099c0c311
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada0p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: fc9c81cb-290a-11e7-a2c5-d05099c0c311
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: ada0
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: ada1
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada1p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: fe5d3eda-290a-11e7-a2c5-d05099c0c311
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada1p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: fe8f3196-290a-11e7-a2c5-d05099c0c311
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: ada1
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 00580a84-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada2p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 0086bffa-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: ada2
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: ada3
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada3p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 025d2f23-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada3p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 0289d555-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: ada3
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: ada4
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada4p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 043bb325-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada4p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 046bc5a9-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: ada4
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: ada5
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada5p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 0640466a-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada5p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 06727917-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: ada5
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: ada6
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada6p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 07d94859-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada6p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 07eb3705-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: ada6
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: ada7
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 7814037134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada7p1
   Mediasize: 2147483648 (2.0G)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e1
   rawuuid: 097997a8-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 2147483648
   offset: 65536
   type: freebsd-swap
   index: 1
   end: 4194431
   start: 128
2. Name: ada7p2
   Mediasize: 3998639460352 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r1w1e2
   rawuuid: 09a97061-290b-11e7-a2c5-d05099c0c311
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 3998639460352
   offset: 2147549184
   type: freebsd-zfs
   index: 2
   end: 7814037127
   start: 4194432
Consumers:
1. Name: ada7
   Mediasize: 4000787030016 (3.6T)
   Sectorsize: 512
   Stripesize: 4096
   Stripeoffset: 0
   Mode: r2w2e5

Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 15630302
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: da0p1
   Mediasize: 524288 (512K)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 17408
   Mode: r0w0e0
   rawuuid: fa31339c-291b-11e7-a8da-d05099c0c311
   rawtype: 21686148-6449-6e6f-744e-656564454649
   label: (null)
   length: 524288
   offset: 17408
   type: bios-boot
   index: 1
   end: 1057
   start: 34
2. Name: da0p2
   Mediasize: 8002166784 (7.5G)
   Sectorsize: 512
   Stripesize: 0
   Stripeoffset: 544768
   Mode: r1w1e1
   rawuuid: fa4866ac-291b-11e7-a8da-d05099c0c311
   rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
   label: (null)
   length: 8002166784
   offset: 544768
   type: freebsd-zfs
   index: 2
   end: 15630295
   start: 1064
Consumers:
1. Name: da0
   Mediasize: 8002732032 (7.5G)
   Sectorsize: 512
   Mode: r1w1e2

I started to transfer my CD collection ( FLAC files ) to the NAS, so it contained 100+ albums. I didnt do any snapshots or anything. I still have all the CD's so nothing is lost but time if it cant be restored.

 

[Ericloewe]

I have no idea what you did, exactly, but unless your 100+ albums compressed down to less than 20 MB total, they're not on your server.

Seriously, I have no idea what's going on. Clearly you didn't destroy the old pool an create a new one, because zpool history says otherwise. But your pool is rather empty.