Trying to get back the files - wont boot now

[melloa]

Ok I went through the log as pointed out, but I couldnt see any major flaws that I understood to be troubles there.

Get the entire file in a google drive or similar and PM the link if you me to look. Not a SME, but two pair of two eyes = four eyes.

Should I see a volume there now? All it says under "Volumes" is "No entry has been found".

When you go to the function to start the process, you will see the volume(s) available for importing. After that, it will appear on your storage.

 

[melloa]

Guys,

Went through the log and there are no errors. All detected during normal boot:

Code:

CPU: Intel(R) Core(TM) i5-3570 CPU @ 3.40GHz (3392.36-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306a9  Family=0x6  Model=0x3a  Stepping=9

real memory  = 17706254336 (16886 MB)
avail memory = 16484724736 (15721 MB)

re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xe000-0xe0ff

ZFS filesystem version: 5
ZFS storage pool version: features support (5000)

uhub5 on uhub0
uhub5: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
ugen2.2: <SanDisk Ultra Fit> at usbus2
umass0 on uhub3
umass0: <SanDisk Ultra Fit, class 0/0, rev 3.00/1.00, addr 1> on usbus2
umass0:  SCSI over Bulk-Only; quirks = 0x8100
umass0:5:0: Attached to scbus5

ada0: <WDC WD20EFRX-68AX9N0 80.00A80> ACS-2 ATA SATA 3.x device
da0: <SanDisk Ultra Fit 1.00> Removable Direct Access SPC-4 SCSI device
ada1: <WDC WD20EFRX-68AX9N0 80.00A80> ACS-2 ATA SATA 3.x device
ada2: <WDC WD20EFRX-68AX9N0 80.00A80> ACS-2 ATA SATA 3.x device
ada3: <WDC WD20EFRX-68AX9N0 80.00A80> ACS-2 ATA SATA 3.x device

random: unblocking device.
Trying to mount root from zfs:freenas-boot/ROOT/default []...
re0: link state changed to UP
GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
GEOM_MIRROR: Device mirror/swap0 launched (2/2).
GEOM_MIRROR: Device mirror/swap1 launched (2/2).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:	 Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:	 Crypto: hardware
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/8/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI>
re0: link state changed to DOWN
re0: link state changed to UP

Any clues why the pool issues @sizetwo is having?

 

[kdragon75]

I think if zpool import -f CAUSED a reboot, we need a fresh download and USB drive, memtest+, and another try with zpool import -f. Thats SHOULD NOT cause a reboot unless there's a hardware or corrupted software issue.

 

[sizetwo]

I think if zpool import -f CAUSED a reboot, we need a fresh download and USB drive, memtest+, and another try with zpool import -f. Thats SHOULD NOT cause a reboot unless there's a hardware or corrupted software issue.

Well, I guess my only option is for another USB drive then. This would be the third one Im trying. Is FreeNAS really that finicky when it comes to choice of USB drive? I will see if I can get a hold of the one suggested in the beginning of this thread.

 

[melloa]

Is FreeNAS really that finicky when it comes to choice of USB drive?

Never had problems with SanDisks. I have one running 9.10 for three years on a remote site without maintenance, that I won't update due to the box not meeting memory minimum specs - it's running on a HP desktop with 4 GB - Only 2 TiB storage; Had at home for two years, two on a i5/32GB/ASRock/40TiB.

This would be the third one Im trying.

If the one in use is new, I don't this that is what's causing the problem. Unfortunately I didn't see anything on the logs giving any clue. For sure something at the hardware level is causing this issue, as it worked before and now is misbehaving.

 

[sizetwo]

I think if zpool import -f CAUSED a reboot, we need a fresh download and USB drive, memtest+, and another try with zpool import -f. Thats SHOULD NOT cause a reboot unless there's a hardware or corrupted software issue.

Ok. Bought a new USB drive. Didnt have Kingston, but an older San Disk USB 2. Tried the zpool import -f described earlier once more. It just restarts. Does give some output before automatically restarting though. So if its not the USB drives, could it be the memory thats causing it? Thats the only thing I can think of that could be causing this... Is there a memory tester with the FreeNAS installation, or can that be downloaded some how through the shell? :/

 

[kdragon75]

Ok. Bought a new USB drive. Didnt have Kingston, but an older San Disk USB 2. Tried the zpool import -f described earlier once more. It just restarts. Does give some output before automatically restarting though. So if its not the USB drives, could it be the memory thats causing it? Thats the only thing I can think of that could be causing this... Is there a memory tester with the FreeNAS installation, or can that be downloaded some how through the shell? :/

Almost any OS install disk should have a memory test option.

 

[sizetwo]

OK some testing. Removed 8GB of memory to see if one of the pairs were corrupt some how. Tested with both pairs, no difference. When it reboots while doing the zpool import -f command described earlier in the thread it does say that it logs the data. I cant seem quite to find it, but I looked under data/crash/ and found textdump.tar.last.gz. Unrared this file, and a large file with data appeared. I was assuming the last part of that file included what I was looking for? Either way, Ive pasted the last part untill the panic, the last part of the document. Please let me know if this is some how usefull. Im starting to think its not the USB Drive nor the RAM thats the problem, but rather something else.

Code:

<118>Setting hostuuid: 05b5c1ce-aaca-11e8-b537-80ee73328d47.
<118>Setting hostid: 0x64318471.
<118>Starting file system checks:
<118>Mounting local filesystems:.
<118>Beginning ZFS volume imports
<118>
<118>
<118>ZFS volume imports complete
<118>ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/nss /usr/local/lib/perl5/5.24/mach/CORE
<118>32-bit compatibility ldconfig path:
<118>Loading kernel modules:
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/8/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI>
<118>Setting hostname: freenas.local.
<118>Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,NET_ETHER,NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
<118>Feeding entropy: .
<5>re0: link state changed to DOWN
<118>Starting dhclient.
<118>re0: no link .....
<5>re0: link state changed to UP
<118> got link
<118>DHCPDISCOVER on re0 to 255.255.255.255 port 67 interval 5
<118>DHCPOFFER from 192.168.1.1
<118>DHCPREQUEST on re0 to 255.255.255.255 port 67
<118>DHCPACK from 192.168.1.1
<118>bound to 192.168.1.17 -- renewal in 43200 seconds.
<118>Starting Network: lo0 re0.
<118>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
<118>	options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
<118>	inet6 ::1 prefixlen 128 
<118>	inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2 
<118>	inet 127.0.0.1 netmask 0xff000000 
<118>	nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
<118>	groups: lo 
<118>re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
<118>	options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
<118>	ether 80:ee:73:32:8d:47
<118>	hwaddr 80:ee:73:32:8d:47
<118>	inet 192.168.1.17 netmask 0xffffff00 broadcast 192.168.1.255 
<118>	nd6 options=9<PERFORMNUD,IFDISABLED>
<118>	media: Ethernet autoselect (1000baseT <full-duplex>)
<118>	status: active
<118>Starting devd.
<118>add host 127.0.0.1: gateway lo0 fib 0: route already in table
<118>add host ::1: gateway lo0 fib 0: route already in table
<118>add net fe80::: gateway ::1
<118>add net ff02::: gateway ::1
<118>add net ::ffff:0.0.0.0: gateway ::1
<118>add net ::0.0.0.0: gateway ::1
<118>Starting syslog_ng.
<118>Creating and/or trimming log files.
<118>Starting watchdogd.
<118>Setting up system for textdumps.
<118>debug.ddb.textdump.pending: 0 -> 1
<118>debug.debugger_on_panic: 1 -> 1
<118>debug.ddb.capture.bufsize: 49152 -> 524288
<118>Alarm clock
<118>Updating motd:.
<118>Mounting late filesystems:.
<118>Starting ntpd.
<118>Can't load /usr/local/etc/smb4.conf - run testparm to debug it
<118>Syncing disks...
<118>
<118>[2K[A[2KTotal Progress: [________________________________________] 0.00%[2K[A[2KTotal Progress: [########################################] 100.00%
<118>Starting smartd_daemon.
<118>Starting pbid...
<118>Performing sanity check on nginx configuration:
<118>nginx: the configuration file /usr/local/etc/nginx/nginx.conf syntax is ok
<118>nginx: configuration file /usr/local/etc/nginx/nginx.conf test is successful
<118>Starting nginx.
<118>Starting dbus.
<118>Starting mdnsd.
<118>* [I|O|C] starting jails... 
<118>Aug 28 11:17:30 freenas smartd[2432]: Unable to register device /dev/da1 (no Directive -d removable). Exiting.
<118>IOCAGE_SKIP is TRUE or an RC operation, not activating a pool.
<118>Please manually issue iocage activate POOL
<118>Starting consul_alerts.
<118>Starting consul.
<118>Starting collectd.
<118>plugin_load: plugin "aggregation" successfully loaded.
<118>plugin_load: plugin "cpu" successfully loaded.
<118>plugin_load: plugin "cputemp" successfully loaded.
<118>plugin_load: plugin "ctl" successfully loaded.
<118>plugin_load: plugin "df" successfully loaded.
<118>plugin_load: plugin "disk" successfully loaded.
<118>plugin_load: plugin "exec" successfully loaded.
<118>plugin_load: plugin "geom_stat" successfully loaded.
<118>plugin_load: plugin "interface" successfully loaded.
<118>plugin_load: plugin "load" successfully loaded.
<118>plugin_load: plugin "memory" successfully loaded.
<118>plugin_load: plugin "network" successfully loaded.
<118>plugin_load: plugin "processes" successfully loaded.
<118>plugin_load: plugin "rrdtool" successfully loaded.
<118>plugin_load: plugin "swap" successfully loaded.
<118>plugin_load: plugin "uptime" successfully loaded.
<118>Flushed all rules.
<118>Waiting up to 5 seconds for ixdiagnose to finish... 5 4 3 2 done.
<118>Starting zfsd.
<118>Configuring syscons: blanktime.
<118>Starting cron.
<118>
<118>Tue Aug 28 11:17:39 PDT 2018
panic: Solaris(panic): blkptr at 0xfffffe0011ac1680 has invalid CHECKSUM 0
cpuid = 3
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0234a44820
vpanic() at vpanic+0x186/frame 0xfffffe0234a448a0
panic() at panic+0x43/frame 0xfffffe0234a44900
vcmn_err() at vcmn_err+0xcf/frame 0xfffffe0234a44a30
zfs_panic_recover() at zfs_panic_recover+0x5a/frame 0xfffffe0234a44a90
zfs_blkptr_verify() at zfs_blkptr_verify+0x83/frame 0xfffffe0234a44ad0
zio_read() at zio_read+0x2c/frame 0xfffffe0234a44b10
spa_load_verify_cb() at spa_load_verify_cb+0x174/frame 0xfffffe0234a44b80
traverse_visitbp() at traverse_visitbp+0x235/frame 0xfffffe0234a44c40
traverse_visitbp() at traverse_visitbp+0x440/frame 0xfffffe0234a44d00
traverse_dnode() at traverse_dnode+0xc7/frame 0xfffffe0234a44d60
traverse_visitbp() at traverse_visitbp+0x92c/frame 0xfffffe0234a44e20
traverse_visitbp() at traverse_visitbp+0x440/frame 0xfffffe0234a44ee0
traverse_visitbp() at traverse_visitbp+0x440/frame 0xfffffe0234a44fa0
traverse_visitbp() at traverse_visitbp+0x440/frame 0xfffffe0234a45060
traverse_visitbp() at traverse_visitbp+0x440/frame 0xfffffe0234a45120
traverse_visitbp() at traverse_visitbp+0x440/frame 0xfffffe0234a451e0
traverse_dnode() at traverse_dnode+0xc7/frame 0xfffffe0234a45240
traverse_visitbp() at traverse_visitbp+0x6b3/frame 0xfffffe0234a45300
traverse_impl() at traverse_impl+0x22b/frame 0xfffffe0234a45420
traverse_pool() at traverse_pool+0x16d/frame 0xfffffe0234a454f0
spa_load() at spa_load+0x1c0a/frame 0xfffffe0234a455e0
spa_load_best() at spa_load_best+0x6e/frame 0xfffffe0234a45640
spa_import() at spa_import+0x1a3/frame 0xfffffe0234a456f0
zfs_ioc_pool_import() at zfs_ioc_pool_import+0x163/frame 0xfffffe0234a45740
zfsdev_ioctl() at zfsdev_ioctl+0x6d5/frame 0xfffffe0234a457e0
devfs_ioctl_f() at devfs_ioctl_f+0x128/frame 0xfffffe0234a45840
kern_ioctl() at kern_ioctl+0x281/frame 0xfffffe0234a458b0
sys_ioctl() at sys_ioctl+0x15c/frame 0xfffffe0234a45980
amd64_syscall() at amd64_syscall+0xa4a/frame 0xfffffe0234a45ab0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0234a45ab0
--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80120022a, rsp = 0x7fffffffbd18, rbp = 0x7fffffffbd90 ---
KDB: enter: panic

Does this make sense to anyone?

 

[melloa]

Is there a memory tester with the FreeNAS installation, or can that be downloaded some how through the shell? :/

Check the resources. One thing that nobody does is test memory and burn disks :(

or go here: http://memtest.org/

 

[sizetwo]

Check the resources. One thing that nobody does is test memory and burn disks :(

or go here: http://memtest.org/

So you think the log I posted is related to memory issues?

 

[kdragon75]

panic: Solaris(panic): blkptr at 0xfffffe0011ac1680 has invalid CHECKSUM 0

That's the issue, whats causing the issue, I can't say from that. I surprised a block pointer would cause an issue unless it on the same drive as the OS. Do you have another machine you could try?

 

[melloa]

So you think the log I posted is related to memory issues?

No, didn't read the log. Was replying to your question previous post.

 

[sizetwo]

That's the issue, whats causing the issue, I can't say from that. I surprised a block pointer would cause an issue unless it on the same drive as the OS. Do you have another machine you could try?

No I dont have one available at the moment. Thanks for everyone that tried to help me, but it seems like we are at the end of the road. I doubt there is a hardware issue here (though of course there could be). The Shuttle box Im using has never had any problems before, and its strange that it should have that now. Of course, I guess I will never know. Since the log I posted apparently doesnt give any help to where the problem could be, I guess this is a lost cause. I might have backups of some of the data on some other drives somewhere, so it might not be a complete loss. Anyway, thanks for trying to help me out! :)

 

[melloa]

I might have backups of some of the data on some other drives somewhere, so it might not be a complete loss.

Your volume was there, so not yet sure you lost it. It you want to try to be sure, assume you have a spare sata port there, get a small drive with freebsd. Installation is easy. I'll send you the notes I took when I first installed, so you can try to test.