Importing Volume Showing Checksum Errors and Then Panics

koolcats123 · Feb 22, 2017

Code:

ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <WDC WD40EFRX-68WT0N0 82.00A82> ACS-2 ATA SATA 3.x device
ada0: Serial Number WD-WCC4E0YY99HK
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 3815447MB (7814037168 512 byte sectors)
ada0: quirks=0x1<4K>
ada0: Previously was known as ad4
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <WDC WD40EFRX-68WT0N0 82.00A82> ACS-2 ATA SATA 3.x device
ada1: Serial Number WD-WCC4E7EXPT4T
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 3815447MB (7814037168 512 byte sectors)
ada1: quirks=0x1<4K>
ada1: Previously was known as ad6
ada2 at ata2 bus 0 scbus2 target 0 lun 0
ada2: <ST4000DM000-1F2168 CC54> ACS-2 ATA SATA 3.x device
ada2: Serial Number Z3035Y35
ada2: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada2: 3815447MB (7814037168 512 byte sectors)
ada2: quirks=0x1<4K>
ada2: Previously was known as ad8
ada3 at ata3 bus 0 scbus3 target 0 lun 0
ada3: <ST4000DM000-2AE166 0001> ACS-3 ATA SATA 3.x device
ada3: Serial Number WDH0XV9N
ada3: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada3: 3815447MB (7814037168 512 byte sectors)
ada3: quirks=0x1<4K>
ada3: Previously was known as ad10
ada4 at ata4 bus 0 scbus4 target 0 lun 0
ada4: <ST4000DM000-2AE166 0001> ACS-3 ATA SATA 3.x device
ada4: Serial Number WDH0VVPR
ada4: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada4: 3815447MB (7814037168 512 byte sectors)
ada4: quirks=0x1<4K>
ada4: Previously was known as ad12
ada5 at ata5 bus 0 scbus5 target 0 lun 0
ada5: <WDC WD20EARX-008FB0 51.0AB51> ATA8-ACS SATA 3.x device
ada5: Serial Number WD-WCAZAH025808
ada5: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada5: 1907729MB (3907029168 512 byte sectors)
ada5: quirks=0x1<4K>
ada5: Previously was known as ad14
da0 at umass-sim0 bus 0 scbus7 target 0 lun 0
da0: <ADATA USB Flash Drive 1100> Removable Direct Access SPC-4 SCSI device
da0: Serial Number 14B2417581240014
da0: 400.000MB/s transfers
da0: 59200MB (121241600 512 byte sectors)
da0: quirks=0x2<NO_6_BYTE>
SMP: AP CPU #2 Launched!
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
Timecounter "TSC-low" frequency 1496630730 Hz quality 1000
Trying to mount root from zfs:freenas-boot/ROOT/default []...
<118>Loading early kernel modules:
GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
<118>savecore: reboot after panic: Solaris(panic): blkptr at 0xfffffe001362f2c0 has invalid CHECKSUM 0
<118>savecore: writing compressed core to /data/crash/textdump.tar.3.gz
<118>/data/crash/vmcore.3 not found
<118>Setting hostuuid: 5eda2040-5bcb-11d9-857a-5404a667a51d.
<118>Setting hostid: 0x92bf3fa0.
<118>No suitable dump device was found.
<118>Entropy harvesting: interrupts ethernet point_to_point swi.
<118>Starting file system checks:
<118>Mounting local file systems:.
<118>Beginning ZFS volume imports
<118>
<118>    Importing 17177318048554058877
<118>
<118><118>                                                                     spa=Extra async request task=1                                                                     txg 599593 open pool version 5000; software version 5000/5; uts  10.3-STABLE 1003510 amd64                                                                     spa=Extra async request task=32                                                                     txg 599595 import pool version 5000; software version 5000/5; uts  10.3-STABLE 1003510 amd64
<118>ZFS volume imports complete
<118>Loading kernel modules:
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/8/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI> UCP/8/48/0x3f8<EDG,THR,REA,WRI,INV,QUA,PRC> UCF/1/48/0x60<REA,WRI>
<118>Writing entropy file:.
<118>Setting hostname: freenas.local.
<118>ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat /usr/local/lib/nss /usr/local/lib/perl5/5.20/mach/CORE
<118>32-bit compatibility ldconfig path: /usr/lib32 /usr/local/lib32/compat
<5>re0: link state changed to DOWN
<118>Starting dhclient.
<118>re0: no link ......
<5>re0: link state changed to UP
<118> got link
<118>DHCPDISCOVER on re0 to 255.255.255.255 port 67 interval 4
<118>DHCPOFFER from 192.168.0.1
<118>DHCPREQUEST on re0 to 255.255.255.255 port 67
<118>DHCPACK from 192.168.0.1
<118>bound to 192.168.0.23 -- renewal in 60 seconds.
<118>Starting Network: lo0 re0.
<118>lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
<118>    options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
<118>    inet6 ::1 prefixlen 128
<118>    inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
<118>    inet 127.0.0.1 netmask 0xff000000
<118>    nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
<118>re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
<118>    options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
<118>    ether 54:04:a6:67:a5:1d
<118>    inet 192.168.0.23 netmask 0xffffff00 broadcast 192.168.0.255
<118>    nd6 options=9<PERFORMNUD,IFDISABLED>
<118>    media: Ethernet autoselect (1000baseT <full-duplex>)
<118>    status: active
<118>Starting devd.
ums0: <Logitech USB Laser Mouse, class 0/0, rev 2.00/56.01, addr 3> on usbus2
ums0: 8 buttons and [XYZT] coordinates ID=0
uhid0: <NOVATEK USB Keyboard, class 0/0, rev 1.10/1.04, addr 4> on usbus2
<118>Starting ums0 moused.
<118>add net fe80::: gateway ::1
<118>add net ff02::: gateway ::1
<118>add net ::ffff:0.0.0.0: gateway ::1
<118>add net ::0.0.0.0: gateway ::1
<118>Generating host.conf.
<118>Warning: unrecognized source [mdns]
<118>[: False: bad number
<118>Starting syslog_ng.
<118>Creating and/or trimming log files.
<118>Starting watchdogd.
GEOM_ELI: Device ada5p1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
<118>Setting up system for textdumps.
<118>debug.ddb.textdump.pending: 0 -> 1
<118>debug.debugger_on_panic: 1 -> 1
<118>No core dumps found.
<118>Alarm clock
<118>Updating motd:.
<118>Mounting late file systems:.
<118>Starting ntpd.
<118>Can't load /usr/local/etc/smb4.conf - run testparm to debug it
<118>/etc/rc: WARNING: failed precmd routine for vmware_guestd
<118>Performing sanity check on openssh configuration.
<118>Starting openssh.
<118>Starting smartd.
<118>Starting pbid...
<118>Performing sanity check on nginx configuration:
<118>nginx: the configuration file /usr/local/etc/nginx/nginx.conf syntax is ok
<118>nginx: configuration file /usr/local/etc/nginx/nginx.conf test is successful
<118>Starting nginx.
<118>Starting mdnsd.
<118>Starting dbus.
<118>Starting collectd.
<118>Flushed all rules.
<118>Waiting up to 5 seconds for ixdiagnose to finish... done.
<118>Starting zfsd.
<118>Configuring syscons: blanktime.
<118>Starting cron.
<118>
<118>Fri Feb 17 21:31:20 EST 2017
panic: Solaris(panic): blkptr at 0xfffffe00125382c0 has invalid CHECKSUM 0
cpuid = 3
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0456808360
kdb_backtrace() at kdb_backtrace+0x39/frame 0xfffffe0456808410
vpanic() at vpanic+0x126/frame 0xfffffe0456808450
panic() at panic+0x43/frame 0xfffffe04568084b0
vcmn_err() at vcmn_err+0xcf/frame 0xfffffe04568085e0
zfs_panic_recover() at zfs_panic_recover+0x60/frame 0xfffffe0456808640
zfs_blkptr_verify() at zfs_blkptr_verify+0xbe/frame 0xfffffe0456808680
zio_read() at zio_read+0x2f/frame 0xfffffe0456808710
spa_load_verify_cb() at spa_load_verify_cb+0x1b2/frame 0xfffffe0456808790
traverse_visitbp() at traverse_visitbp+0x293/frame 0xfffffe04568088d0
traverse_dnode() at traverse_dnode+0xd2/frame 0xfffffe0456808940
traverse_visitbp() at traverse_visitbp+0xaa8/frame 0xfffffe0456808a80
traverse_visitbp() at traverse_visitbp+0x7af/frame 0xfffffe0456808bc0
traverse_visitbp() at traverse_visitbp+0x7af/frame 0xfffffe0456808d00
traverse_visitbp() at traverse_visitbp+0x7af/frame 0xfffffe0456808e40
traverse_visitbp() at traverse_visitbp+0x7af/frame 0xfffffe0456808f80
traverse_visitbp() at traverse_visitbp+0x7af/frame 0xfffffe04568090c0
traverse_dnode() at traverse_dnode+0xd2/frame 0xfffffe0456809130
traverse_visitbp() at traverse_visitbp+0x591/frame 0xfffffe0456809270
traverse_impl() at traverse_impl+0x32e/frame 0xfffffe04568093b0
traverse_pool() at traverse_pool+0x17f/frame 0xfffffe0456809480
spa_load() at spa_load+0x1af9/frame 0xfffffe04568095c0
spa_load_best() at spa_load_best+0x6f/frame 0xfffffe0456809620
spa_import() at spa_import+0x23b/frame 0xfffffe04568096f0
zfs_ioc_pool_import() at zfs_ioc_pool_import+0xa4/frame 0xfffffe0456809740
zfsdev_ioctl() at zfsdev_ioctl+0x560/frame 0xfffffe04568097e0
devfs_ioctl_f() at devfs_ioctl_f+0x139/frame 0xfffffe0456809840
kern_ioctl() at kern_ioctl+0x255/frame 0xfffffe04568098b0
sys_ioctl() at sys_ioctl+0x140/frame 0xfffffe0456809990
amd64_syscall() at amd64_syscall+0x41e/frame 0xfffffe0456809ab0
Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0456809ab0
--- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x801a0280a, rsp = 0x7fffffffbcd8, rbp = 0x7fffffffbd50 ---
KDB: enter: panic

That was the output of msgbuf.txt file when i tried to import the volume "Hayes", i tried many different commends like readonly, -R and -f but with no luck. Doing research on similar problems lead me to check the memory, which i did using memtest for 24 hours and before that trying if freenas 10 would fix it. If you want to see my zfs volume see the link at the bottom of this post, Extra is just a jail volume. Right now i don't know if this can be fixed but it would be nice if anyone can help. :)

Specs;
Intel(R) Core(TM) i5-2320 CPU @ 3.00GHz
FreeNAS-9.10.2-U1
16GB Corsair Ram (no-ecc)
zpool import in shell;
http://i.imgur.com/HeqwPCT.png
System Specs;
http://i.imgur.com/xC4aMZ5.png

Robert Trevellyan · Feb 22, 2017

It looks like "Hayes" is a 4-disk RAIDZ1 vdev striped with a single disk vdev. My guess is the single disk is corrupted and your pool is gone.

Try posting, between CODE tags, the output of smartctl -x for that single disk.

SweetAndLow · Feb 22, 2017

When posting your hardware specs you need to actually tell us what hardware you have. Motherboard, CPU, ram, amount RAM, power supply, case... everything. You also have a pool with a strip disk. If that disk has any problems it will corrupt your entire pool. The only luck you could have would be to use 'zpool import -F Hayes' then backup all your data. This command will try and import your pool in recovery mode.

koolcats123 · Feb 22, 2017

Thanks for the quick answer, here is the output of the command;

Code:

[root@freenas] ~# zpool import
  pool: Extra
  id: 17177318048554058877
  state: ONLINE
 action: The pool can be imported using its name or numeric identifier.
 config:

  Extra  ONLINE
  gptid/d0a58623-d481-11e6-923b-5404a667a51d  ONLINE

  pool: Hayes
  id: 5553722501274720225
  state: ONLINE
 action: The pool can be imported using its name or numeric identifier.
 config:

  Hayes  ONLINE
  raidz1-0  ONLINE
  gptid/e648b649-ce43-11e6-923b-5404a667a51d  ONLINE
  gptid/e6f7b26e-ce43-11e6-923b-5404a667a51d  ONLINE
  gptid/e7ab7dda-ce43-11e6-923b-5404a667a51d  ONLINE
  gptid/e8603a4b-ce43-11e6-923b-5404a667a51d  ONLINE
  gptid/d39c0fad-d203-11e6-923b-5404a667a51d  ONLINE
[root@freenas] ~# glabel status
  Name  Status  Components
gptid/d39c0fad-d203-11e6-923b-5404a667a51d  N/A  ada0p2
gptid/e6397d0a-ce43-11e6-923b-5404a667a51d  N/A  ada1p1
gptid/e648b649-ce43-11e6-923b-5404a667a51d  N/A  ada1p2
gptid/e6e952cb-ce43-11e6-923b-5404a667a51d  N/A  ada2p1
gptid/e6f7b26e-ce43-11e6-923b-5404a667a51d  N/A  ada2p2
gptid/e79737bb-ce43-11e6-923b-5404a667a51d  N/A  ada3p1
gptid/e7ab7dda-ce43-11e6-923b-5404a667a51d  N/A  ada3p2
gptid/e84bee04-ce43-11e6-923b-5404a667a51d  N/A  ada4p1
gptid/e8603a4b-ce43-11e6-923b-5404a667a51d  N/A  ada4p2
gptid/d0951122-d481-11e6-923b-5404a667a51d  N/A  ada5p1
gptid/d0a58623-d481-11e6-923b-5404a667a51d  N/A  ada5p2
gptid/4f6c1ce3-f7be-11e6-9d6a-5404a667a51d  N/A  da0p1
gptid/d389cab4-d203-11e6-923b-5404a667a51d  N/A  ada0p1

[root@freenas] ~# smartctl -x /dev/ada0
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:  Western Digital Red
Device Model:  WDC WD40EFRX-68WT0N0
Serial Number:  WD-WCC4E0YY99HK
LU WWN Device Id: 5 0014ee 20cca9c7c
Firmware Version: 82.00A82
User Capacity:  4,000,787,030,016 bytes [4.00 TB]
Sector Sizes:  512 bytes logical, 4096 bytes physical
Rotation Rate:  5400 rpm
Device is:  In smartctl database [for details use: -P show]
ATA Version is:  ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:  Wed Feb 22 20:42:39 2017 PST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:  Unavailable
APM feature is:  Unavailable
Rd look-ahead is: Enabled
Write cache is:  Enabled
ATA Security is:  Disabled, NOT FROZEN [SEC1]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
  was never started.
  Auto Offline Data Collection: Enabled.
Self-test execution status:  (  0) The previous self-test routine completed
  without error or no self-test has ever
  been run.
Total time to complete Offline
data collection:  (54240) seconds.
Offline data collection
capabilities:  (0x7b) SMART execute Offline immediate.
  Auto Offline data collection on/off support.
  Suspend Offline collection upon new
  command.
  Offline surface scan supported.
  Self-test supported.
  Conveyance Self-test supported.
  Selective Self-test supported.
SMART capabilities:  (0x0003) Saves SMART data before entering
  power-saving mode.
  Supports SMART auto save timer.
Error logging capability:  (0x01) Error logging supported.
  General Purpose Logging supported.
Short self-test routine
recommended polling time:  (  2) minutes.
Extended self-test routine
recommended polling time:  ( 542) minutes.
Conveyance self-test routine
recommended polling time:  (  5) minutes.
SCT capabilities:  (0x703d) SCT Status supported.
  SCT Error Recovery Control supported.
  SCT Feature Control supported.
  SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME  FLAGS  VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate  POSR-K  200  200  051  -  0
  3 Spin_Up_Time  POS--K  190  172  021  -  7466
  4 Start_Stop_Count  -O--CK  100  100  000  -  122
  5 Reallocated_Sector_Ct  PO--CK  200  200  140  -  0
  7 Seek_Error_Rate  -OSR-K  100  253  000  -  0
  9 Power_On_Hours  -O--CK  090  090  000  -  7764
 10 Spin_Retry_Count  -O--CK  100  100  000  -  0
 11 Calibration_Retry_Count -O--CK  100  100  000  -  0
 12 Power_Cycle_Count  -O--CK  100  100  000  -  122
192 Power-Off_Retract_Count -O--CK  200  200  000  -  106
193 Load_Cycle_Count  -O--CK  200  200  000  -  951
194 Temperature_Celsius  -O---K  122  113  000  -  30
196 Reallocated_Event_Count -O--CK  200  200  000  -  0
197 Current_Pending_Sector  -O--CK  200  200  000  -  0
198 Offline_Uncorrectable  ----CK  100  253  000  -  0
199 UDMA_CRC_Error_Count  -O--CK  200  200  000  -  0
200 Multi_Zone_Error_Rate  ---R--  200  200  000  -  0
  ||||||_ K auto-keep
  |||||__ C event count
  ||||___ R error rate
  |||____ S speed/performance
  ||_____ O updated online
  |______ P prefailure warning

General Purpose Log Directory Version 1
SMART  Log Directory Version 1 [multi-sector log support]
Address  Access  R/W  Size  Description
0x00  GPL,SL  R/O  1  Log Directory
0x01  SL  R/O  1  Summary SMART error log
0x02  SL  R/O  5  Comprehensive SMART error log
0x03  GPL  R/O  6  Ext. Comprehensive SMART error log
0x06  SL  R/O  1  SMART self-test log
0x07  GPL  R/O  1  Extended self-test log
0x09  SL  R/W  1  Selective self-test log
0x10  GPL  R/O  1  SATA NCQ Queued Error log
0x11  GPL  R/O  1  SATA Phy Event Counters log
0x21  GPL  R/O  1  Write stream error log
0x22  GPL  R/O  1  Read stream error log
0x80-0x9f  GPL,SL  R/W  16  Host vendor specific log
0xa0-0xa7  GPL,SL  VS  16  Device vendor specific log
0xa8-0xb6  GPL,SL  VS  1  Device vendor specific log
0xb7  GPL,SL  VS  39  Device vendor specific log
0xbd  GPL,SL  VS  1  Device vendor specific log
0xc0  GPL,SL  VS  1  Device vendor specific log
0xc1  GPL  VS  93  Device vendor specific log
0xe0  GPL,SL  R/W  1  SCT Command/Status
0xe1  GPL,SL  R/W  1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (6 sectors)
Device Error Count: 1
  CR  = Command Register
  FEATR  = Features Register
  COUNT  = Count (was: Sector Count) Register
  LBA_48 = Upper bytes of LBA High/Mid/Low Registers ]  ATA-8
  LH  = LBA High (was: Cylinder High) Register  ]  LBA
  LM  = LBA Mid (was: Cylinder Low) Register  ] Register
  LL  = LBA Low (was: Sector Number) Register  ]
  DV  = Device (was: Device/Head) Register
  DC  = Device Control Register
  ER  = Error register
  ST  = Status register
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 1 [0] occurred at disk power-on lifetime: 7656 hours (319 days + 0 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  04 -- 51 00 01 00 00 00 00 00 00 00 00  Error: ABRT

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  b0 00 d5 00 01 00 00 00 c2 4f e1 00 08  00:15:25.257  SMART READ LOG
  b0 00 d6 00 01 00 00 00 c2 4f e0 00 08  00:15:25.257  SMART WRITE LOG
  b0 00 d6 00 01 00 00 00 c2 4f e0 00 08  00:15:25.256  SMART WRITE LOG
  b0 00 d5 00 01 00 00 00 c2 4f e0 00 08  00:15:25.256  SMART READ LOG
  b0 00 d5 00 01 00 00 00 c2 4f e0 00 08  00:15:25.256  SMART READ LOG

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description  Status  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline  Interrupted (host reset)  90%  7656  -
# 2  Extended offline  Completed without error  00%  6553  -
# 3  Extended offline  Completed without error  00%  6317  -
# 4  Extended offline  Completed without error  00%  6150  -
# 5  Extended offline  Completed without error  00%  5975  -
# 6  Extended offline  Completed without error  00%  5962  -
# 7  Extended offline  Completed without error  00%  5926  -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
  1  0  0  Not_testing
  2  0  0  Not_testing
  3  0  0  Not_testing
  4  0  0  Not_testing
  5  0  0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:  3
SCT Version (vendor specific):  258 (0x0102)
SCT Support Level:  1
Device State:  Active (0)
Current Temperature:  30 Celsius
Power Cycle Min/Max Temperature:  26/30 Celsius
Lifetime  Min/Max Temperature:  18/39 Celsius
Under/Over Temperature Limit Count:  0/0
Vendor specific:
01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

SCT Temperature History Version:  2
Temperature Sampling Period:  1 minute
Temperature Logging Interval:  1 minute
Min/Max recommended Temperature:  0/60 Celsius
Min/Max Temperature Limit:  -41/85 Celsius
Temperature History Size (Index):  478 (330)

Index  Estimated Time  Temperature Celsius
 331  2017-02-22 12:45  30  ***********
 ...  ..(164 skipped).  ..  ***********
  18  2017-02-22 15:30  30  ***********
  19  2017-02-22 15:31  29  **********
  20  2017-02-22 15:32  29  **********
  21  2017-02-22 15:33  29  **********
  22  2017-02-22 15:34  30  ***********
 ...  ..( 19 skipped).  ..  ***********
  42  2017-02-22 15:54  30  ***********
  43  2017-02-22 15:55  29  **********
 ...  ..(156 skipped).  ..  **********
 200  2017-02-22 18:32  29  **********
 201  2017-02-22 18:33  30  ***********
 202  2017-02-22 18:34  30  ***********
 203  2017-02-22 18:35  29  **********
 ...  ..(116 skipped).  ..  **********
 320  2017-02-22 20:32  29  **********
 321  2017-02-22 20:33  30  ***********
 ...  ..(  8 skipped).  ..  ***********
 330  2017-02-22 20:42  30  ***********

SCT Error Recovery Control:
  Read:  70 (7.0 seconds)
  Write:  70 (7.0 seconds)

Device Statistics (GP/SMART Log 0x04) not supported

SATA Phy Event Counters (GP Log 0x11)
ID  Size  Value  Description
0x0001  2  0  Command failed due to ICRC error
0x0002  2  0  R_ERR response for data FIS
0x0003  2  0  R_ERR response for device-to-host data FIS
0x0004  2  0  R_ERR response for host-to-device data FIS
0x0005  2  0  R_ERR response for non-data FIS
0x0006  2  0  R_ERR response for device-to-host non-data FIS
0x0007  2  0  R_ERR response for host-to-device non-data FIS
0x0008  2  0  Device-to-host non-data FIS retries
0x0009  2  52  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2  53  Device-to-host register FISes sent due to a COMRESET
0x000b  2  0  CRC errors within host-to-device FIS
0x000f  2  0  R_ERR response for host-to-device data FIS, CRC
0x0012  2  0  R_ERR response for host-to-device non-data FIS, CRC
0x8000  4  194460  Vendor specific

[root@freenas] ~#

SweetAndLow · Feb 22, 2017

koolcats123 said:

Thanks for the quick answer, here is the output of the command;

Code:

[root@freenas] ~# zpool import
  pool: Extra
  id: 17177318048554058877
  state: ONLINE
action: The pool can be imported using its name or numeric identifier.
config:

  Extra  ONLINE
  gptid/d0a58623-d481-11e6-923b-5404a667a51d  ONLINE

  pool: Hayes
  id: 5553722501274720225
  state: ONLINE
action: The pool can be imported using its name or numeric identifier.
config:

  Hayes  ONLINE
  raidz1-0  ONLINE
  gptid/e648b649-ce43-11e6-923b-5404a667a51d  ONLINE
  gptid/e6f7b26e-ce43-11e6-923b-5404a667a51d  ONLINE
  gptid/e7ab7dda-ce43-11e6-923b-5404a667a51d  ONLINE
  gptid/e8603a4b-ce43-11e6-923b-5404a667a51d  ONLINE
  gptid/d39c0fad-d203-11e6-923b-5404a667a51d  ONLINE
[root@freenas] ~# glabel status
  Name  Status  Components
gptid/d39c0fad-d203-11e6-923b-5404a667a51d  N/A  ada0p2
gptid/e6397d0a-ce43-11e6-923b-5404a667a51d  N/A  ada1p1
gptid/e648b649-ce43-11e6-923b-5404a667a51d  N/A  ada1p2
gptid/e6e952cb-ce43-11e6-923b-5404a667a51d  N/A  ada2p1
gptid/e6f7b26e-ce43-11e6-923b-5404a667a51d  N/A  ada2p2
gptid/e79737bb-ce43-11e6-923b-5404a667a51d  N/A  ada3p1
gptid/e7ab7dda-ce43-11e6-923b-5404a667a51d  N/A  ada3p2
gptid/e84bee04-ce43-11e6-923b-5404a667a51d  N/A  ada4p1
gptid/e8603a4b-ce43-11e6-923b-5404a667a51d  N/A  ada4p2
gptid/d0951122-d481-11e6-923b-5404a667a51d  N/A  ada5p1
gptid/d0a58623-d481-11e6-923b-5404a667a51d  N/A  ada5p2
gptid/4f6c1ce3-f7be-11e6-9d6a-5404a667a51d  N/A  da0p1
gptid/d389cab4-d203-11e6-923b-5404a667a51d  N/A  ada0p1

[root@freenas] ~# smartctl -x /dev/ada0
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:  Western Digital Red
Device Model:  WDC WD40EFRX-68WT0N0
Serial Number:  WD-WCC4E0YY99HK
LU WWN Device Id: 5 0014ee 20cca9c7c
Firmware Version: 82.00A82
User Capacity:  4,000,787,030,016 bytes [4.00 TB]
Sector Sizes:  512 bytes logical, 4096 bytes physical
Rotation Rate:  5400 rpm
Device is:  In smartctl database [for details use: -P show]
ATA Version is:  ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:  Wed Feb 22 20:42:39 2017 PST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:  Unavailable
APM feature is:  Unavailable
Rd look-ahead is: Enabled
Write cache is:  Enabled
ATA Security is:  Disabled, NOT FROZEN [SEC1]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80) Offline data collection activity
  was never started.
  Auto Offline Data Collection: Enabled.
Self-test execution status:  (  0) The previous self-test routine completed
  without error or no self-test has ever
  been run.
Total time to complete Offline
data collection:  (54240) seconds.
Offline data collection
capabilities:  (0x7b) SMART execute Offline immediate.
  Auto Offline data collection on/off support.
  Suspend Offline collection upon new
  command.
  Offline surface scan supported.
  Self-test supported.
  Conveyance Self-test supported.
  Selective Self-test supported.
SMART capabilities:  (0x0003) Saves SMART data before entering
  power-saving mode.
  Supports SMART auto save timer.
Error logging capability:  (0x01) Error logging supported.
  General Purpose Logging supported.
Short self-test routine
recommended polling time:  (  2) minutes.
Extended self-test routine
recommended polling time:  ( 542) minutes.
Conveyance self-test routine
recommended polling time:  (  5) minutes.
SCT capabilities:  (0x703d) SCT Status supported.
  SCT Error Recovery Control supported.
  SCT Feature Control supported.
  SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME  FLAGS  VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate  POSR-K  200  200  051  -  0
  3 Spin_Up_Time  POS--K  190  172  021  -  7466
  4 Start_Stop_Count  -O--CK  100  100  000  -  122
  5 Reallocated_Sector_Ct  PO--CK  200  200  140  -  0
  7 Seek_Error_Rate  -OSR-K  100  253  000  -  0
  9 Power_On_Hours  -O--CK  090  090  000  -  7764
10 Spin_Retry_Count  -O--CK  100  100  000  -  0
11 Calibration_Retry_Count -O--CK  100  100  000  -  0
12 Power_Cycle_Count  -O--CK  100  100  000  -  122
192 Power-Off_Retract_Count -O--CK  200  200  000  -  106
193 Load_Cycle_Count  -O--CK  200  200  000  -  951
194 Temperature_Celsius  -O---K  122  113  000  -  30
196 Reallocated_Event_Count -O--CK  200  200  000  -  0
197 Current_Pending_Sector  -O--CK  200  200  000  -  0
198 Offline_Uncorrectable  ----CK  100  253  000  -  0
199 UDMA_CRC_Error_Count  -O--CK  200  200  000  -  0
200 Multi_Zone_Error_Rate  ---R--  200  200  000  -  0
  ||||||_ K auto-keep
  |||||__ C event count
  ||||___ R error rate
  |||____ S speed/performance
  ||_____ O updated online
  |______ P prefailure warning

General Purpose Log Directory Version 1
SMART  Log Directory Version 1 [multi-sector log support]
Address  Access  R/W  Size  Description
0x00  GPL,SL  R/O  1  Log Directory
0x01  SL  R/O  1  Summary SMART error log
0x02  SL  R/O  5  Comprehensive SMART error log
0x03  GPL  R/O  6  Ext. Comprehensive SMART error log
0x06  SL  R/O  1  SMART self-test log
0x07  GPL  R/O  1  Extended self-test log
0x09  SL  R/W  1  Selective self-test log
0x10  GPL  R/O  1  SATA NCQ Queued Error log
0x11  GPL  R/O  1  SATA Phy Event Counters log
0x21  GPL  R/O  1  Write stream error log
0x22  GPL  R/O  1  Read stream error log
0x80-0x9f  GPL,SL  R/W  16  Host vendor specific log
0xa0-0xa7  GPL,SL  VS  16  Device vendor specific log
0xa8-0xb6  GPL,SL  VS  1  Device vendor specific log
0xb7  GPL,SL  VS  39  Device vendor specific log
0xbd  GPL,SL  VS  1  Device vendor specific log
0xc0  GPL,SL  VS  1  Device vendor specific log
0xc1  GPL  VS  93  Device vendor specific log
0xe0  GPL,SL  R/W  1  SCT Command/Status
0xe1  GPL,SL  R/W  1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (6 sectors)
Device Error Count: 1
  CR  = Command Register
  FEATR  = Features Register
  COUNT  = Count (was: Sector Count) Register
  LBA_48 = Upper bytes of LBA High/Mid/Low Registers ]  ATA-8
  LH  = LBA High (was: Cylinder High) Register  ]  LBA
  LM  = LBA Mid (was: Cylinder Low) Register  ] Register
  LL  = LBA Low (was: Sector Number) Register  ]
  DV  = Device (was: Device/Head) Register
  DC  = Device Control Register
  ER  = Error register
  ST  = Status register
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 1 [0] occurred at disk power-on lifetime: 7656 hours (319 days + 0 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  04 -- 51 00 01 00 00 00 00 00 00 00 00  Error: ABRT

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  b0 00 d5 00 01 00 00 00 c2 4f e1 00 08  00:15:25.257  SMART READ LOG
  b0 00 d6 00 01 00 00 00 c2 4f e0 00 08  00:15:25.257  SMART WRITE LOG
  b0 00 d6 00 01 00 00 00 c2 4f e0 00 08  00:15:25.256  SMART WRITE LOG
  b0 00 d5 00 01 00 00 00 c2 4f e0 00 08  00:15:25.256  SMART READ LOG
  b0 00 d5 00 01 00 00 00 c2 4f e0 00 08  00:15:25.256  SMART READ LOG

SMART Extended Self-test Log Version: 1 (1 sectors)
Num  Test_Description  Status  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline  Interrupted (host reset)  90%  7656  -
# 2  Extended offline  Completed without error  00%  6553  -
# 3  Extended offline  Completed without error  00%  6317  -
# 4  Extended offline  Completed without error  00%  6150  -
# 5  Extended offline  Completed without error  00%  5975  -
# 6  Extended offline  Completed without error  00%  5962  -
# 7  Extended offline  Completed without error  00%  5926  -

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
  1  0  0  Not_testing
  2  0  0  Not_testing
  3  0  0  Not_testing
  4  0  0  Not_testing
  5  0  0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:  3
SCT Version (vendor specific):  258 (0x0102)
SCT Support Level:  1
Device State:  Active (0)
Current Temperature:  30 Celsius
Power Cycle Min/Max Temperature:  26/30 Celsius
Lifetime  Min/Max Temperature:  18/39 Celsius
Under/Over Temperature Limit Count:  0/0
Vendor specific:
01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00

SCT Temperature History Version:  2
Temperature Sampling Period:  1 minute
Temperature Logging Interval:  1 minute
Min/Max recommended Temperature:  0/60 Celsius
Min/Max Temperature Limit:  -41/85 Celsius
Temperature History Size (Index):  478 (330)

Index  Estimated Time  Temperature Celsius
331  2017-02-22 12:45  30  ***********
...  ..(164 skipped).  ..  ***********
  18  2017-02-22 15:30  30  ***********
  19  2017-02-22 15:31  29  **********
  20  2017-02-22 15:32  29  **********
  21  2017-02-22 15:33  29  **********
  22  2017-02-22 15:34  30  ***********
...  ..( 19 skipped).  ..  ***********
  42  2017-02-22 15:54  30  ***********
  43  2017-02-22 15:55  29  **********
...  ..(156 skipped).  ..  **********
200  2017-02-22 18:32  29  **********
201  2017-02-22 18:33  30  ***********
202  2017-02-22 18:34  30  ***********
203  2017-02-22 18:35  29  **********
...  ..(116 skipped).  ..  **********
320  2017-02-22 20:32  29  **********
321  2017-02-22 20:33  30  ***********
...  ..(  8 skipped).  ..  ***********
330  2017-02-22 20:42  30  ***********

SCT Error Recovery Control:
  Read:  70 (7.0 seconds)
  Write:  70 (7.0 seconds)

Device Statistics (GP/SMART Log 0x04) not supported

SATA Phy Event Counters (GP Log 0x11)
ID  Size  Value  Description
0x0001  2  0  Command failed due to ICRC error
0x0002  2  0  R_ERR response for data FIS
0x0003  2  0  R_ERR response for device-to-host data FIS
0x0004  2  0  R_ERR response for host-to-device data FIS
0x0005  2  0  R_ERR response for non-data FIS
0x0006  2  0  R_ERR response for device-to-host non-data FIS
0x0007  2  0  R_ERR response for host-to-device non-data FIS
0x0008  2  0  Device-to-host non-data FIS retries
0x0009  2  52  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2  53  Device-to-host register FISes sent due to a COMRESET
0x000b  2  0  CRC errors within host-to-device FIS
0x000f  2  0  R_ERR response for host-to-device data FIS, CRC
0x0012  2  0  R_ERR response for host-to-device non-data FIS, CRC
0x8000  4  194460  Vendor specific

[root@freenas] ~#

I don't think you understand. If your pool doesn't import things are gone. Rebuild and restore from backup.

koolcats123 · Feb 23, 2017

SweetAndLow said:
I don't think you understand. If your pool doesn't import things are gone. Rebuild and restore from backup.

Well that sucks, thanks for the quick answer regarding this issue.

rs225 · Feb 23, 2017

Did you try importing it like this:

Code:

zpool import -o readonly=on Hayes

There are some other things to try https://forums.freenas.org/index.php?threads/zfs-has-failed-you.11951/

Robert Trevellyan · Feb 23, 2017

koolcats123 said:
here is the output

There's nothing obviously wrong with ada0, and the indentation looks different this time.

Please post the output of zdb so we can confirm the pool structure.

koolcats123 · Feb 23, 2017

Robert Trevellyan said:
There's nothing obviously wrong with ada0, and the indentation looks different this time.

Please post the output of zdb so we can confirm the pool structure.

When I run a zdb command this is the output;

Code:

[root@freenas] ~# zdb
freenas-boot:
  version: 5000
  name: 'freenas-boot'
  state: 0
  txg: 10785
  pool_guid: 12191717688580028969
  hostname: ''
  vdev_children: 1
  vdev_tree:
  type: 'root'
  id: 0
  guid: 12191717688580028969
  create_txg: 4
  children[0]:
  type: 'disk'
  id: 0
  guid: 17762710621501218051
  path: '/dev/da0p2'
  whole_disk: 1
  metaslab_array: 30
  metaslab_shift: 29
  ashift: 9
  asize: 62070194176
  is_log: 0
  create_txg: 4
  features_for_read:
[root@freenas] ~#

Robert Trevellyan · Feb 24, 2017

How about zdb Hayes?

koolcats123 · Feb 24, 2017

Robert Trevellyan said:
How about zdb Hayes?

This is what I get;

Code:

[root@freenas] ~# zdb Hayes
zdb: can't open 'Hayes': No such file or directory

ZFS_DBGMSG(zdb):
[root@freenas] ~#

Robert Trevellyan · Feb 25, 2017

zdb -e Hayes?

koolcats123 · Feb 25, 2017

The output of the command was so big I had to save it to a file. At the end though this is what I get;

Code:

  525599  3  128K  128K  281M  281M  100.00  ZFS plain file
Assertion failed: dn->dn_bonuslen <= ((1 << 9) - 64 - (1 << 7)) (0x2a8 <= 0x140), file /freenas-9.10-releng/_BE/os/cddl/lib/libzpool/../../../sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dnode.c, line 264.
Abort (core dumped)
[root@freenas] /#

Output Zip of the command

Robert Trevellyan · Feb 25, 2017

Code:

Configuration for import:
        vdev_children: 2
        version: 5000
        pool_guid: 5553722501274720225
        name: 'Hayes'
        state: 0
        hostid: 2462007200
        hostname: ''
        vdev_tree:
            type: 'root'
            id: 0
            guid: 5553722501274720225
            children[0]:
                type: 'raidz'
                id: 0
                guid: 172246028765695554
                nparity: 1
                metaslab_array: 35
                metaslab_shift: 37
                ashift: 12
                asize: 15994538950656
                is_log: 0
                create_txg: 4
                children[0]:
                    type: 'disk'
                    id: 0
                    guid: 18072016931215656910
                    whole_disk: 1
                    create_txg: 4
                    path: '/dev/gptid/e648b649-ce43-11e6-923b-5404a667a51d'
                children[1]:
                    type: 'disk'
                    id: 1
                    guid: 4096945204963873590
                    whole_disk: 1
                    create_txg: 4
                    path: '/dev/gptid/e6f7b26e-ce43-11e6-923b-5404a667a51d'
                children[2]:
                    type: 'disk'
                    id: 2
                    guid: 14335204400496344610
                    whole_disk: 1
                    create_txg: 4
                    path: '/dev/gptid/e7ab7dda-ce43-11e6-923b-5404a667a51d'
                children[3]:
                    type: 'disk'
                    id: 3
                    guid: 15585744030035999092
                    whole_disk: 1
                    create_txg: 4
                    path: '/dev/gptid/e8603a4b-ce43-11e6-923b-5404a667a51d'
            children[1]:
                type: 'disk'
                id: 1
                guid: 13042727952487039649
                whole_disk: 1
                metaslab_array: 156
                metaslab_shift: 35
                ashift: 12
                asize: 3998634737664
                is_log: 0
                create_txg: 164629
                path: '/dev/gptid/d39c0fad-d203-11e6-923b-5404a667a51d'

This is the part I wanted to see, and it confirms what I said earlier, which is that you have a pool made of one 4-disk RAIDZ1 vdev and one 1-disk stripe, which is a horrible layout that you should not plan to keep.

Assuming you haven't given up hope yet, your goal should be to backup the data and rebuild the pool. I don't have personal experience of recovering a damaged pool, but I've seen several cases where people were able to import a damaged pool read-only and recover data from it.

You could start with zpool import -fFn Hayes, just to see if ZFS expects to be able to recover the pool (the 'n' means "don't actually do it, just investigate the possibility"). If that looks promising, you could remove the 'n' and add '-o readonly=on'.

You might also try using zdb -F:

-F Attempt to make an unreadable pool readable by trying progressively older transactions.

https://www.freebsd.org/cgi/man.cgi?query=zpool
https://www.freebsd.org/cgi/man.cgi?query=zdb

koolcats123 · Feb 25, 2017

This setup was created when I was trying to add one drive to a raidz1. I will try to run the command in a moment but now I know to not do this raid layout again. Ok, I ran zpool import -fFn Hayes but the system still crashes.
Update: ran the zdb -F and zdb -F Hayes

Code:

[root@freenas] ~# zdb -F
freenas-boot:
  version: 5000
  name: 'freenas-boot'
  state: 0
  txg: 38062
  pool_guid: 12191717688580028969
  hostname: ''
  vdev_children: 1
  vdev_tree:
  type: 'root'
  id: 0
  guid: 12191717688580028969
  create_txg: 4
  children[0]:
  type: 'disk'
  id: 0
  guid: 17762710621501218051
  path: '/dev/da0p2'
  whole_disk: 1
  metaslab_array: 30
  metaslab_shift: 29
  ashift: 9
  asize: 62070194176
  is_log: 0
  create_txg: 4
  features_for_read:
[root@freenas] ~# zdb -F Hayes
zdb: can't open 'Hayes': No such file or directory

ZFS_DBGMSG(zdb):
[root@freenas] ~#

Robert Trevellyan · Feb 25, 2017

zdb -e -F Hayes?

koolcats123 · Feb 25, 2017

Thanks for the quick reply, this is the output;

Code:

[root@freenas] ~# zdb -e -F Hayes

Configuration for import:
  vdev_children: 2
  version: 5000
  pool_guid: 5553722501274720225
  name: 'Hayes'
  state: 0
  hostid: 2462007200
  hostname: ''
  vdev_tree:
  type: 'root'
  id: 0
  guid: 5553722501274720225
  children[0]:
  type: 'raidz'
  id: 0
  guid: 172246028765695554
  nparity: 1
  metaslab_array: 35
  metaslab_shift: 37
  ashift: 12
  asize: 15994538950656
  is_log: 0
  create_txg: 4
  children[0]:
  type: 'disk'
  id: 0
  guid: 18072016931215656910
  whole_disk: 1
  create_txg: 4
  path: '/dev/gptid/e648b649-ce43-11e6-923b-5404a667a51d'
  children[1]:
  type: 'disk'
  id: 1
  guid: 4096945204963873590
  whole_disk: 1
  create_txg: 4
  path: '/dev/gptid/e6f7b26e-ce43-11e6-923b-5404a667a51d'
  children[2]:
  type: 'disk'
  id: 2
  guid: 14335204400496344610
  whole_disk: 1
  create_txg: 4
  path: '/dev/gptid/e7ab7dda-ce43-11e6-923b-5404a667a51d'
  children[3]:
  type: 'disk'
  id: 3
  guid: 15585744030035999092
  whole_disk: 1
  create_txg: 4
  path: '/dev/gptid/e8603a4b-ce43-11e6-923b-5404a667a51d'
  children[1]:
  type: 'disk'
  id: 1
  guid: 13042727952487039649
  whole_disk: 1
  metaslab_array: 156
  metaslab_shift: 35
  ashift: 12
  asize: 3998634737664
  is_log: 0
  create_txg: 164629
  path: '/dev/gptid/d39c0fad-d203-11e6-923b-5404a667a51d'
error: blkptr at 0x80aa292c0 has invalid CHECKSUM 0
Abort (core dumped)
[root@freenas] ~#

Robert Trevellyan · Feb 26, 2017

koolcats123 said:
error: blkptr at 0x80aa292c0 has invalid CHECKSUM 0 Abort (core dumped)

Unfortunately I'm out of ideas.

koolcats123 · Feb 26, 2017

Robert Trevellyan said:
Unfortunately I'm out of ideas.

Do you think it is a drive problem, hardware problem or a corrupted zfs volume?

Robert Trevellyan · Feb 26, 2017

I think it's most likely a corrupted ZFS volume, probably caused by some kind of hardware failure.

Your system multiplies three high risk factors together:

RAIDZ1 with drives > 1TB.
Single-drive vdev added on.
Non-ECC RAM.

Important Announcement for the TrueNAS Community.

Importing Volume Showing Checksum Errors and Then Panics

Dabbler

Pony Wrangler

Sweet'NASty

Dabbler

Sweet'NASty

Dabbler

Guru

Pony Wrangler

Dabbler

Pony Wrangler

Dabbler

Pony Wrangler

Dabbler

Pony Wrangler

Dabbler

Pony Wrangler

Dabbler

Pony Wrangler

Dabbler

Pony Wrangler

Similar threads