Erd
Cadet
- Joined
- May 30, 2016
- Messages
- 5
Hey guys I've been running a FreeNAS box casually for about 2 years, and the past 3 or 4 months I've been building up my server and having it do more and more. About a month ago I decided my FreeNAS configs were borked up and decided to start fresh (I was running 9.1.x at the time). So I installed 9.10 on my flash drive and started configuring everything.
Heres the specs:
FreeNAS 9.10
AMD Athlon X2 5400+
8GB Ram
2 x 2TB HDDs
1 x 3TB HDD (was external, then removed from case and made internal)
HDDs connected via SATA2 in AHCI
Fast forward to a couple weeks ago, and I noticed my external drive was failing SMART checks so I decided I'd take it out of the external shell and make it an internal drive. This fixed the SMART failures. However, now volume disappeared but I decided "thats fine I have a backup and I'll just wipe it clean and restore it". Everything restores fine and the system is stable and I go on with life.
Last night I decided to reboot my system after it had been up since I made the above swap, but the new volume is gone! It should have mounted to /mnt/Hydrogen instead I have an error "The volume Hydrogen (ZFS) state is UNKNOWN"
My USB stick also recently has a DEGRADED status (I've ordered an SSD to replace it). This is the output of zpool status -v:
I also ran zpool import, which gave no output. "zpool import Hydrogen" gave the following:
The disk is definitely being detected, "smartctl -a /dev/ada0" gives the following:
I can't import the volume from the gui, there are no volumes in the list to select from, and the disk shows up in the "View Disks" gui.
I'm not very FreeNAS saavy, I know enough to be dangerous, but I'm at a complete loss of why this would happen. I've tried re-seating the sata power/data connections on my HDDs as a last ditch effort. Could the data-corruption on my boot drive have caused this? Its corrupt on a .tgz file, which (if I'm not mistaken), is just the compressed update when downloaded (which gets unpacked) so it shouldn't really affect anything, right?
The HDD in question has ~25,000 hours on it (from the smrtctl command above), that might be the cause? I dunno, I'm lost :(
I didn't have periodic snapshots set up, I've lost my old backup from the original swap (I did an rm -r 2 days ago!!), and I don't have the recycle bin option checked on the relevant CIFS shares. If I can't recover the volume I'm pretty sure I've lost ~2TB of data. Do I have any options left, or am I boned?
Heres the specs:
FreeNAS 9.10
AMD Athlon X2 5400+
8GB Ram
2 x 2TB HDDs
1 x 3TB HDD (was external, then removed from case and made internal)
HDDs connected via SATA2 in AHCI
Fast forward to a couple weeks ago, and I noticed my external drive was failing SMART checks so I decided I'd take it out of the external shell and make it an internal drive. This fixed the SMART failures. However, now volume disappeared but I decided "thats fine I have a backup and I'll just wipe it clean and restore it". Everything restores fine and the system is stable and I go on with life.
Last night I decided to reboot my system after it had been up since I made the above swap, but the new volume is gone! It should have mounted to /mnt/Hydrogen instead I have an error "The volume Hydrogen (ZFS) state is UNKNOWN"
My USB stick also recently has a DEGRADED status (I've ordered an SSD to replace it). This is the output of zpool status -v:
Code:
freenas# zpool status -v
pool: Giant
state: ONLINE
scan: scrub repaired 0 in 3h43m with 0 errors on Sun May 29 05:43:21 2016
config:
NAME STATE READ WRITE CKSUM
Giant ONLINE 0 0 0
gptid/08d31604-8d61-11e3-b925-001fd090a73f ONLINE 0 0 0
errors: No known data errors
pool: Scratch
state: ONLINE
scan: scrub repaired 0 in 1h10m with 0 errors on Sun May 1 01:10:19 2016
config:
NAME STATE READ WRITE CKSUM
Scratch ONLINE 0 0 0
gptid/4306bc8d-ac3e-11e4-b13b-001fd090a73f ONLINE 0 0 0
errors: No known data errors
pool: freenas-boot
state: DEGRADED
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://illumos.org/msg/ZFS-8000-8A
scan: none requested
config:
NAME STATE READ WRITE CKSUM
freenas-boot DEGRADED 0 0 1
da0p2 DEGRADED 0 0 2 too many errors
errors: Permanent errors have been detected in the following files:
/var/db/system/update/base-os-9.10-STABLE-201605021851-d55ab9177fa7bbcd849b9f0687646c3d-9.10-STABLE-201605240427-b1814726769db6f75a5797438735378e.tgz
I also ran zpool import, which gave no output. "zpool import Hydrogen" gave the following:
Code:
cannot import 'Hydrogen': no such pool available
The disk is definitely being detected, "smartctl -a /dev/ada0" gives the following:
Code:
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)
Copyright (C) 2002-15, Bruce Allen, Christian Franke, www.smartmontools.org
=== START OF INFORMATION SECTION ===
Model Family: Seagate Barracuda 7200.14 (AF)
Device Model: ST3000DM001-9YN166
Serial Number: Z1F0F1JE
LU WWN Device Id: 5 000c50 03f918f3e
Firmware Version: CC9D
User Capacity: 3,000,588,754,432 bytes [3.00 TB]
Sector Sizes: 512 bytes logical, 4096 bytes physical
Rotation Rate: 7200 rpm
Device is: In smartctl database [for details use: -P show]
ATA Version is: ATA8-ACS T13/1699-D revision 4
SATA Version is: SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is: Mon May 30 12:12:02 2016 CDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
See vendor-specific Attribute list for marginal Attributes.
General SMART Values:
Offline data collection status: (0x82) Offline data collection activity
was completed without error.
Auto Offline Data Collection: Enabled.
Self-test execution status: ( 0) The previous self-test routine completed
without error or no self-test has ever
been run.
Total time to complete Offline
data collection: ( 584) seconds.
Offline data collection
capabilities: (0x7b) SMART execute Offline immediate.
Auto Offline data collection on/off support.
Suspend Offline collection upon new
command.
Offline surface scan supported.
Self-test supported.
Conveyance Self-test supported.
Selective Self-test supported.
SMART capabilities: (0x0003) Saves SMART data before entering
power-saving mode.
Supports SMART auto save timer.
Error logging capability: (0x01) Error logging supported.
General Purpose Logging supported.
Short self-test routine
recommended polling time: ( 1) minutes.
Extended self-test routine
recommended polling time: ( 333) minutes.
Conveyance self-test routine
recommended polling time: ( 2) minutes.
SCT capabilities: (0x3081) SCT Status supported.
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE
1 Raw_Read_Error_Rate 0x000f 119 099 006 Pre-fail Always - 213242304
3 Spin_Up_Time 0x0003 093 092 000 Pre-fail Always - 0
4 Start_Stop_Count 0x0032 099 099 020 Old_age Always - 1558
5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 0
7 Seek_Error_Rate 0x000f 073 056 030 Pre-fail Always - 12968535153
9 Power_On_Hours 0x0032 072 072 000 Old_age Always - 24948
10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0
12 Power_Cycle_Count 0x0032 099 099 020 Old_age Always - 1529
183 Runtime_Bad_Block 0x0032 024 024 000 Old_age Always - 76
184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0
187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0
188 Command_Timeout 0x0032 100 100 000 Old_age Always - 0 0 0
189 High_Fly_Writes 0x003a 097 097 000 Old_age Always - 3
190 Airflow_Temperature_Cel 0x0022 062 029 045 Old_age Always In_the_past 38 (26 18 38 38 0)
191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0
192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 819
193 Load_Cycle_Count 0x0032 001 001 000 Old_age Always - 253811
194 Temperature_Celsius 0x0022 038 071 000 Old_age Always - 38 (0 17 0 0 0)
197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0
198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0
199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0
240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 12119h+04m+50.964s
241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 61677123469235
242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 280798454013571
SMART Error Log Version: 1
No Errors Logged
SMART Self-test log structure revision number 1
Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error
# 1 Conveyance offline Completed without error 00% 24948 -
# 2 Extended offline Completed without error 00% 5 -
SMART Selective self-test log data structure revision number 1
SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS
1 0 0 Not_testing
2 0 0 Not_testing
3 0 0 Not_testing
4 0 0 Not_testing
5 0 0 Not_testing
Selective self-test flags (0x0):
After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
I can't import the volume from the gui, there are no volumes in the list to select from, and the disk shows up in the "View Disks" gui.
I'm not very FreeNAS saavy, I know enough to be dangerous, but I'm at a complete loss of why this would happen. I've tried re-seating the sata power/data connections on my HDDs as a last ditch effort. Could the data-corruption on my boot drive have caused this? Its corrupt on a .tgz file, which (if I'm not mistaken), is just the compressed update when downloaded (which gets unpacked) so it shouldn't really affect anything, right?
The HDD in question has ~25,000 hours on it (from the smrtctl command above), that might be the cause? I dunno, I'm lost :(
I didn't have periodic snapshots set up, I've lost my old backup from the original swap (I did an rm -r 2 days ago!!), and I don't have the recycle bin option checked on the relevant CIFS shares. If I can't recover the volume I'm pretty sure I've lost ~2TB of data. Do I have any options left, or am I boned?
Last edited: