SOLVED Degraded

vamfoom

Dabbler
Joined
Aug 15, 2019
Messages
19
I powered off my NAS while away on vacation. This morning when I powered it back on, the pool went into degraded mode. This message popped up in the notification:
Pool fongpool1 state is DEGRADED: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state.

The pool is on ada1 and ada2 and both of them seem to be okay:

=> 40 11721045088 ada1 GPT (5.5T)
40 88 - free - (44K)
128 4194304 1 freebsd-swap (2.0G)
4194432 11716850696 2 freebsd-zfs (5.5T)

=> 40 9767541088 ada2 GPT (4.5T)
40 88 - free - (44K)
128 4194304 1 freebsd-swap (2.0G)
4194432 9763346696 2 freebsd-zfs (4.5T)


ada2 no longer seem to be part of the pool grep of ada2 in all files under /var/log/ doesn't show any error. Do I need to remove ada2 and readd?
 
Joined
Oct 18, 2018
Messages
969
Hi @vamfoom, would you mind following the suggestion in the Forum Rules and post all of your hardware etc? Also, would you mind posting the output of zpool status? What is the output of smartctl -a /dev/ada2? Finally, do you run regular SMART tests or scrubs and if so what are the most recent results?
 

vamfoom

Dabbler
Joined
Aug 15, 2019
Messages
19
smartctl output:

Code:
# smartctl -a /dev/ada2
smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.2-STABLE amd64] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Seagate Barracuda 2.5 5400
Device Model:     ST5000LM000-2AN170
Serial Number:    WCJ16PA7
LU WWN Device Id: 5 000c50 0b415cde9
Firmware Version: 0001
User Capacity:    5,000,981,078,016 bytes [5.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5526 rpm
Form Factor:      2.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-3 T13/2161-D revision 5
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Mon Oct 14 14:17:42 2019 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
See vendor-specific Attribute list for marginal Attributes.


zpool status:

Code:
# zpool status
  pool: fongpool1
 state: DEGRADED
status: One or more devices could not be opened.  Sufficient replicas exist for
        the pool to continue functioning in a degraded state.
action: Attach the missing device and online it using 'zpool online'.
   see: http://illumos.org/msg/ZFS-8000-2Q
  scan: resilvered 2.56T in 0 days 09:04:10 with 0 errors on Wed Sep 25 20:36:14 2019
config:

        NAME                                                STATE     READ WRITE CKSUM
        fongpool1                                           DEGRADED     0     0     0
          mirror-0                                          DEGRADED     0     0     0
            4736739188957053059                             UNAVAIL      0     0     0  was /dev/gptid/e428cdee-9ca0-11e9-ac9f-60a44cac9492.eli
            gptid/c0957478-dfc2-11e9-9c5f-5480284fbe46.eli  ONLINE       0     0     0

errors: No known data errors
 

vamfoom

Dabbler
Joined
Aug 15, 2019
Messages
19
glabel output:

Code:
# glabel status|egrep 'Name|ada2'
                                      Name  Status  Components
gptid/e428cdee-9ca0-11e9-ac9f-60a44cac9492     N/A  ada2p2
 

vamfoom

Dabbler
Joined
Aug 15, 2019
Messages
19
I replaced the missing vdev with itself. Hopefully, this is correct:

Code:
# zpool replace -f fongpool1 4736739188957053059 /dev/ada2p2
 
Joined
Oct 18, 2018
Messages
969
I replaced the missing vdev with itself. Hopefully, this is correct:
Did you try it without the -f flag? Also, in general all basic functionality such as this can be performed via the GUI and it is advised you use it in the event you omit a flag which FreeNAS expects. Sometimes a command will work via the CLI but have unintended consequences due to missing flags, for example.

What is the output of zpool status now?

Also, have you ever run any scrubs or SMART tests on your drives or perhaps you truncated the result of smartctl -a /dev/da2? I would've expected to see test results there.

Finally, you omitted your hardware. What kind of hardware are you running on? I notice the drive is a 2.5" HDD, is this a laptop or a laptop drive used for data?
 

vamfoom

Dabbler
Joined
Aug 15, 2019
Messages
19
Yes, I did truncate the output of smartctl.

My NAS is back to normal and healthy after forcing the replacement of the device with itself. Thanks for the inputs.
 
Top