TooMuchData
Contributor
- Joined
- Jan 4, 2015
- Messages
- 188
Hello All. I'm a bit worried about recovering from this and will appreciate all help. I assume I must replace the drive. How is that done safely? Can I just try to boot again or is that dangerous? Should I shut down until ready to replace drive?
Here is my story---
Rebooted FN 9.10 earlier after network configuration changes. Just wanted to see a clean start. I was surprised and dismayed to receive this email:
The volume zVol (ZFS) state is DEGRADED: One or more devices has been removed by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state.
Got a zpool report:
########## ZPool status report for zVol ##########
pool: zVol
state: DEGRADED
status: One or more devices has been removed by the administrator.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Online the device using 'zpool online' or replace the device with
'zpool replace'.
scan: scrub repaired 0 in 17h35m with 0 errors on Thu Jul 14 18:36:08 2016
config:
NAME STATE READ WRITE CKSUM
zVol DEGRADED 0 0 0
raidz2-0 DEGRADED 0 0 0
gptid/831ef1ef-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
gptid/83ec38c1-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
gptid/84b80ccd-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
gptid/85856a70-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
gptid/86542f6a-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
11302004924969255930 REMOVED 0 0 0 was /dev/gptid/8726b5b1-a343-11e4-adaf-d050995044d1
errors: No known data errors
Tried zpool online:
[root@freenas ~]# zpool online zVol 11302004924969255930
warning: device '11302004924969255930' onlined, but remains in faulted state use 'zpool replace' to replace devices that are no longer present
[root@freenas ~]#
Tried to see the smart status:
[root@freenas ~]# smartctl -a /dev/ada5
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build) Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
/dev/ada5: Unable to detect device type Please specify device type with the -d option. Use smartctl -h to get a usage summary [root@freenas ~]#
Found these entries in boot log:
Jul 19 17:42:58 freenas ada5 at ahcich13 bus 0 scbus14 target 0 lun 0
Jul 19 17:42:58 freenas ada5: <WDC WD60EFRX-68MYMN1 82.00A82> ACS-2 ATA SATA 3.x device
Jul 19 17:42:58 freenas ada5: Serial Number WD-WX11D4444271
Jul 19 17:42:58 freenas ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
Jul 19 17:42:58 freenas ada5: Command Queueing enabled
Jul 19 17:42:58 freenas ada5: 5723166MB (11721045168 512 byte sectors)
Jul 19 17:42:58 freenas ada5: quirks=0x1<4K>
Jul 19 17:42:58 freenas ada5: Previously was known as ad30
Jul 19 17:43:02 freenas GEOM_ELI: Device ada5p1.eli created.
Jul 19 17:43:02 freenas GEOM_ELI: Encryption: AES-XTS 128
Jul 19 17:43:02 freenas GEOM_ELI: Crypto: hardware
Jul 19 17:43:36 freenas devd: Executing '/etc/rc.d/dhclient quietstart igb0'
Jul 19 17:43:38 freenas devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d ada5'
Jul 19 17:43:38 freenas ada5 at ahcich13 bus 0 scbus14 target 0 lun 0
Jul 19 17:43:38 freenas ada5: <WDC WD60EFRX-68MYMN1 82.00A82> s/n WD-WX11D4444271 detached
Jul 19 17:43:38 freenas GEOM_ELI: Device ada5p1.eli destroyed.
Jul 19 17:43:38 freenas GEOM_ELI: Detached ada5p1.eli on last close.
Jul 19 17:43:38 freenas (ada5:ahcich13:0:0:0): Periph destroyed
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): NOP FLUSHQUEUE. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): CAM status: ATA Status Error
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): ATA status: d1 (BSY DRDY SERV ERR), error: 04 (ABRT )
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): RES: d1 04 ff ff ff ff ff ff ff ff ff
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): Error 5, Retries exhausted
Thanks again.
Here is my story---
Rebooted FN 9.10 earlier after network configuration changes. Just wanted to see a clean start. I was surprised and dismayed to receive this email:
The volume zVol (ZFS) state is DEGRADED: One or more devices has been removed by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state.
Got a zpool report:
########## ZPool status report for zVol ##########
pool: zVol
state: DEGRADED
status: One or more devices has been removed by the administrator.
Sufficient replicas exist for the pool to continue functioning in a
degraded state.
action: Online the device using 'zpool online' or replace the device with
'zpool replace'.
scan: scrub repaired 0 in 17h35m with 0 errors on Thu Jul 14 18:36:08 2016
config:
NAME STATE READ WRITE CKSUM
zVol DEGRADED 0 0 0
raidz2-0 DEGRADED 0 0 0
gptid/831ef1ef-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
gptid/83ec38c1-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
gptid/84b80ccd-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
gptid/85856a70-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
gptid/86542f6a-a343-11e4-adaf-d050995044d1 ONLINE 0 0 0
11302004924969255930 REMOVED 0 0 0 was /dev/gptid/8726b5b1-a343-11e4-adaf-d050995044d1
errors: No known data errors
Tried zpool online:
[root@freenas ~]# zpool online zVol 11302004924969255930
warning: device '11302004924969255930' onlined, but remains in faulted state use 'zpool replace' to replace devices that are no longer present
[root@freenas ~]#
Tried to see the smart status:
[root@freenas ~]# smartctl -a /dev/ada5
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build) Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org
/dev/ada5: Unable to detect device type Please specify device type with the -d option. Use smartctl -h to get a usage summary [root@freenas ~]#
Found these entries in boot log:
Jul 19 17:42:58 freenas ada5 at ahcich13 bus 0 scbus14 target 0 lun 0
Jul 19 17:42:58 freenas ada5: <WDC WD60EFRX-68MYMN1 82.00A82> ACS-2 ATA SATA 3.x device
Jul 19 17:42:58 freenas ada5: Serial Number WD-WX11D4444271
Jul 19 17:42:58 freenas ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
Jul 19 17:42:58 freenas ada5: Command Queueing enabled
Jul 19 17:42:58 freenas ada5: 5723166MB (11721045168 512 byte sectors)
Jul 19 17:42:58 freenas ada5: quirks=0x1<4K>
Jul 19 17:42:58 freenas ada5: Previously was known as ad30
Jul 19 17:43:02 freenas GEOM_ELI: Device ada5p1.eli created.
Jul 19 17:43:02 freenas GEOM_ELI: Encryption: AES-XTS 128
Jul 19 17:43:02 freenas GEOM_ELI: Crypto: hardware
Jul 19 17:43:36 freenas devd: Executing '/etc/rc.d/dhclient quietstart igb0'
Jul 19 17:43:38 freenas devd: Executing '[ -e /tmp/.sync_disk_done ] && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/sync_disks.py && LD_LIBRARY_PATH=/usr/local/lib /usr/local/bin/python /usr/local/www/freenasUI/tools/smart_alert.py -d ada5'
Jul 19 17:43:38 freenas ada5 at ahcich13 bus 0 scbus14 target 0 lun 0
Jul 19 17:43:38 freenas ada5: <WDC WD60EFRX-68MYMN1 82.00A82> s/n WD-WX11D4444271 detached
Jul 19 17:43:38 freenas GEOM_ELI: Device ada5p1.eli destroyed.
Jul 19 17:43:38 freenas GEOM_ELI: Detached ada5p1.eli on last close.
Jul 19 17:43:38 freenas (ada5:ahcich13:0:0:0): Periph destroyed
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): NOP FLUSHQUEUE. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): CAM status: ATA Status Error
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): ATA status: d1 (BSY DRDY SERV ERR), error: 04 (ABRT )
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): RES: d1 04 ff ff ff ff ff ff ff ff ff
Jul 19 17:43:43 freenas (aprobe0:ahcich13:0:0:0): Error 5, Retries exhausted
Thanks again.