help with Degraded and Unavail disks

Status
Not open for further replies.
T

Tomer

Dabbler
Joined
Jun 26, 2017
Messages
17
Hi,
i run into some problem replacing bad disks, i tried to backup disk to a spare and replace a bad disk, for some reason i cannot get the pool to work again, and i cannot get disk to go offline or replacing it, from gui the it is just wont work...
i need some help resolving this issue please!
 

Attachments

  • freeNas.jpg
    freeNas.jpg
    165.5 KB · Views: 236
Last edited:
T

Tomer

Dabbler
Joined
Jun 26, 2017
Messages
17
zpool status -v | more
give this:

is it possible to save anything from this pool?

RAID10-Vstorage
state: DEGRADED
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Tue Sep 12 09:06:50 2017
737G scanned out of 1.22T at 50.2M/s, 2h54m to go
9.07G resilvered, 58.84% done
config:

NAME STATE READ WRITE CKSUM
RAID10-Vstorage DEGRADED 0 0 13.7M
mirror-0 ONLINE 0 0 0
gptid/a9f8359c-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/ad6ab7ce-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
gptid/b0e4d652-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/b452b4fd-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-2 ONLINE 0 0 0
gptid/b7c8fa85-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/bb4418c0-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-3 ONLINE 0 0 0
gptid/becd26a2-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/c24868ab-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-4 DEGRADED 0 0 27.5M
gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728 ONLINE 0 0 27.5M (resilvering)
replacing-1 DEGRADED 0 0 27.5M
spare-0 DEGRADED 0 0 27.5M
replacing-0 DEGRADED 27.5M 0 0
450655911209013653 UNAVAIL 0 0 0 was /dev/gptid/c946d9e8-54fc-11e7-a8bd-e83935bc7728
gptid/bfa2fd71-95fc-11e7-b503-e83935bc7728 ONLINE 0 0 27.5M (resilvering)
gptid/74505882-95fc-11e7-b503-e83935bc7728 ONLINE 0 0 27.5M (resilvering)
gptid/82f5b205-95fb-11e7-b503-e83935bc7728 ONLINE 0 0 27.5M (resilvering)
mirror-5 ONLINE 0 0 0
gptid/ccc6fc55-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/d0528a1f-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-6 ONLINE 0 0 0
gptid/d42b2c6c-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/d7e25edc-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
spares
10345938651656877100 INUSE was /dev/gptid/74505882-95fc-11e7-b503-e83935bc7728

errors: Permanent errors have been detected in the following files:

RAID10-Vstorage/VESXI-Raid10:<0x1>
RAID10-Vstorage/VHyper-V-Raid10:<0x1>
/var/db/system/samba4/share_info.tdb
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/samba4/log.samba
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/utx.log
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/maillog.2.bz2
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/cron.1.bz2
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/samba4/log.winbindd-idmap
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da25.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da25.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-cd0/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da25.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da0/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da49/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-cd0/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da45.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da49/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da0/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da13.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da13.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da1/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da1/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da1/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da26.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da2/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da38/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da27.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da47.rrd
log file: tatus -v | more replacing-0 DEGRADED 27.5M 0 0
450655911209013653 UNAVAIL 0 0 0 was /dev/gptid/c946d9e8-54fc-11e7-a8bd-e83935bc7728
gptid/bfa2fd71-95fc-11e7-b503-e83935bc7728 ONLINE 0 0 27.5M (resilvering)
gptid/74505882-95fc-11e7-b503-e83935bc7728 ONLINE 0 0 27.5M (resilvering)
gptid/82f5b205-95fb-11e7-b503-e83935bc7728 ONLINE 0 0 27.5M (resilvering)
mirror-5 ONLINE 0 0 0
gptid/ccc6fc55-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/d0528a1f-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-6 ONLINE 0 0 0
gptid/d42b2c6c-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/d7e25edc-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
spares
10345938651656877100 INUSE was /dev/gptid/74505882-95fc-11e7-b503-e83935bc7728

errors: Permanent errors have been detected in the following files:

RAID10-Vstorage/VESXI-Raid10:<0x1>
RAID10-Vstorage/VHyper-V-Raid10:<0x1>
/var/db/system/samba4/share_info.tdb
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/samba4/log.samba
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/utx.log
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/maillog.2.bz2
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/cron.1.bz2
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/samba4/log.winbindd-idmap
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da25.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da25.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-cd0/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da25.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da0/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da49/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-cd0/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da45.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da49/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da0/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da13.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da13.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da1/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da1/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da1/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da26.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da2/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da38/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da27.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da47.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da14.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da39/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da47.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair1a/if_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da40/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da27.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair1a/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da4/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da4/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da27.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da0p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da4/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da40/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da48.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da5/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da5/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da0p2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da5/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da6/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da0p1.eli.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da7/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da0p1.eli.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da44/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da9/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da9/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da44/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da9/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da16.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da9/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da45/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da45/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da10/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da11/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_l2write-l2_write_in_l2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da11/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da12/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_l2write-l2_write_buffer_iter.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da17.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da17.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da12/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_l2write-l2_write_buffer_list_null_iter.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da12/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da17.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_duplicate-duplicate_buffers.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_duplicate-duplicate_buffers_size.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da13/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da48/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_arcmeta-arc_meta_used.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da13/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_arcmeta-arc_meta_min.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da31.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair2a/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da31.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_arc-hits.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair2a/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_arc-misses.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da14/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_arc-l2_misses.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da14/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da32.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_mu-mfu_ghost_hits.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da15/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_metadata-prefetch_metadata_hits.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da18.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da34.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da16/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da16/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da48p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da48p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da48p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da48p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/df-mnt-Video-STORAGE/df_complex-reserved.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da17/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da48p2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da18/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce0/if_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da19/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce0/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da19/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce1/if_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce1/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da19/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce3/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da21/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da0.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce3/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da22/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da36.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-lagg0/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da0.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da23/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-tap0/if_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-tap0/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da24/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-2/cpu-nice.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-3/cpu-nice.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-2/cpu-interrupt.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da25/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da39.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da39.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-7/cpu-interrupt.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/memory/memory-free.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-1/cpu-idle.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da27/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-5/cpu-idle.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da27/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da41.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da28/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair0a/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da23.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/df-mnt-General-Storage-.warden-template-standard/df_complex-free.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da31/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da33/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da25.rrd

pool: freenas-boot
state: ONLINE
scan: scrub repaired 2K in 0h5m with 0 errors on Wed Aug 30 03:50:12 2017
config:

NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
da49p2 ONLINE 0 0 0
 
D

dlavigne

Guest
It looks like the pool is still resilvering. If you still have issues after zpool status indicates that a resilver isn't still in progress, let us know.
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
dlavigne said:
It looks like the pool is still resilvering. If you still have issues after zpool status indicates that a resilver isn't still in progress, let us know.
Click to expand...
It's already showing metadata corruption (besides the errors in the .system dataset, but those can be worked around), so it's definitely a "get all the data off that pool ASAP" kind of situation.
 
T

Tomer

Dabbler
Joined
Jun 26, 2017
Messages
17
Ericloewe said:
It's already showing metadata corruption (besides the errors in the .system dataset, but those can be worked around), so it's definitely a "get all the data off that pool ASAP" kind of situation.
Click to expand...


Can you advice how can i copy the data from the disk?
 
T

Tomer

Dabbler
Joined
Jun 26, 2017
Messages
17
dlavigne said:
It looks like the pool is still resilvering. If you still have issues after zpool status indicates that a resilver isn't still in progress, let us know.
Click to expand...


here is the output for zpool status -v | more


pool: RAID10-Vstorage
state: DEGRADED
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://illumos.org/msg/ZFS-8000-8A
scan: resilvered 11.0G in 6h41m with 22613957 errors on Tue Sep 12 15:48:48 2017
config:

NAME STATE READ WRITE CKSUM
RAID10-Vstorage DEGRADED 0 0 22.2M
mirror-0 ONLINE 0 0 0
gptid/a9f8359c-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/ad6ab7ce-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
gptid/b0e4d652-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/b452b4fd-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-2 ONLINE 0 0 0
gptid/b7c8fa85-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/bb4418c0-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-3 ONLINE 0 0 0
gptid/becd26a2-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/c24868ab-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-4 DEGRADED 0 0 44.6M
gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728 ONLINE 0 0 44.6M
replacing-1 DEGRADED 0 0 44.6M
spare-0 DEGRADED 0 0 44.6M
replacing-0 DEGRADED 44.6M 0 0
450655911209013653 UNAVAIL 0 0 0 was /dev/gptid/c946d9e8-54fc-11e7-a8bd-e83935bc7728
gptid/bfa2fd71-95fc-11e7-b503-e83935bc7728 ONLINE 0 0 44.6M
gptid/74505882-95fc-11e7-b503-e83935bc7728 ONLINE 0 0 44.6M
gptid/82f5b205-95fb-11e7-b503-e83935bc7728 ONLINE 0 0 44.6M
mirror-5 ONLINE 0 0 0
gptid/ccc6fc55-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/d0528a1f-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
mirror-6 ONLINE 0 0 0
gptid/d42b2c6c-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
gptid/d7e25edc-54fc-11e7-a8bd-e83935bc7728 ONLINE 0 0 0
spares
10345938651656877100 INUSE was /dev/gptid/74505882-95fc-11e7-b503-e83935bc7728

errors: Permanent errors have been detected in the following files:

RAID10-Vstorage/VESXI-Raid10:<0x1>
RAID10-Vstorage/VHyper-V-Raid10:<0x1>
/var/db/system/samba4/share_info.tdb
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/samba4/log.samba
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/utx.log
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/maillog.3.bz2
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/cron.1.bz2
/var/db/system/syslog-7c35bc62b22f460fb3766e1c156d5c44/log/samba4/log.winbindd-idmap
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da25.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da25.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-cd0/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da25.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da0/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da49/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-cd0/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da45.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da49/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da0/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da13.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da13.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da1/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da1/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da1/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da26.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da2/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da38/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da27.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da47.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da14.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da39/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da47.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da3/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair1a/if_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da40/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da27.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair1a/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da4/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da4/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da27.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da0p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da4/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da40/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da48.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da5/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da5/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da0p2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da5/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da6/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da0p1.eli.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da7/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da0p1.eli.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da44/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da9/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da9/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da44/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da9/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da16.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da9/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da45/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da45/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da10/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da11/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_l2write-l2_write_in_l2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da11/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da12/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_l2write-l2_write_buffer_iter.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da17.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da17.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da12/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_l2write-l2_write_buffer_list_null_iter.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da12/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da17.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_duplicate-duplicate_buffers.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_duplicate-duplicate_buffers_size.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da13/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da48/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_arcmeta-arc_meta_used.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da13/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/gauge_arcstats_raw_arcmeta-arc_meta_min.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da31.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair2a/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da31.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_arc-hits.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair2a/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_arc-misses.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da14/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_arc-l2_misses.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da14/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da32.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_mu-mfu_ghost_hits.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da15/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/zfs_arc_v2/arcstat_ratio_metadata-prefetch_metadata_hits.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da18.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da34.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da16/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da16/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da48p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da48p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da48p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da48p1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/df-mnt-Video-STORAGE/df_complex-reserved.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da17/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da48p2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da18/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce0/if_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da19/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce0/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da19/disk_ops.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce1/if_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce1/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da19/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce3/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da21/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da0.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-bce3/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da22/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da36.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-lagg0/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da0.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da23/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-tap0/if_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-tap0/if_errors.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da24/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-2/cpu-nice.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-3/cpu-nice.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da1.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops-da2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-2/cpu-interrupt.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da25/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_busy_percent-da39.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_bw-da2.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da39.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-7/cpu-interrupt.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/memory/memory-free.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-1/cpu-idle.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da27/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/cpu-5/cpu-idle.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da27/disk_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_ops_rwd-da41.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da28/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/interface-epair0a/if_packets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_latency-da23.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/df-mnt-General-Storage-.warden-template-standard/df_complex-free.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da31/disk_io_time.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/disk-da33/disk_octets.rrd
/var/db/system/rrd-7c35bc62b22f460fb3766e1c156d5c44/freenas.BA/geom_stat/geom_queue-da25.rrd

pool: freenas-boot
state: ONLINE
scan: scrub repaired 2K in 0h5m with 0 errors on Wed Aug 30 03:50:12 2017
config:

NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
da49p2 ONLINE 0 0 0
 
SweetAndLow

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
Do you have Backup? Your going to want to use your backup or make one really fast. A 10TB hdd is pretty cheap.
 
T

Tomer

Dabbler
Joined
Jun 26, 2017
Messages
17
i dont have a 10TB hdd,
is there a way to connect to the pool and copy some data from it?
 
T

Tomer

Dabbler
Joined
Jun 26, 2017
Messages
17
i dont have a 10TB hdd,
is there a way to connect to the pool and copy some data from it?
 
SweetAndLow

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
Tomer said:
i dont have a 10TB hdd,
is there a way to connect to the pool and copy some data from it?
Click to expand...
Huh? Of course there is it's a nas that is what it's purpose is. You use smb, nf, should, rsync, afp to move data over a network. Does that make sense? I think I might be understanding you wrong because that answer I just gave is silly. What do you mean by connect to the pool? How did you get all your data in there in the first place?
 
T

Tomer

Dabbler
Joined
Jun 26, 2017
Messages
17
SweetAndLow said:
Huh? Of course there is it's a nas that is what it's purpose is. You use smb, nf, should, rsync, afp to move data over a network. Does that make sense? I think I might be understanding you wrong because that answer I just gave is silly. What do you mean by connect to the pool? How did you get all your data in there in the first place?
Click to expand...

Hi,
the pool is a iscsi mounted to ESXi's.
after its start to be degraded mode, it cannot be reached.
i tried as you sugested to configure it to be SMB, but its unreacheble(i can see only the JAIL folder)...
 
R

rs225

Guru
Joined
Jun 28, 2014
Messages
878
Can you reconnect the first disk you removed?

SMART data from that disk and the remaining disk would be good.
Code:
gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728
gptid/c946d9e8-54fc-11e7-a8bd-e83935bc7728
 
Last edited:
T

Tomer

Dabbler
Joined
Jun 26, 2017
Messages
17
rs225 said:
Can you reconnect the disk you removed?

SMART data from that disk and the remaining disk would be good.
Code:
gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728
gptid/c946d9e8-54fc-11e7-a8bd-e83935bc7728
Click to expand...

No..
 
R

rs225

Guru
Joined
Jun 28, 2014
Messages
878
The first disk removed may be the only way to get the pool back to normal operation.

The other possibility is a bad cable on the other remaining disk. 27.5 million errors is very high.
 
T

Tomer

Dabbler
Joined
Jun 26, 2017
Messages
17
Hi,
The problem starts when i tried to get disk to go offline, then i get this error:

is this a bug?


Request Method: POST

Request URL: http://10.100.100.6/storage/zpool-R...e/gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728/

Software Version: FreeNAS-11.0-U2 (e417d8aa5)

Exception Type: MiddlewareError

Exception Value:
[MiddlewareError: b'Disk offline failed: "cannot offline gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728: no valid replicas, "']

Exception Location: ./freenasUI/middleware/notifier.py in zfs_offline_disk, line 1167

Server time: Sun, 24 Sep 2017 09:18:15 +0300

Traceback


Environment:

Software Version: FreeNAS-11.0-U2 (e417d8aa5)
Request Method: POST
Request URL: http://10.100.100.6/storage/zpool-R...e/gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728/


Traceback:
File "/usr/local/lib/python3.6/site-packages/django/core/handlers/exception.py" in inner
39. response = get_response(request)
File "/usr/local/lib/python3.6/site-packages/django/core/handlers/base.py" in _legacy_get_response
249. response = self._get_response(request)
File "/usr/local/lib/python3.6/site-packages/django/core/handlers/base.py" in _get_response
178. response = middleware_method(request, callback, callback_args, callback_kwargs)
File "./freenasUI/freeadmin/middleware.py" in process_view
162. return login_required(view_func)(request, *view_args, **view_kwargs)
File "/usr/local/lib/python3.6/site-packages/django/contrib/auth/decorators.py" in _wrapped_view
23. return view_func(request, *args, **kwargs)
File "./freenasUI/storage/views.py" in disk_offline
830. notifier().zfs_offline_disk(volume, label)
File "./freenasUI/middleware/notifier.py" in zfs_offline_disk
1167. raise MiddlewareError('Disk offline failed: "%s"' % error)

Exception Type: MiddlewareError at /storage/zpool-RAID10-Vstorage/disk/offline/gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728/
Exception Value: [MiddlewareError: b'Disk offline failed: "cannot offline gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728: no valid replicas, "']


Request information
GET

No GET data

POST

Variable Value

__form_id 'form_str'

FILES

No FILES data

COOKIES

Variable Value

csrftoken 'xn7JeEAXFU8eZlc5V7faOB1ggpONNaKqD7hubXDV1zOcLbUVVSLU1EtBAaq0Zwxo'

fntreeSaveStateCookie 'root%2Croot%2F64%2F65%2F78%2Croot%2F160%2Croot%2F10%2Croot%2F10%2F17%2Croot%2F64%2F65%2Croot%2F112%2Croot%2F161%2Croot%2F112%2F122%2Croot%2F1%2Croot%2F1%2F7%2Croot%2F66%2F93%2Croot%2F114%2Croot%2F114%2F124%2Croot%2F114%2F130%2Croot%2F66%2F67%2F76%2F81%2Croot%2F66%2F67%2F76%2F77%2Croot%2F118%2Croot%2F118%2F134%2Croot%2F118%2F134%2F136%2Croot%2F164%2Croot%2F12%2Croot%2F12%2F19%2Croot%2F183%2Croot%2F160%2F169%2Croot%2F160%2F169%2F171%2Croot%2F182%2Croot%2F105%2Croot%2F66%2Croot%2F66%2F67%2Croot%2F66%2F67%2F68'

sessionid 'ic6i54a49e87fv6o8b1e6i86jyz1lnuz'

META

Variable Value
 
SweetAndLow

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
Tomer said:
Hi,
The problem starts when i tried to get disk to go offline, then i get this error:

is this a bug?


Request Method: POST

Request URL: http://10.100.100.6/storage/zpool-R...e/gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728/

Software Version: FreeNAS-11.0-U2 (e417d8aa5)

Exception Type: MiddlewareError

Exception Value:
[MiddlewareError: b'Disk offline failed: "cannot offline gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728: no valid replicas, "']

Exception Location: ./freenasUI/middleware/notifier.py in zfs_offline_disk, line 1167

Server time: Sun, 24 Sep 2017 09:18:15 +0300

Traceback


Environment:

Software Version: FreeNAS-11.0-U2 (e417d8aa5)
Request Method: POST
Request URL: http://10.100.100.6/storage/zpool-R...e/gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728/


Traceback:
File "/usr/local/lib/python3.6/site-packages/django/core/handlers/exception.py" in inner
39. response = get_response(request)
File "/usr/local/lib/python3.6/site-packages/django/core/handlers/base.py" in _legacy_get_response
249. response = self._get_response(request)
File "/usr/local/lib/python3.6/site-packages/django/core/handlers/base.py" in _get_response
178. response = middleware_method(request, callback, callback_args, callback_kwargs)
File "./freenasUI/freeadmin/middleware.py" in process_view
162. return login_required(view_func)(request, *view_args, **view_kwargs)
File "/usr/local/lib/python3.6/site-packages/django/contrib/auth/decorators.py" in _wrapped_view
23. return view_func(request, *args, **kwargs)
File "./freenasUI/storage/views.py" in disk_offline
830. notifier().zfs_offline_disk(volume, label)
File "./freenasUI/middleware/notifier.py" in zfs_offline_disk
1167. raise MiddlewareError('Disk offline failed: "%s"' % error)

Exception Type: MiddlewareError at /storage/zpool-RAID10-Vstorage/disk/offline/gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728/
Exception Value: [MiddlewareError: b'Disk offline failed: "cannot offline gptid/b15d2ccb-95f8-11e7-b503-e83935bc7728: no valid replicas, "']


Request information
GET

No GET data

POST

Variable Value

__form_id 'form_str'

FILES

No FILES data

COOKIES

Variable Value

csrftoken 'xn7JeEAXFU8eZlc5V7faOB1ggpONNaKqD7hubXDV1zOcLbUVVSLU1EtBAaq0Zwxo'

fntreeSaveStateCookie 'root%2Croot%2F64%2F65%2F78%2Croot%2F160%2Croot%2F10%2Croot%2F10%2F17%2Croot%2F64%2F65%2Croot%2F112%2Croot%2F161%2Croot%2F112%2F122%2Croot%2F1%2Croot%2F1%2F7%2Croot%2F66%2F93%2Croot%2F114%2Croot%2F114%2F124%2Croot%2F114%2F130%2Croot%2F66%2F67%2F76%2F81%2Croot%2F66%2F67%2F76%2F77%2Croot%2F118%2Croot%2F118%2F134%2Croot%2F118%2F134%2F136%2Croot%2F164%2Croot%2F12%2Croot%2F12%2F19%2Croot%2F183%2Croot%2F160%2F169%2Croot%2F160%2F169%2F171%2Croot%2F182%2Croot%2F105%2Croot%2F66%2Croot%2F66%2F67%2Croot%2F66%2F67%2F68'

sessionid 'ic6i54a49e87fv6o8b1e6i86jyz1lnuz'

META

Variable Value
Click to expand...
I don't think you understand. You have multiple driver failures so all your data is gone. You need to destroy everything, rebuild your pool with working disk then restore your data from your backup. You can't offline a disk, you can't replace a disk. This is just what happens when multiple disk fail in a vdev.

Do you have smartctl -a info for the failed disks? We should make sure they are actually dead.
 
R

rs225

Guru
Joined
Jun 28, 2014
Messages
878
That isn't a bug. You can't offline a disk when you are in the degraded mode.

Do you still have the first disk? If so, you must connect it without removing any of the other related disks. The only other possibility is to figure out why you have so many errors and fix that problem if possible.
 
Status
Not open for further replies.

Important Announcement for the TrueNAS Community.

The TrueNAS Community has now been moved. This forum will now become READ-ONLY for historical purposes. Please feel free to join us on the new TrueNAS Community Forums.

Related topics on forums.truenas.com for thread: "help with Degraded and Unavail disks"

Similar threads

unca_NAS
  • Locked
SOLVED Unable to replace failed, UNAVAIL disk
Replies
12
Views
8K
Starpulkka
Starpulkka
N
  • Locked
Encrypted pool degraded and disks unavail
Replies
3
Views
2K
n01
N
L
  • Locked
Insufficient replicas for degraded raidz pool
Replies
3
Views
3K
kdragon75
kdragon75
D
  • Locked
zpool unknown - how to fix
Replies
14
Views
4K
dy1m9
D
alexfax
  • Locked
impossible import zpool state UNAVAIL
Replies
18
Views
12K
alexfax
alexfax
Top