Replacing HDD

[terryharris]

HI. I have a 1TB (Part of an 8 Drive Array) and I tried to replace it, the re-silver failed with the box hanging, I rebooted it and there was no mention of resilver and the drive was offline. I tried again and the same happened, however I now have the drives listed below. I have tried to detach the drives with zpool command but the box just freezes then restarts with the same degraded pool. Are then command I can run to remove the drives and add the new ada2 back to the pool?

Thanks

 

[Chris Moore]

First, stop trying to do drive replacements at the command line.
Then give hardware details, use this as a guide:
https://www.ixsystems.com/community/threads/forum-guidelines.45124

After that, give us the output of zpool status, and enclose the text in [CODE] tags like this, to preserve the formatting[/CODE] . It should come out looking like this:

Code:

  pool: Irene
 state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
        still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
        the pool may no longer be accessible by software that does not support
        the features. See zpool-features(7) for details.
  scan: scrub repaired 0 in 0 days 03:42:32 with 0 errors on Wed Aug  7 03:42:33 2019
config:

        NAME                                            STATE     READ WRITE CKSUM
        Irene                                           ONLINE       0     0     0
          raidz2-0                                      ONLINE       0     0     0
            gptid/8710385b-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/87e94156-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/88db19ad-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/89addd3b-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/8a865453-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/8b66b1ef-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
          raidz2-1                                      ONLINE       0     0     0
            gptid/8c69bc72-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/8d48655d-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/8e2b6d1f-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/8efea929-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/8fd4d25c-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0
            gptid/90c2759a-becf-11e8-b1c8-0cc47a9cd5a4  ONLINE       0     0     0

errors: No known data errors

 

[terryharris]

[CODE]
pool: DataStore
state: DEGRADED
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Fri Aug 9 10:28:00 2019
514G scanned at 2.76G/s, 1.40G issued at 18.9M/s, 4.55T total
0 resilvered, 0.03% done, 2 days 22:18:43 to go
config:

NAME STATE READ WRITE CKSUM
DataStore DEGRADED 0 0 0
raidz2-0 DEGRADED 0 0 0
gptid/f9731ff1-b144-11e9-a755-0015171ddf76 ONLINE 0 0 0
gptid/fbab8e38-b144-11e9-a755-0015171ddf76 ONLINE 0 0 0
replacing-2 DEGRADED 0 0 0
69284683364884838 OFFLINE 0 0 0 was /dev/gptid/fe3cf278-b144-11e9-a755-0015171ddf76
709672201460225457 OFFLINE 0 0 0 was /dev/gptid/3717eaca-b92c-11e9-a42a-6cb3111c2c8e
gptid/3ebf8691-b9a8-11e9-a624-6cb3111c2c8e ONLINE 0 0 0
ada3p2 ONLINE 0 0 0
gptid/01ff52ab-b145-11e9-a755-0015171ddf76 ONLINE 0 0 0
gptid/0435b8be-b145-11e9-a755-0015171ddf76 ONLINE 0 0 0
gptid/06ae048d-b145-11e9-a755-0015171ddf76 ONLINE 0 0 0
gptid/08d23be2-b145-11e9-a755-0015171ddf76 ONLINE 0 0 0

errors: No known data errors

pool: freenas-boot
state: ONLINE
status: One or more devices are configured to use a non-native block size.
Expect reduced performance.
action: Replace affected devices with devices that support the
configured block size, or migrate data to a properly configured
pool.
scan: scrub repaired 0 in 0 days 00:00:03 with 0 errors on Mon Aug 5 03:45:03 2019
config:

NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
ada8p2 ONLINE 0 0 0
ada12p2 ONLINE 0 0 0 block size: 512B configured, 4096B native

errors: No known data errors

pool: ssdtemp
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
ssdtemp ONLINE 0 0 0
gptid/564962f6-b571-11e9-b45a-6cb3111c2c8e ONLINE 0 0 0

errors: No known data errors

pool: tbmirror
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
tbmirror ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
gptid/ed299dc7-b547-11e9-b45a-6cb3111c2c8e ONLINE 0 0 0
gptid/eebce0d4-b547-11e9-b45a-6cb3111c2c8e ONLINE 0 0 0

errors: No known data errors[/CODE]

Hi Ive added my config to the signature. Except Drives (too many lines.)

The pool that's playing up is an eight drive (x1TB) array connected to the ASMedia Sata via two esata ports to an external enclosure. This was running as a windows pool flawlessly for a few years and as an array on Ubuntu for the last couple of months. I then decommissioned a HP to become a freenas, then transferred the hardware to the Dell as it had more ram, ports and an i7 so I could create VM's

Thanks

Drives below.

Code:

ada1
DataStore
WD-WMAV50174433
931.51 GiB
DISABLED
DISABLED
yes
more_vert





ada2
DataStore
WD-WMAV50142932
931.51 GiB
DISABLED
DISABLED
yes
more_vert





ada3
DataStore
WD-WMAV50140705
931.51 GiB
DISABLED
DISABLED
yes
more_vert





ada4
DataStore
S1D3K5AD
931.51 GiB
DISABLED
DISABLED
yes
more_vert





ada5
DataStore
WD-WMAV50084851
931.51 GiB
DISABLED
DISABLED
yes
more_vert





ada6
DataStore
WD-WMAV50081485
931.51 GiB
DISABLED
DISABLED
yes
more_vert





ada7
DataStore
WD-WMAV50204476
931.51 GiB
DISABLED
DISABLED
yes
more_vert





ada8
Boot Pool
2019022500026
223.57 GiB
DISABLED
DISABLED
yes
more_vert





ada9
ssdtemp
S15FNSAD209496
119.24 GiB
DISABLED
DISABLED
yes
more_vert





ada10
tbmirror
JP2911HZ3XBB1C
931.51 GiB
DISABLED
DISABLED
yes
more_vert





ada11
tbmirror
S1D3KHSP
931.51 GiB
DISABLED
DISABLED
yes
more_vert





ada12
Boot Pool
S1DHNSAFB90836H
465.76 GiB
DISABLED
DISABLED
yes
more_vert

 

[terryharris]

Lost all confidence in freenas right now. I have tried to manually copy the data across to 2 new 4TB drives installed but the system keeps failing re-silver and restarting.

 

[Heracles]

Hey Terry,

As an appliance, it is way better to use FreeNAS's WebUI whenever possible. This is true for disk replacement.

Your pool being built with RaidZ-2, you are still safe even with that problematic. It needs to be replace and do not waste time, but no need to panic either. Even myself as of now I am running on a degraded pool in my main server. I will offline the server today and do the basic checks.

To replace the drive, go in the WebUI, select that drive and turn it to Offline. Once offline, you physically replace the bad drive with a good one, powering down the server first if yours is not hot plug capable. Once the good drive is in place, you can go back in the WebUI and select that new drive to replace the old one. FreeNAS will do the resilver and you should be good after that.

It is good to test new material before putting it in your server because too many devices are Defective On Arrival. In this case, because you are RaidZ-2 and already short by a drive, you may be better to put a new drive in right away instead of doing few days of testing before.

Should you prefer to use anything else than FreeNAS, feel free to do it. Just know that whatever appliance-style solution you will use, it is always better to use it as designed. Here, my firewall is pfSense, another appliance-style solution based on FreeBSD just like FreeNAS. For both of them, the WebUI is the first if not the only way to interact with it.

Good luck fixing your case,

 

[terryharris]

Why have a got 2 guid replacements, as per the attachment above?

 

[terryharris]

Even though my data isn't that important as I have been trying FreeNas, It seems to be pretty poor and defiantly not usable in a production environment. The Re-silver fails constantly, other drives are fine with zero errors, no commands seem to work. Backing up data via ssh while the pool is degraded is slow (somewhat expected but not 85% slower) as well as to add to the mix the box reboots periodically when the re-silver does complete but does not register this and so starts from zero again. As for the stupid reply above about using the GUI and not the CLI, I would expect that only from a novice. The GUI would be executing commands that can be entered manually, that's always the case. The GUI has failed here and so I have resorted to CLI to fix the issues. No one has offered the a solution to remove the faulty vdev / dev entries or a way to stabilize the box to retrieve data, then simply blow the faulty pool away and recreate. I created the fault deliberately removing the drive to ascertain if a recovery was flawless, its absolutely not and worryingly so poor its only suitable for non critical uses.

 

[Jailer]

This isn't a FreeNAS problem. Lose the asmedia card and get a real HBA and your problems will likely disappear.