SOLVED No member disk option under "Replace Drive"

[shimon]

Have 8 x 6TB WD Red drives in a pool using v11.35-U5. Drive ada3 developed an unreadable sector.

I followed the manual and put the drive Offline then shut down system. Replaced drive with a new one and turned on system. I chose Replace for the drive but in the pop-up window there is no choice under "Member Drive".

I see that another drive is now called ada3 and the only free drive designator is ada2. Can that be the issue? Or do I just choose "force"?

I did search but the posts I saw with the same problem didn't put the drive offline before swapping. The closest post I saw is this one but at least he had the option of another drive under Member Drive where I have no choices: https://www.truenas.com/community/t...ly-can-replace-the-wrong-dev-da-number.77538/

 

[shimon]

BTW...I did shutdown and re-seat the drive and that didn't help.

 

[Samuel Tai]

Drive identifiers can change between boots. Look under Storage->Drives to see if ada2's serial number matches the new drive.

 

[shimon]

Drive identifiers can change between boots. Look under Storage->Drives to see if ada2's serial number matches the new drive.

Actually, the new drive doesn't even show up under Storage>Disks. I thought ada2 was free but it's actually the SSD that came with the unit (IX Systems mini XL). See attachment.

I looked in the manual about renaming drives but can't find anything. Not sure if the SSD is supposed to be ada2 or if it really matters. I guess the next drive would be ada8 but I can't enter it manually into the "member disk" option.

I replaced a drive a couple of years ago using the standard procedure (offline/replace) and didn't have these problems then.

 

[shimon]

I tried something hoping it would work but didn't.

I installed the old drive and put it online and I was back to normal. I then put it offline and hot-swapped the replacement drive in hoping that without a reboot the drive naming would not change. But when I select replace, I still have no choices for selecting a drive. I selected the force checkbox but "confirm" is greyed out. I can put the drive online ok but it shows the the drive as unavailable and I still can't choose replace.

If I go to Storage>Disks, the drive doesn't show up and there isn't an ada3 (which is what the old drive was). Went to Import Disk but no disks are available in the drop down menu.

Is there a way to make it available?

 

[shimon]

Also here is the results of zpool status -v and camcontrol devlist

Code:

root@freenas:~ # zpool status -v
  pool: freenas-boot
 state: ONLINE
  scan: scrub repaired 0 in 0 days 00:02:42 with 0 errors on Tue Oct 12 03:47:42 2021
config:

        NAME        STATE     READ WRITE CKSUM
        freenas-boot  ONLINE       0     0     0
          ada2p2    ONLINE       0     0     0

errors: No known data errors

  pool: smnas
 state: DEGRADED
status: One or more devices could not be opened.  Sufficient replicas exist for
        the pool to continue functioning in a degraded state.
action: Attach the missing device and online it using 'zpool online'.
   see: http://illumos.org/msg/ZFS-8000-2Q
  scan: resilvered 15.9M in 0 days 00:00:10 with 0 errors on Tue Oct 12 07:41:00 2021
config:

        NAME                                            STATE     READ WRITE CKSUM
        smnas                                           DEGRADED     0     0 0
          raidz3-0                                      DEGRADED     0     0 0
            gptid/af2fb0a9-2ab1-11e8-b18f-d05099c09f1e  ONLINE       0     0 0
            gptid/9a0df1ca-2337-11e8-809f-d05099c09f1e  ONLINE       0     0 0
            gptid/09127f01-264b-11e8-b18f-d05099c09f1e  ONLINE       0     0 0
            6067457576715001596                         UNAVAIL      0     0 0  was /dev/gptid/25165fe3-2713-11e8-b18f-d05099c09f1e
            gptid/0102f063-bbdb-11e7-809f-d05099c09f1e  ONLINE       0     0 0
            gptid/092fa248-2a08-11e8-b18f-d05099c09f1e  ONLINE       0     0 0
            gptid/fd2d805c-2267-11e8-809f-d05099c09f1e  ONLINE       0     0 0
            gptid/47c8affb-2bc8-11e8-b18f-d05099c09f1e  ONLINE       0     0 0

errors: No known data errors



root@freenas:~ # camcontrol devlist
<WDC WD60EFRX-68L0BN1 82.00A82>    at scbus0 target 0 lun 0 (pass0,ada0)
<WDC WD60EFRX-68L0BN1 82.00A82>    at scbus1 target 0 lun 0 (pass1,ada1)
<16GB SATA Flash Drive SFDK002A>   at scbus4 target 0 lun 0 (pass2,ada2)
<Marvell Console 1.01>             at scbus9 target 0 lun 0 (pass3)
<WDC WD60EFRX-68L0BN1 82.00A82>    at scbus11 target 0 lun 0 (pass5,ada4)
<WDC WD60EFRX-68L0BN1 82.00A82>    at scbus12 target 0 lun 0 (pass6,ada5)
<WDC WD60EFRX-68L0BN1 82.00A82>    at scbus13 target 0 lun 0 (pass7,ada6)
<WDC WD60EFRX-68L0BN1 82.00A82>    at scbus14 target 0 lun 0 (pass8,ada7)
<WDC WD60EFRX-68L0BN1 82.00A82>    at scbus15 target 0 lun 0 (pass9,ada8)

 

[Samuel Tai]

Very peculiar. Can you provide some more details about your hardware?

 

[shimon]

Very peculiar. Can you provide some more details about your hardware?

It's an IX Systems Mini XL bought in 2016 through Amazon (this one). Came with 4TB drives but replaced with 8 x WD 6TB Red drives installed in 2018. 32GB RAM. Micron M600 SSD flash cache drive 16GB (I think). ASRock C2750D4I motherboard which was replaced in 2018 under warranty.

I'm beginning to suspect maybe the new drive I got from WD is bad. I just ordered it last week direct from WD. Is there a way to test it? I can try to format it with a Windows machine but not sure if that's a good idea or not. Not sure how to do it under FreeNAS if the drive is unavailable.

Attached image of new drive label.

Thanks for your time.

 

[Samuel Tai]

Yes, you got a SMR drive WD60EFAX, which has bad behavior with ZFS. You should get that swapped for a CMR drive WD60EFRX.

 

[shimon]

Yes, you got a SMR drive WD60EFAX, which has bad behavior with ZFS. You should get that swapped for a CMR drive WD60EFRX.

Interesting. I'm sending this drive back. It seems like the WD60EFRX that you recommend is discontinued and the ones that are available are very expensive.

What about the WD60EFZX which is listed as CMR on this datasheet and appears to be the replacement model for the EFRX.

 

[Samuel Tai]

The EFZX is OK.

 

[shimon]

Thanks for the assistance, Samuel.

When I get the new drive I'll update this post with the results.

 

[shimon]

I received the new drive today and the swap was fast and easy per the manual. Drive is currently re-silvering. Thanks again for the help.