One Drive Not Included in RaidZ-2 Pool?

Beorn1357

Cadet
Joined
Jun 4, 2023
Messages
1
I have two QNAP QM2-4P-384 Quad M.2 PCIe SSD Expansion Cards with four Samsung 980 Pro attached to each and one additional drive on the motherboard.
The system has a Xeon processor (8 threads) and 64GB of ECC RAM. There are also two SSDs in a Raid1 formation for TrueNAS Core. I started investigating
what originally appeared as an issue with the storage capacity. I was expecting 14TB of usable space but the GUI is reporting only 12TB. I ran
"zpool status -v Archive" and got the following output:
Code:
Archive                                                                     ONLINE       0     0     0
      raidz2-0                                                                  ONLINE       0     0     0
        gptid/83ca5b06-92e5-11ed-9d7f-001517bf02e1  ONLINE       0     0     0
        gptid/83cc2a61-92e5-11ed-9d7f-001517bf02e1  ONLINE       0     0     0
        gptid/83d9328a-92e5-11ed-9d7f-001517bf02e1  ONLINE       0     0     0
        gptid/83d2fa32-92e5-11ed-9d7f-001517bf02e1  ONLINE       0     0     0
        gptid/83d1d08b-92e5-11ed-9d7f-001517bf02e1  ONLINE       0     0     0
        gptid/83e2037c-92e5-11ed-9d7f-001517bf02e1  ONLINE       0     0     0
        gptid/83e7d88d-92e5-11ed-9d7f-001517bf02e1  ONLINE       0     0     0
        nvd7p2                                                                  ONLINE       0     0     0
        gptid/83e8d4b0-92e5-11ed-9d7f-001517bf02e1  ONLINE       0     0     0



The first thing I noticed was that one of the drives isn't being identified by gptid, nvd7p2.
I then ran "glabel list" and got the following output:


Geom name: nvd0p2
Providers:
1. Name: gptid/83ca5b06-92e5-11ed-9d7f-001517bf02e1
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e1
secoffset: 0
offset: 0
seclength: 3902834696
length: 1998251364352
index: 0
Consumers:
1. Name: nvd0p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2

Geom name: nvd1p2
Providers:
1. Name: gptid/83cc2a61-92e5-11ed-9d7f-001517bf02e1
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e1
secoffset: 0
offset: 0
seclength: 3902834696
length: 1998251364352
index: 0
Consumers:
1. Name: nvd1p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2

Geom name: nvd2p2
Providers:
1. Name: gptid/83d9328a-92e5-11ed-9d7f-001517bf02e1
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e1
secoffset: 0
offset: 0
seclength: 3902834696
length: 1998251364352
index: 0
Consumers:
1. Name: nvd2p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2

Geom name: nvd3p2
Providers:
1. Name: gptid/83d2fa32-92e5-11ed-9d7f-001517bf02e1
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e1
secoffset: 0
offset: 0
seclength: 3902834696
length: 1998251364352
index: 0
Consumers:
1. Name: nvd3p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2

Geom name: nvd4p2
Providers:
1. Name: gptid/83d1d08b-92e5-11ed-9d7f-001517bf02e1
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e1
secoffset: 0
offset: 0
seclength: 3902834696
length: 1998251364352
index: 0
Consumers:
1. Name: nvd4p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2

Geom name: nvd5p2
Providers:
1. Name: gptid/83e2037c-92e5-11ed-9d7f-001517bf02e1
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e1
secoffset: 0
offset: 0
seclength: 3902834696
length: 1998251364352
index: 0
Consumers:
1. Name: nvd5p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2

Geom name: nvd6p2
Providers:
1. Name: gptid/83e7d88d-92e5-11ed-9d7f-001517bf02e1
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e1
secoffset: 0
offset: 0
seclength: 3902834696
length: 1998251364352
index: 0
Consumers:
1. Name: nvd6p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2

Geom name: nvd8p2
Providers:
1. Name: gptid/83e8d4b0-92e5-11ed-9d7f-001517bf02e1
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e1
secoffset: 0
offset: 0
seclength: 3902834696
length: 1998251364352
index: 0
Consumers:
1. Name: nvd8p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2


There is no listing for nvd7p2 which I expected to see. The pool has been scrubbed several times and there are no
reported errors. The drive is listed as a part of the pool in the GUI but I am exactly 2TB short of what I expected
from the storage. The storage is at 67% capacity for 12TB. I've run several long and short smartctl test and all
the drives pass and the firmware is up to date on these drives. I thought to take the drive offline and reattach it
but it will not offline. I've only been using ZFS for about six months so I thought I'd ask more experienced users
what might be the problem. Any help would be appreciated.
 
Last edited by a moderator:
Top