<div class="bbWrapper"><blockquote data-attributes="member: 117605" data-quote="Davvo" data-source="post: 776629"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776629"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776629">Davvo said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
The fastest the new drives come home, the safest for your data.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Not entirely, because I'm still not replacing the entire pool.<br />
However, maybe it'd be best for me to add on the old drives to the current vdevs and turn all of them into 3-way mirrors.<br />
<br />
That being said, <a href="https://www.truenas.com/community/threads/migrating-to-new-drives-ironwolf-hdd-pro-other.111646/post-776567" class="link link--internal">I still</a> am trying to find information on how to actually properly add in the 20tb drives, while removing the other vdevs.</div>
<div class="bbWrapper"><blockquote data-attributes="member: 113736" data-quote="isopropyl" data-source="post: 776637"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776637"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776637">isopropyl said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
Not entirely, because I'm still not replacing the entire pool.<br />
However, maybe it'd be best for me to add on the old drives to the current vdevs and turn all of them into 3-way mirrors.<br />
<br />
That being said, <a href="https://www.truenas.com/community/threads/migrating-to-new-drives-ironwolf-hdd-pro-other.111646/post-776567" class="link link--internal">I still</a> am trying to find information on how to actually properly add in the 20tb drives, while removing the other vdevs.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>
<div class="bbCodeBlock bbCodeBlock--unfurl js-unfurl fauxBlockLink"
data-unfurl="true" data-result-id="38543" data-url="https://www.truenas.com/docs/core/coretutorials/storage/pools/managingpools/" data-host="www.truenas.com" data-pending="false">
<div class="contentRow">
<div class="contentRow-figure contentRow-figure--fixedSmall js-unfurl-figure">
<img src="https://www.truenas.com/docs/images/open-enterprise-storage--logo-full-color-rgb-large.png" alt="www.truenas.com" data-onerror="hide-parent"/>
</div>
<div class="contentRow-main">
<h3 class="contentRow-header js-unfurl-title">
<a href="https://www.truenas.com/docs/core/coretutorials/storage/pools/managingpools/"
class="link link--internal fauxBlockLink-blockLink"
target=""
rel=""
data-proxy-href="">
Managing Pools
</a>
</h3>
<div class="contentRow-snippet js-unfurl-desc">Describes how to manage storage pools on TrueNAS CORE.</div>
<div class="contentRow-minor contentRow-minor--hideLinks">
<span class="js-unfurl-favicon">
<img src="https://www.truenas.com/docs/core/coretutorials/storage/pools/managingpools/" alt="www.truenas.com" class="bbCodeBlockUnfurl-icon"
data-onerror="hide-parent"/>
</span>
www.truenas.com
</div>
</div>
</div>
</div>
First you expand the pool adding a vdev made of the new drives.</div>
<div class="bbWrapper"><blockquote data-attributes="member: 117605" data-quote="Davvo" data-source="post: 776638"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776638"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776638">Davvo said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
<div class="bbCodeBlock bbCodeBlock--unfurl js-unfurl fauxBlockLink"
data-unfurl="true" data-result-id="38543" data-url="https://www.truenas.com/docs/core/coretutorials/storage/pools/managingpools/" data-host="www.truenas.com" data-pending="false">
<div class="contentRow">
<div class="contentRow-figure contentRow-figure--fixedSmall js-unfurl-figure">
<img src="https://www.truenas.com/docs/images/open-enterprise-storage--logo-full-color-rgb-large.png" alt="www.truenas.com" data-onerror="hide-parent"/>
</div>
<div class="contentRow-main">
<h3 class="contentRow-header js-unfurl-title">
<a href="https://www.truenas.com/docs/core/coretutorials/storage/pools/managingpools/"
class="link link--internal fauxBlockLink-blockLink"
target=""
rel=""
data-proxy-href="">
Managing Pools
</a>
</h3>
<div class="contentRow-snippet js-unfurl-desc">Describes how to manage storage pools on TrueNAS CORE.</div>
<div class="contentRow-minor contentRow-minor--hideLinks">
<span class="js-unfurl-favicon">
<img src="https://www.truenas.com/docs/core/coretutorials/storage/pools/managingpools/" alt="www.truenas.com" class="bbCodeBlockUnfurl-icon"
data-onerror="hide-parent"/>
</span>
www.truenas.com
</div>
</div>
</div>
</div>
First you expand the pool adding a vdev made of the new drives.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>How would this work though, If I am going to be removing the old vdevs? That's what is confusing me I think. Because the data needs to be moved onto the new drives, so it is safe to remove the old drives.<br />
<br />
________________<br />
<br />
<div class="bbCodeBlock bbCodeBlock--unfurl js-unfurl fauxBlockLink"
data-unfurl="true" data-result-id="43242" data-url="https://www.truenas.com/community/threads/migrating-to-new-drives-ironwolf-hdd-pro-other.111646/post-773560" data-host="www.truenas.com" data-pending="false">
<div class="contentRow">
<div class="contentRow-main">
<h3 class="contentRow-header js-unfurl-title">
<a href="https://www.truenas.com/community/threads/migrating-to-new-drives-ironwolf-hdd-pro-other.111646/post-773560"
class="link link--internal fauxBlockLink-blockLink"
target=""
rel=""
data-proxy-href="">
Migrating To New Drives, Ironwolf HDD Pro? Other?
</a>
</h3>
<div class="contentRow-snippet js-unfurl-desc">I want to migrate my drives sometime soon. Currently my system is running mirror pairs of x15 SAS drives. x2 of which are spares. They are all used HGST HUS726040AL4210 & HITACHI HUS72604CLAR4000 drives, stamped with 2016 dates. So they are quite old and are making me nervous. While they are...</div>
<div class="contentRow-minor contentRow-minor--hideLinks">
<span class="js-unfurl-favicon">
<img src="https://www.truenas.com/community/data/assets/logo/FORUMSFAVICON.png" alt="www.truenas.com" class="bbCodeBlockUnfurl-icon"
data-onerror="hide-parent"/>
</span>
www.truenas.com
</div>
</div>
</div>
</div>
Basically, if I am re-reading correctly. I can remove x2 of my 4tb vdevs, and replace them with the 20tb vdev. Given I want to keep my current remaining space.<br />
<br />
So when I put in these 20tb drives, I can remove 8 of my 4tb drives (2 vdevs) and I should still have my current ~5-6tb of free space to use. Correct?<br />
(If I removed 3 vdevs, I'd lose that free space.)</div>
<div class="bbWrapper">Sorry, I think I lost the big picture. What is the final configuration you want to have for your pools?<br />
<br />
I understand one pool of two mirrored 20TB drives. What is the configuration of the second pool? Are you wanting mirrors of old 4TB drives or a RAIDZ2 of old 4TB drives? And how many drives?<br />
<blockquote data-attributes="member: 113736" data-quote="isopropyl" data-source="post: 776641"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776641"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776641">isopropyl said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
So when I put in these 20tb drives, I can remove 8 of my 4tb drives (2 vdevs) and I should still have my current ~5-6tb of free space to use. Correct?
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>I'm really confused about what you think your configuration will be. If you make a 20TB Mirror and you are able to place 19.4 TB of data on it, you have no space left. That is assuming you can fit 19.4TB of data on it, I doubt it. So yes, please explain your desired end configuration, I think you posted it in these 5 pages of text but I didn't see it.</div>
<div class="bbWrapper">You add more space with the big drives vdev, the you detach the drive from the WebUI and the<br />
<blockquote data-attributes="member: 101" data-quote="joeschmuck" data-source="post: 776721"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776721"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776721">joeschmuck said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
Sorry, I think I lost the big picture. What is the final configuration you want to have for your pools?<br />
<br />
I understand one pool of two mirrored 20TB drives. What is the configuration of the second pool? Are you wanting mirrors of old 4TB drives or a RAIDZ2 of old 4TB drives? And how many drives?<br />
<br />
I'm really confused about what you think your configuration will be. If you make a 20TB Mirror and you are able to place 19.4 TB of data on it, you have no space left. That is assuming you can fit 19.4TB of data on it, I doubt it. So yes, please explain your desired end configuration, I think you posted it in these 5 pages of text but I didn't see it.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Nope, another thread.<br />
<div class="bbCodeBlock bbCodeBlock--unfurl js-unfurl fauxBlockLink"
data-unfurl="true" data-result-id="43242" data-url="https://www.truenas.com/community/threads/migrating-to-new-drives-ironwolf-hdd-pro-other.111646/post-773560" data-host="www.truenas.com" data-pending="false">
<div class="contentRow">
<div class="contentRow-main">
<h3 class="contentRow-header js-unfurl-title">
<a href="https://www.truenas.com/community/threads/migrating-to-new-drives-ironwolf-hdd-pro-other.111646/post-773560"
class="link link--internal fauxBlockLink-blockLink"
target=""
rel=""
data-proxy-href="">
Migrating To New Drives, Ironwolf HDD Pro? Other?
</a>
</h3>
<div class="contentRow-snippet js-unfurl-desc">I want to migrate my drives sometime soon. Currently my system is running mirror pairs of x15 SAS drives. x2 of which are spares. They are all used HGST HUS726040AL4210 & HITACHI HUS72604CLAR4000 drives, stamped with 2016 dates. So they are quite old and are making me nervous. While they are...</div>
<div class="contentRow-minor contentRow-minor--hideLinks">
<span class="js-unfurl-favicon">
<img src="https://www.truenas.com/community/data/assets/logo/FORUMSFAVICON.png" alt="www.truenas.com" class="bbCodeBlockUnfurl-icon"
data-onerror="hide-parent"/>
</span>
www.truenas.com
</div>
</div>
</div>
</div></div>
<div class="bbWrapper"><blockquote data-attributes="member: 101" data-quote="joeschmuck" data-source="post: 776721"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776721"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776721">joeschmuck said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
Sorry, I think I lost the big picture. What is the final configuration you want to have for your pools?<br />
<br />
I understand one pool of two mirrored 20TB drives. What is the configuration of the second pool? Are you wanting mirrors of old 4TB drives or a RAIDZ2 of old 4TB drives? And how many drives?<br />
<br />
I'm really confused about what you think your configuration will be. If you make a 20TB Mirror and you are able to place 19.4 TB of data on it, you have no space left. That is assuming you can fit 19.4TB of data on it, I doubt it. So yes, please explain your desired end configuration, I think you posted it in these 5 pages of text but I didn't see it.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Look at the thread he linked, but basically replace a few of the vdevs with the 20tb drives as a 3-way mirror. And keep a handful of the 4tb vdevs. So it'd be a mixture of the both. Then when I can allocate more funds in the near future to replacing the others eventually it'd be an all 20tb vdev.<br />
I think it came out to be needing 9 of the 20tb drives to complete it.<br />
<br />
So my pool would turn from x7 4tb vdevs, to x5 4tb 2-way mirror vdevs and x1 20tb 3-way mirror vdev, although I may reuse the old 4tb drives and add them on to the others to make them all 4tb 3-way mirror vdevs instead of 2-way<br />
<blockquote data-attributes="member: 117605" data-quote="Davvo" data-source="post: 776768"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776768"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776768">Davvo said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
You add more space with the big drives vdev, the you detach the drive from the WebUI and the
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>But when I add more drives by expanding it, it's in a separate vdev. So the data will be spread across that vdev too.<br />
The data isn't being moved from the vdevs I'm wanting to remove, onto those drives. So I can't just go and put in the vdev, and then completely remove the other vdevs. The data needs to come off of them.</div>
<div class="bbWrapper"><blockquote data-attributes="member: 113736" data-quote="isopropyl" data-source="post: 776625"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776625"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776625">isopropyl said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
That being said, I am currently running a scrub again. It seems a little too weird to me. But maybe the drive was just seated weird or something.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>On a side note, the scrub didn't find any issues. Interesting</div>
<div class="bbWrapper"><blockquote data-attributes="member: 113736" data-quote="isopropyl" data-source="post: 776780"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776780"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776780">isopropyl said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
But when I add more drives by expanding it, it's in a separate vdev. So the data will be spread across that vdev too.<br />
The data isn't being moved from the vdevs I'm wanting to remove, onto those drives. So I can't just go and put in the vdev, and then completely remove the other vdevs. The data needs to come off of them.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Seems a bit complicated to me. As long as it's clear in your mind, that is what counts and I hope it works out the way you want.</div>
<div class="bbWrapper"><blockquote data-attributes="member: 113736" data-quote="isopropyl" data-source="post: 776780"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776780"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776780">isopropyl said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
The data isn't being moved from the vdevs I'm wanting to remove, onto those drives. So I can't just go and put in the vdev, and then completely remove the other vdevs. The data needs to come off of them.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>As far as I am aware, that's exactly what should happen if you have enough space. I am talking about the WebUI, not the shell.<br />
Can anyone confirm this?</div>
<div class="bbWrapper"><blockquote data-attributes="member: 101" data-quote="joeschmuck" data-source="post: 776789"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776789"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776789">joeschmuck said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
Seems a bit complicated to me. As long as it's clear in your mind, that is what counts and I hope it works out the way you want.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Complicated how so? I just don't have the money to replace all of my vdevs with 20tb drives upfront. So I will replace part of it for now basically.<br />
Basically replacing a few vdevs with 1 vdev of higher capcity drives.<br />
<br />
Beyond that, as I said I will probably take the drives I'm pulling out, and just attach them but onto the other vdevs to turn them into 3-way mirrors just for added reliability on those vdevs.<br />
So it'd turn the system from 7 vdevs of 4tb 2-way mirrors into >> x1 3-way mirror of 20tb drives, and like 5 vdevs of 4tb 3-way mirrors. Until I can replace those 4tb vdevs with more 20tb vdevs in the future, and eventually weed out all the unreliable old 4tb drives.<br />
<blockquote data-attributes="member: 117605" data-quote="Davvo" data-source="post: 776794"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776794"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776794">Davvo said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
As far as I am aware, that's exactly what should happen if you have enough space. I am talking about the WebUI, not the shell.<br />
Can anyone confirm this?
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Would like confirmation as well. But yeah something doesn't ring right in my mind with that process. Because the data is sparsed across all vdevs. If I put in the 20tb mirror, and then just go remove the other vdevs, they still have my data on it.<br />
How would truenas know "he is planning to remove these vdevs, so we need to make sure to move all the data over to this new vdev"?</div>
<div class="bbWrapper"><blockquote data-attributes="member: 113736" data-quote="isopropyl" data-source="post: 776857"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776857"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776857">isopropyl said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
If I put in the 20tb mirror, and then just go remove the other vdevs, they still have my data on it.<br />
How would truenas know "he is planning to remove these vdevs, so we need to make sure to move all the data over to this new vdev"?
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>You don't just pull them out you have to [software] detach them.</div>
<div class="bbWrapper"><blockquote data-attributes="member: 117605" data-quote="Davvo" data-source="post: 776890"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776890"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776890">Davvo said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
You don't just pull them out you have to [software] detach them.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>No I get that, but how will truenas know they are staying out and the data needs to be moved off of them onto the new drives?<br />
Could detach not be utilized for other circumstances where you plan to put that drive back in?</div>
<div class="bbWrapper"><blockquote data-attributes="member: 113736" data-quote="isopropyl" data-source="post: 776977"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776977"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776977">isopropyl said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
No I get that, but how will truenas know they are staying out and the data needs to be moved off of them onto the new drives?<br />
Could detach not be utilized for other circumstances where you plan to put that drive back in?
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Iirc TN doesn't allow you to bring a VDEV offline if doing so offlines your pool.</div>
<div class="bbWrapper">So basically how it works is<br />
<br />
I add in the 3 20tb drives as a new vdev <br />
Then I go and click detatch on each of the 2 drives in any of my 4tb vdevs<br />
it will auto resilver onto the 20tb drives<br />
and then I can remove them<br />
And then I go and click detatch on each of the 2 drives in another 4tb vdev<br />
It will resilver<br />
And I can remove them<br />
<br />
Now the data is on the 20tb drives, and I can go and reattach the 4 4tb drives to the existing pools to turn them into 3 way mirrors.<br />
<br />
Correct?<br />
<br />
For the first part, should I detatch both drives in a vdev st once, because its gonna kick in my spare drives too</div>
<div class="bbWrapper">Btw the new drives came in today, but I will probably run a conveyence smart test on them first, and then and long smart before I pop them in.<br />
My whole rack is getting redone on tuesday so I can't pop them in anyways because if they don't finish resilvering in time I don't want to have to shut the server down during a resilver.<br />
<br />
<br />
<blockquote data-attributes="member: 113736" data-quote="isopropyl" data-source="post: 776625"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=776625"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-776625">isopropyl said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
That being said, I am currently running a scrub again. It seems a little too weird to me. But maybe the drive was just seated weird or something.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Also in regards to this, I stated that the pool shows healthy now and it ran another scrub last night and still shows healthy.<br />
That spare still shows in use though, should I just detatch it?<br />
<br />
<div class="bbCodeBlock bbCodeCode"><div class="type">Code:</div><pre> zpool status -v
pool: PrimaryPool
state: ONLINE
scan: scrub repaired 0B in 15:04:36 with 0 errors on Fri Aug 25 02:57:48 2023
config:
NAME STATE READ WRITE CKSUM
PrimaryPool ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
gptid/d7476d46-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
gptid/d8d6aa36-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
mirror-1 ONLINE 0 0 0
gptid/d9a6f5dc-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
gptid/db71bcb5-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
mirror-2 ONLINE 0 0 0
gptid/d8b2f42f-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
gptid/d96847a9-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
mirror-3 ONLINE 0 0 0
gptid/d9fb7757-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
gptid/da1e1121-32ca-11ec-b815-002590f52cc2 ONLINE 0 0 0
mirror-4 ONLINE 0 0 0
gptid/9fd0872d-8f64-11ec-8462-002590f52cc2 ONLINE 0 0 0
gptid/9ff0f041-8f64-11ec-8462-002590f52cc2 ONLINE 0 0 0
mirror-5 ONLINE 0 0 0
gptid/14811777-1b6d-11ed-8423-ac1f6be66d76 ONLINE 0 0 0
gptid/0cd1e905-3c2e-11ee-96af-ac1f6be66d76 ONLINE 0 0 0
mirror-6 ONLINE 0 0 0
gptid/749a1891-1b5c-11ee-941f-ac1f6be66d76 ONLINE 0 0 0
spare-1 ONLINE 0 0 0
gptid/c774316e-3c2c-11ee-96af-ac1f6be66d76 ONLINE 0 0 0
gptid/0d48d4ab-1e91-11ed-a6aa-ac1f6be66d76 ONLINE 0 0 0
spares
gptid/0d48d4ab-1e91-11ed-a6aa-ac1f6be66d76 INUSE currently in use
gptid/0d56b97d-1e91-11ed-a6aa-ac1f6be66d76 AVAIL
errors: No known data errors
pool: boot-pool
state: ONLINE
status: Some supported and requested features are not enabled on the pool.
The pool can still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: scrub repaired 0B in 00:01:06 with 0 errors on Sat Aug 26 03:46:06 2023
config:</pre></div></div>
<div class="bbWrapper"><blockquote data-attributes="member: 117605" data-quote="Davvo" data-source="post: 777010"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=777010"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-777010">Davvo said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
Detatch those spares.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Just tried detatching that one that is in use and getting and error.<br />
<br />
<div class="bbCodeBlock bbCodeCode"><div class="type">Code:</div><pre>EZFS_NOTSUP] Cannot detach root-level vdevs
Error: concurrent.futures.process._RemoteTraceback:
"""
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/zfs.py", line 232, in __zfs_vdev_operation
op(target, *args)
File "libzfs.pyx", line 402, in libzfs.ZFS.__exit__
File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/zfs.py", line 232, in __zfs_vdev_operation
op(target, *args)
File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/zfs.py", line 241, in <lambda>
self.__zfs_vdev_operation(name, label, lambda target: target.detach())
File "libzfs.pyx", line 2158, in libzfs.ZFSVdev.detach
libzfs.ZFSException: Cannot detach root-level vdevs
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/concurrent/futures/process.py", line 246, in _process_worker
r = call_item.fn(*call_item.args, **call_item.kwargs)
File "/usr/local/lib/python3.9/site-packages/middlewared/worker.py", line 111, in main_worker
res = MIDDLEWARE._run(*call_args)
File "/usr/local/lib/python3.9/site-packages/middlewared/worker.py", line 45, in _run
return self._call(name, serviceobj, methodobj, args, job=job)
File "/usr/local/lib/python3.9/site-packages/middlewared/worker.py", line 39, in _call
return methodobj(*params)
File "/usr/local/lib/python3.9/site-packages/middlewared/worker.py", line 39, in _call
return methodobj(*params)
File "/usr/local/lib/python3.9/site-packages/middlewared/schema.py", line 985, in nf
return f(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/zfs.py", line 241, in detach
self.__zfs_vdev_operation(name, label, lambda target: target.detach())
File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/zfs.py", line 234, in __zfs_vdev_operation
raise CallError(str(e), e.code)
middlewared.service_exception.CallError: [EZFS_NOTSUP] Cannot detach root-level vdevs
"""
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 139, in call_method
result = await self.middleware._call(message['method'], serviceobj, methodobj, params, app=self)
File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1236, in _call
return await methodobj(*prepared_call.args)
File "/usr/local/lib/python3.9/site-packages/middlewared/schema.py", line 981, in nf
return await f(*args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/pool.py", line 1103, in detach
await self.middleware.call('zfs.pool.detach', pool['name'], found[1]['guid'])
File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1279, in call
return await self._call(
File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1244, in _call
return await self._call_worker(name, *prepared_call.args)
File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1250, in _call_worker
return await self.run_in_proc(main_worker, name, args, job)
File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1169, in run_in_proc
return await self.run_in_executor(self.__procpool, method, *args, **kwargs)
File "/usr/local/lib/python3.9/site-packages/middlewared/main.py", line 1152, in run_in_executor
return await loop.run_in_executor(pool, functools.partial(method, *args, **kwargs))
middlewared.service_exception.CallError: [EZFS_NOTSUP] Cannot detach root-level vdevs
</pre></div></div>
<div class="bbWrapper"><a href="https://www.truenas.com/community/members/55604/" class="username" data-xf-init="member-tooltip" data-user-id="55604" data-username="@sretalla">@sretalla</a> any idea why?</div>
