zdb command not giving expected results

[Jared Smith]

<div class="bbWrapper">I'm new to FreeNAS. Decided to doing some benchmarking. I rsynced about 375 GB data to a dataset without dedup enabled (using NFS share). Then did the same to a data set with dedup enabled. I expected to run some zdb commands to get some finer grained statistics but when I do it does not recognize my zpool.<br /> <br /> [root@freenas] ~# zpool list<br /> NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT<br /> freenas-boot 14.9G 482M 14.4G - - 3% 1.00x ONLINE -<br /> storage 5.44T 753G 4.70T - 10% 13% 1.79x ONLINE /mnt<br /> [root@freenas] ~# zdb -D storage<br /> zdb: can't open 'storage': No such file or directory<br /> [root@freenas] ~#<br /> <br /> I found a similar report in a bug report<br /> <br /> <a href="https://bugs.freenas.org/issues/7877" target="_blank" class="link link--external" rel="nofollow ugc noopener">https://bugs.freenas.org/issues/7877</a><br /> <br /> Should I be able to see output from the zdb command for my zpool &quot;storage&quot;?<br /> <br /> zdb commands work just fine for zpool &quot;freenas-boot&quot; <br /> <br /> Any thoughts?</div>

 

[Jared Smith]

<div class="bbWrapper">I guess I better describe my system so I don't get my hand slapped. :)<br /> <br /> I repurposed me an old Dell R610 and am running the latest FreeNAS (installed this week). It has 49113MB of RAM and 6x1TB HD's join a RaidZ1.</div>

 

[Robert Trevellyan]

<div class="bbWrapper"><blockquote data-attributes="member: 47987" data-quote="Jared Smith" data-source="post: 192617" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=192617" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-192617">Jared Smith said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> I guess I better describe my system so I don't get my hand slapped. :)<br /> <br /> I repurposed me an old Dell R610 and am running the latest FreeNAS (installed this week). It has 49113MB of RAM and 6x1TB HD's join a RaidZ1. </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>Is your goal to find out how well your data de-duplicates on a test system, or how de-duplication affects real-world performance on a system you plan to deploy? If the former, you might sneak through without anyone slapping you. If the latter, someone will definitely slap you for having less than the minimum recommended RAM, while trying to use a feature that requires masses of RAM.<br /> <br /> And sorry, I don't have the answer to your question about zdb.</div>

 

[HoneyBadger]

<div class="bbWrapper"><blockquote data-attributes="member: 40195" data-quote="Robert Trevellyan" data-source="post: 192641" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=192641" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-192641">Robert Trevellyan said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> If the latter, someone will definitely slap you for having less than the minimum recommended RAM, while trying to use a feature that requires masses of RAM. </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote><br /> He's got 48GB to support 5TB. I think he's going to be just fine. If he's going to get his hand slapped for anything it'll be for using RAIDZ1 instead of RAIDZ2 or mirrors.<br /> <br /> As far as your ZDB question, zdb -D poolname works for me. Not sure what's going on there.<br /> <br /> Do <b>zpool status -D storage</b> and you should get some useful bits at least.</div>

 

[Bidule0hm]

<div class="bbWrapper">Naming the pool &quot;storage&quot; is maybe the source of this problem.</div>

 

[Robert Trevellyan]

<div class="bbWrapper"><blockquote data-attributes="member: 36971" data-quote="HoneyBadger" data-source="post: 192645" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=192645" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-192645">HoneyBadger said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> He's got 48GB to support 5TB. I think he's going to be just fine. </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>I'll get my coat...<br /> <img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite10" alt=":oops:" title="Oops! :oops:" loading="lazy" data-shortname=":oops:" /></div>

 

[avalon60]

<div class="bbWrapper">I get the same error message when I run:<br /> zpool status -D storage<br /> cannot open 'storage': no such pool<br /> <br /> I know why now! I should have entered the pool <b>name</b>. Doh!</div>

 

[Jared Smith]

<div class="bbWrapper">Thanks to everyone that has responded.<br /> <br /> <a href="https://www.truenas.com/community/members/36971/" class="username" data-xf-init="member-tooltip" data-user-id="36971" data-username="@HoneyBadger">@HoneyBadger</a> - Yes that command worked for me but I was hoping to get the information zdb offers as well. <br /> <br /> <a href="https://www.truenas.com/community/members/31801/" class="username" data-xf-init="member-tooltip" data-user-id="31801" data-username="@Bidule0hm">@Bidule0hm</a> - I don't think the issue is name being &quot;storage&quot; since the person that submitted <a href="https://bugs.freenas.org/issues/7877" target="_blank" class="link link--external" rel="nofollow ugc noopener">https://bugs.freenas.org/issues/7877</a> had the same issue without having the name storage for his pool.<br /> <br /> Any other thoughts. Could it really be a bug? Possibly me setting something up incorrectly? Any thoughts would be welcome.</div>

 

[cyberjock]

<div class="bbWrapper">That's a terrible bug to quote. They guy put the FreeNAS boot device on a damn hardware RAID! Then, he did dedup! The person that wrote that should be committed. :P</div>

 

[stilgars]

<div class="bbWrapper"><blockquote data-attributes="member: 22572" data-quote="cyberjock" data-source="post: 194545" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=194545" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-194545">cyberjock said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> That's a terrible bug to quote. They guy put the FreeNAS boot device on a damn hardware RAID! Then, he did dedup! The person that wrote that should be committed. :p </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote><br /> Hello,<br /> <br /> I know it is a terrible bug to quote, but I am hitting the same issue, no dedup nor hardware RAID however cyberjock :D<br /> <br /> Except the standard freenas-boot one, zdb doesn't seem to find my two pools. I did not use the GUI to create them but the command line (I know my SLOG is not mirrored, this is temporary).<br /> <br /> I updated the bug request with my details and a screenshot.<br /> <br /> <a href="https://bugs.freenas.org/issues/7877" target="_blank" class="link link--external" rel="nofollow ugc noopener">https://bugs.freenas.org/issues/7877</a></div>

 

[stilgars]

<div class="bbWrapper">Copy pasting the problem below (3 active pools, only one showing up with zdb):<br /> <br /> [root@freenas] ~# zpool list<br /> NAME SIZE ALLOC FREE EXPANDSZ FRAG CAP DEDUP HEALTH ALTROOT<br /> freenas-boot 7.56G 1.30G 6.27G - - 17% 1.00x ONLINE -<br /> system 1.73T 5.05G 1.73T - 0% 0% 1.00x ONLINE /mnt<br /> tank 60T 26.9T 33.1T - 27% 44% 1.00x ONLINE /mnt<br /> <br /> [root@freenas] ~# zdb tank<br /> zdb: can't open 'tank': No such file or directory<br /> <br /> [root@freenas] ~# zdb system<br /> zdb: can't open 'system': No such file or directory<br /> <br /> [root@freenas] ~# zdb<br /> freenas-boot:<br /> version: 28<br /> name: 'freenas-boot'<br /> state: 0<br /> txg: <a href="https://forums.freenas.org/tel:7038453" target="_blank" class="link link--external" rel="nofollow ugc noopener">7038453</a><br /> pool_guid: 9897884101609409482<br /> hostname: ''<br /> vdev_children: 1<br /> vdev_tree:<br /> type: 'root'<br /> id: 0<br /> guid: 9897884101609409482<br /> create_txg: 4<br /> children[0]:<br /> type: 'disk'<br /> id: 0<br /> guid: 155458400138977638<br /> path: '/dev/gptid/70576b63-8e11-11e4-8071-002590db17e9'<br /> whole_disk: 1<br /> metaslab_array: 30<br /> metaslab_shift: 26<br /> ashift: 9<br /> asize: <a href="https://forums.freenas.org/tel:8181776384" target="_blank" class="link link--external" rel="nofollow ugc noopener">8181776384</a><br /> is_log: 0<br /> DTL: 92<br /> create_txg: 4<br /> features_for_read:</div>

 

[stilgars]

<div class="bbWrapper">No idea why zdb can't find my pools, except the boot one?</div>

 

[Mirfster]

<div class="bbWrapper"><blockquote data-attributes="member: 38791" data-quote="stilgars" data-source="post: 271667" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=271667" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-271667">stilgars said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> No idea why zdb can't find my pools, except the boot one? </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>Umm, maybe because if this?:<br /> <blockquote data-attributes="member: 38791" data-quote="stilgars" data-source="post: 268554" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=268554" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-268554">stilgars said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> I did not use the GUI to create them but the command line </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote></div>

 

[stilgars]

<div class="bbWrapper"><blockquote data-attributes="member: 53160" data-quote="Mirfster" data-source="post: 271672" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=271672" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-271672">Mirfster said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> Umm, maybe because if this?: </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote><br /> Well, zdb is not a freeNAS/GUI functionality, so I fail to see why creating a pool using the command line will make it not to appear under zdb which is a standard diagnostic tool from zfs, and secondly, I exported/reimported the pool under the GUI anyway to get rid of the missing gptid labels (with no luck). Still no visibility under zdb.</div>

 

[Mirfster]

<div class="bbWrapper">Make another pool, this time via the GUI and see if you still have the issue...</div>

 

[stilgars]

<div class="bbWrapper">I understand your suggestion and it sounds practical, thank you for it - but specifically, this pool now contains 25 TB of data and re-transferring the whole thing could take days.<br /> In addition, using the command line is not a hack or an exceptional zfs usercase. I don't think the destroy-and-recreate-everything is a good approach in general when no particular mistake was made.</div>

 

[Robert Trevellyan]

<div class="bbWrapper">Have you tried renaming the pool(s)? Maybe &quot;system&quot; is a bad name for a pool.</div>

 

[Mirfster]

<div class="bbWrapper">Interestingly enough, I was just testing some stuff out and saw similar behavior...<br /> <br /> Here is what I did:<br /> <ol> <li data-xf-list-type="ol">Created Pool called &quot;TestPool&quot;<ul> <li data-xf-list-type="ul">Was on a instance of FreeNas runing &quot;Nightlies&quot;<br /> </li> <li data-xf-list-type="ul">Using a 6 disk RaidZ2 vDev (different sized drives; was testing something else)</li> </ul></li> <li data-xf-list-type="ol">Shutdown and then installed FreeNas Stable on a new SSD</li> <li data-xf-list-type="ol">Updated Stable with the latest version</li> <li data-xf-list-type="ol">Then I SSH'd and ran command: <b>zpool import -f TestPool</b><ul> <li data-xf-list-type="ul">GUI &quot;Volumes&quot; did NOT show pool<br /> </li> <li data-xf-list-type="ul"><b>zdb</b> showed pool correctly</li> <li data-xf-list-type="ul"><b>zpool status</b> showed pool correctly</li> </ul></li> <li data-xf-list-type="ol">Rebooted (just to be safe) and tried again with the same results<br /> </li> <li data-xf-list-type="ol">Back in SSH; I then ran command: <b>zpool export -f TestPool</b></li> <li data-xf-list-type="ol">In the GUI; I imported the pool using the &quot;<b>Import Volume</b>&quot; button<ul> <li data-xf-list-type="ul">GUI &quot;Volumes&quot; showed &quot;TestPool&quot;</li> <li data-xf-list-type="ul"><b>zpool status</b> showed pool correctly<br /> </li> <li data-xf-list-type="ul"><b>zdb</b> did not??</li> </ul></li> <li data-xf-list-type="ol">Closed SSH Session and tried again... Same results...<br /> </li> <li data-xf-list-type="ol">I then rebooted the Server; tried again and got same results...<ul> <li data-xf-list-type="ul">GUI &quot;Volumes&quot; showed &quot;TestPool&quot;</li> <li data-xf-list-type="ul"><b>zpool status</b> showed pool correctly</li> <li data-xf-list-type="ul"><b>zdb</b> did not?</li> </ul></li> </ol>Since this is a &quot;dev&quot; machine; I can test it out again in case I did anything blatantly incorrect... Anyone have some stuff you want me to try? <br /> There is not any data on this test machine and I am will to run whatever...</div>

 

[stilgars]

<div class="bbWrapper"><blockquote data-attributes="member: 53160" data-quote="Mirfster" data-source="post: 271728" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=271728" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-271728">Mirfster said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> Interestingly enough, I was just testing some stuff out and saw similar behavior...<br /> <br /> Here is what I did:<br /> <ol> <li data-xf-list-type="ol">Created Pool called &quot;TestPool&quot;<ul> <li data-xf-list-type="ul">Was on a instance of FreeNas runing &quot;Nightlies&quot;<br /> </li> <li data-xf-list-type="ul">Using a 6 disk RaidZ2 vDev (different sized drives; was testing something else)</li> </ul></li> <li data-xf-list-type="ol">Shutdown and then installed FreeNas Stable on a new SSD</li> <li data-xf-list-type="ol">Updated Stable with the latest version</li> <li data-xf-list-type="ol">Then I SSH'd and ran command: <b>zpool import -f TestPool</b><ul> <li data-xf-list-type="ul">GUI &quot;Volumes&quot; did NOT show pool<br /> </li> <li data-xf-list-type="ul"><b>zdb</b> showed pool correctly</li> <li data-xf-list-type="ul"><b>zpool status</b> showed pool correctly</li> </ul></li> <li data-xf-list-type="ol">Rebooted (just to be safe) and tried again with the same results<br /> </li> <li data-xf-list-type="ol">Back in SSH; I then ran command: <b>zpool export -f TestPool</b></li> <li data-xf-list-type="ol">In the GUI; I imported the pool using the &quot;<b>Import Volume</b>&quot; button<ul> <li data-xf-list-type="ul">GUI &quot;Volumes&quot; showed &quot;TestPool&quot;</li> <li data-xf-list-type="ul"><b>zpool status</b> showed pool correctly<br /> </li> <li data-xf-list-type="ul"><b>zdb</b> did not??</li> </ul></li> <li data-xf-list-type="ol">Closed SSH Session and tried again... Same results...<br /> </li> <li data-xf-list-type="ol">I then rebooted the Server; tried again and got same results...<ul> <li data-xf-list-type="ul">GUI &quot;Volumes&quot; showed &quot;TestPool&quot;</li> <li data-xf-list-type="ul"><b>zpool status</b> showed pool correctly</li> <li data-xf-list-type="ul"><b>zdb</b> did not?</li> </ul></li> </ol>Since this is a &quot;dev&quot; machine; I can test it out again in case I did anything blatantly incorrect... Anyone have some stuff you want me to try? <br /> There is not any data on this test machine and I am will to run whatever... </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote><br /> Thank you, interesting - as I have noticed, export/import does not solve the problem. I do not really have any particular idea for testing and remediation at this stage, I think there is a bug lurking here however.</div>

 

[Mirfster]

<div class="bbWrapper"><blockquote data-attributes="member: 38791" data-quote="stilgars" data-source="post: 271863" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=271863" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-271863">stilgars said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> Thank you, interesting - as I have noticed, export/import does not solve the problem. I do not really have any particular idea for testing and remediation at this stage, I think there is a bug lurking here however. </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>I am tending to agree. Have some other things to work on today; but if I get a chance I will run a few more tests. If results show similar behavior; I will file a bug and post back.</div>