<div class="bbWrapper"><blockquote data-attributes="member: 105603" data-quote="John45622" data-source="post: 786176"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=786176"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-786176">John45622 said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
I have a similar problem where SMB volumes just hard dismount from OSX when running Backup apps like carbon copy cloner or Chronoync on large folders (10k+ items). I noticed my ARC request metadata stats jump to 60m when this happens. Can someone explain to me what kind of unit 60m is? Bits? Bytes? or does it mean "million" as in 60M? I assume "m" would mean "milli" hence my confusion. Thanks! Not sure why scanning a folder with 10k items creates an ARC hit of "60m" (whatever unit that is). (the other thread with screen shot <a href="https://www.truenas.com/community/threads/large-folders-via-smb-just-hard-dismount-under-osx-ventura.113610/#post-786158" class="link link--internal">https://www.truenas.com/community/t...ismount-under-osx-ventura.113610/#post-786158</a><br />
<br />
Sometimes just opening such a folder on OSX dismounts the volume after a few seconds.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>It's definitely a bug in trueNAS, not macOS, but you can work around it with CCC if you set CCC to use the legacy file copier under advanced / file copier concurrency.</div>
<div class="bbWrapper"><blockquote data-attributes="member: 132751" data-quote="mickeytankbank" data-source="post: 815587"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=815587"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-815587">mickeytankbank said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
It's definitely a bug in trueNAS, not macOS, but you can work around it with CCC if you set CCC to use the legacy file copier under advanced / file copier concurrency.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>What does that do or what does it do differently? Couldn't find any info in the CCC docs.</div>
<div class="bbWrapper"><blockquote data-attributes="member: 105603" data-quote="John45622" data-source="post: 815987"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=815987"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-815987">John45622 said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
What does that do or what does it do differently? Couldn't find any info in the CCC docs.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>They never really say exactly, just that they completely rebuilt the file copier for <a href="https://bombich.scdn1.secure.raxcdn.com/sites/default/files/bulk_pdf/ccc6-documentation-en.pdf" target="_blank" class="link link--external" rel="nofollow ugc noopener">version 6</a>, and that it's now multithreaded. I think maybe it's the multithreaded part thats overloading TrueNAS.</div>
<div class="bbWrapper">You might want to send that message to AVID and other professional media software makers and explain to them that having 10k files in a folder is OK on MacOS but for TrueNAS they should change their programs so that only 1000 files ever exist in a ProTools project (which dopesn't even cover the files of your last short film shoot) if you want to share them over TrueNAS. ;-)<br />
The last blog post for Dragonfish boasts the handling of "billions of files" on TrueNAS.</div>
<div class="bbWrapper">I wouldn't be so sure in identifying TN (which version?) as the culprit.<br />
SMB is no work of art, and Apple is no Holy Grail.<br />
If you believe to be a TN bug, please file a Bug Report. Opening your own thread might help as well... besides, the blog post of Dragonfish refers to the last version of SCALE, this thread is in the CORE section: the two products are substantially different.</div>
<div class="bbWrapper"><blockquote data-attributes="member: 117605" data-quote="Davvo" data-source="post: 816020"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=816020"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-816020">Davvo said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
I wouldn't be so sure in identifying TN (which version?) as the culprit.<br />
SMB is no work of art, and Apple is no Holy Grail.<br />
If you believe to be a TN bug, please file a Bug Report. Opening your own thread might help as well... besides, the blog post of Dragonfish refers to the last version of SCALE, this thread is in the CORE section: the two products are substantially different.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>Not entirely sure who you're referring to when you say "you" but the dismounts with excessive metadata request I mentioned totally referred to Core. It was quite on topic. Then someone said it's not a bug just wrong usage ("don't put 10k files into one folder").<br />
But for what it's worth: Since I've posted I have since moved to Scale and the dismounts went away. My mac hasn't changed and the OS is still also the same (Ventura) and yet no more dismounts. The only thing hat changed is TN. I was just curious how the person who said that you can work around the issue is doing it. And also:TN for years was saying they have countless installation in media houses. No one would be using TN in these places if having 10k files in a folder is a user error in principle.<br />
But for me personally, the case is closed anyway. Bye for now....</div>
<div class="bbWrapper"><blockquote data-attributes="member: 104866" data-quote="ChrisRJ" data-source="post: 815995"
class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch">
<div class="bbCodeBlock-title">
<a href="/community/goto/post?id=815995"
class="bbCodeBlock-sourceJump"
rel="nofollow"
data-xf-click="attribution"
data-content-selector="#post-815995">ChrisRJ said:</a>
</div>
<div class="bbCodeBlock-content">
<div class="bbCodeBlock-expandContent js-expandContent ">
Irrespective of other aspects it is hardly ever a good idea to have 10k+ files in a single folder.
</div>
<div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div>
</div>
</blockquote>This official TN doc says that<br />
<br />
<i>"Starting in Dragonfish 24.04 and later, the meta-data performance of directory listings over SMB is greatly improved. Depending on your SMB client, it is possible to support a single directory with anywhere from 100,000 to 1,000,000 files on flash systems with decent load times."</i><br />
<br />
So I guess even 10k files is exponentially under what's possible. (on Scale that is and if you can live with the load times, but in principle 10k+ files in folders are no problem at all)<br />
<br />
But now that Core is going away it's probably not worth investigating into it any longer.<br />
<br />
<div class="bbCodeBlock bbCodeBlock--unfurl js-unfurl fauxBlockLink"
data-unfurl="true" data-result-id="53441" data-url="https://www.truenas.com/docs/references/performance/smbfiletimes/" data-host="www.truenas.com" data-pending="false">
<div class="contentRow">
<div class="contentRow-figure contentRow-figure--fixedSmall js-unfurl-figure">
<img src="https://www.truenas.com/docs/images/open-enterprise-storage--logo-full-color-rgb-large.png" alt="www.truenas.com" data-onerror="hide-parent"/>
</div>
<div class="contentRow-main">
<h3 class="contentRow-header js-unfurl-title">
<a href="https://www.truenas.com/docs/references/performance/smbfiletimes/"
class="link link--internal fauxBlockLink-blockLink"
target=""
rel=""
data-proxy-href="">
SMB Directory List Times
</a>
</h3>
<div class="contentRow-snippet js-unfurl-desc">Performance data tables when listing large files counts over SMB.</div>
<div class="contentRow-minor contentRow-minor--hideLinks">
<span class="js-unfurl-favicon">
<img src="https://www.truenas.com/docs/references/performance/smbfiletimes/" alt="www.truenas.com" class="bbCodeBlockUnfurl-icon"
data-onerror="hide-parent"/>
</span>
www.truenas.com
</div>
</div>
</div>
</div></div>
