Scale memory utilization

[jgreco]

<div class="bbWrapper"><blockquote data-attributes="member: 125687" data-quote="asap2go" data-source="post: 764294" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=764294" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-764294">asap2go said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> This also sounds Luke setting max ARC size manually is a bad idea because there might be some memory fragmentation(sounds serious?). </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote><br /> Pretty clear that 50% is just some relatively safe number someone pulled out of an orifice. I expect the problem is that on a small memory system, there's a lot more stress and also a lot of relatively foolish users who will try to squeeze the hell out of it. There shouldn't be a problem on a larger memory system.<br /> <br /> <blockquote data-attributes="member: 125687" data-quote="asap2go" data-source="post: 764298" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=764298" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-764298">asap2go said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> I would assume they intend ro fix memory allocation/fragmentation/reporting instead of just increasing max_arc. Because the latter of which may cause instability when unintentionally overcommiting memory. </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote><br /> That's going to be tricky without some cooperation from Linus. Most memory allocation is pretty complicated in modern systems, even Linux.</div>

 

[winnielinnie]

<div class="bbWrapper">If I didn't know any better, I'd have thought that <a href="https://www.truenas.com/community/members/115/" class="username" data-xf-init="member-tooltip" data-user-id="115" data-username="@jgreco">@jgreco</a> got bullied by a bunch of penguins during an escapade in Antarctica. Ever since that traumatic experience, he's had this seething hatred and vendetta against all things related to penguins.</div>

 

[NugentS]

<div class="bbWrapper"><blockquote data-attributes="member: 98387" data-quote="winnielinnie" data-source="post: 764301" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=764301" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-764301">winnielinnie said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> If I didn't know any better, I'd have thought that <a href="https://www.truenas.com/community/members/115/" class="username" data-xf-init="member-tooltip" data-user-id="115" data-username="@jgreco">@jgreco</a> got bullied by a bunch of penguins during an escapade in Antarctica. Ever since that traumatic experience, he's had this seething hatred and vendetta against all things related to penguins. </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>Or he was brought up in a school run by nuns with the same result</div>

 

[jgreco]

<div class="bbWrapper"><blockquote data-attributes="member: 98387" data-quote="winnielinnie" data-source="post: 764301" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=764301" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-764301">winnielinnie said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> I'd have thought that @jgreco got bullied by a bunch of penguins during an escapade in Antarctica. </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote><br /> I tried roast penguin last week and it gave me diarrhea and terrible flatulence. The skies turned orange and people said the air quality was toxic.</div>

 

[jgreco]

<div class="bbWrapper">I suppose that's going to age terribly so I should probably make a note that Canadian wildfires have left the US eastern coast in orange.<br /> <br /> <script class="js-extraPhrases" type="application/json"> { "lightbox_close": "Close", "lightbox_next": "Next", "lightbox_previous": "Previous", "lightbox_error": "The requested content cannot be loaded. Please try again later.", "lightbox_start_slideshow": "Start slideshow", "lightbox_stop_slideshow": "Stop slideshow", "lightbox_full_screen": "Full screen", "lightbox_thumbnails": "Thumbnails", "lightbox_download": "Download", "lightbox_share": "Share", "lightbox_zoom": "Zoom", "lightbox_new_window": "New window", "lightbox_toggle_sidebar": "Toggle sidebar" } </script> <div class="bbImageWrapper js-lbImage" title="images" data-src="https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSC4H9RNc6WTF9qMTkkqrTTFHHrjPSpTLrs7w&amp;usqp=CAU" data-lb-sidebar-href="" data-lb-caption-extra-html="" data-single-image="1"> <img src="https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSC4H9RNc6WTF9qMTkkqrTTFHHrjPSpTLrs7w&amp;usqp=CAU" data-url="https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSC4H9RNc6WTF9qMTkkqrTTFHHrjPSpTLrs7w&amp;usqp=CAU" class="bbImage" data-zoom-target="1" style="" alt="images" title="" width="" height="" loading="lazy" /> </div></div>

 

[asap2go]

<div class="bbWrapper"><blockquote data-attributes="member: 115" data-quote="jgreco" data-source="post: 764312" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=764312" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-764312">jgreco said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> I suppose that's going to age terribly so I should probably make a note that Canadian wildfires have left the US eastern coast in orange.<br /> <br /> <div class="bbImageWrapper js-lbImage" title="images" data-src="https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSC4H9RNc6WTF9qMTkkqrTTFHHrjPSpTLrs7w&amp;usqp=CAU" data-lb-sidebar-href="" data-lb-caption-extra-html="" data-single-image="1"> <img src="https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSC4H9RNc6WTF9qMTkkqrTTFHHrjPSpTLrs7w&amp;usqp=CAU" data-url="https://encrypted-tbn0.gstatic.com/images?q=tbn:ANd9GcSC4H9RNc6WTF9qMTkkqrTTFHHrjPSpTLrs7w&amp;usqp=CAU" class="bbImage" data-zoom-target="1" style="" alt="images" title="" width="" height="" loading="lazy" /> </div> </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>Looks like international Ubuntu day :)</div>

 

[jgreco]

<div class="bbWrapper">Touche'</div>

 

[Arwen]

<div class="bbWrapper">Gee, someone mentioned the B word, (BTRFS), and NOT that it was implemented first at Oracle;<br /> <a href="https://en.wikipedia.org/wiki/Btrfs#History" target="_blank" class="link link--external" rel="nofollow ugc noopener">Wikipedia - BTRFS - History</a><br /> <br /> So, does this mean BTRFS is also contaminated?<br /> Not according to Linux people!!!<br /> <br /> The big differences:<br /> <ol> <li data-xf-list-type="ol">GPL license compared to CDDL</li> <li data-xf-list-type="ol">Designed for Linux kernel only, (and kernel drivers are part of the Linux kernel source code)</li> </ol>Their are a few other OSes that have support for BTRFS, an open source version of the MS-Windows comes to mind, though I don't remember the details. But, for practical sake, BTRFS is a one OS file system. Unlike OpenZFS, which now exists on 6 OSes... I will leave it to the reader to get the list if desired.</div>

 

[Ericloewe]

<div class="bbWrapper">You know, I'd forgotten about that part. Funny how major patches from Oracle are okay when protected by their Cope License.<br /> <blockquote data-attributes="member: 106202" data-quote="Etorix" data-source="post: 764296" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=764296" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-764296">Etorix said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> Please spit your venom. Don't let it consume your from inside. <img src="data:image/gif;base64,R0lGODlhAQABAIAAAAAAAP///yH5BAEAAAAALAAAAAABAAEAAAIBRAA7" class="smilie smilie--sprite smilie--sprite2" alt=":wink:" title="Wink :wink:" loading="lazy" data-shortname=":wink:" /> </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>So as to not derail this, I'll just say: &quot;Compose File Specification&quot;, more properly described as &quot;Compose File Anarchy&quot;.</div>

 

[morganL]

<div class="bbWrapper"><blockquote data-attributes="member: 125687" data-quote="asap2go" data-source="post: 764294" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=764294" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-764294">asap2go said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> &quot;For Linux, its the safe margin for ARC due to fragmentation on SLUB allocator.<br /> We're treating it as a bug and plan to fix or mitigate it....<br /> Planning to fix in Cobia.&quot;<br /> <br /> This also sounds Luke setting max ARC size manually is a bad idea because there might be some memory fragmentation(sounds serious?). Thank you for the info!<br /> Hope Morgan can tell what Cobia means. </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>Its complex and still under investigation. We have assigned a guy with strong Linux skills to review.<br /> <br /> My current take is that users who make use of Apps and VMs are getting the benefits of their RAM. No major issues.<br /> Users with a primary storage-only workload need a better configuration option.. 75-80% would be a major improvement.<br /> We shouldn't let the desire to be perfect delay the need to be good.<br /> <br /> Does that align with the views here?</div>

 

[asap2go]

<div class="bbWrapper"><blockquote data-attributes="member: 84138" data-quote="morganL" data-source="post: 764323" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=764323" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-764323">morganL said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> Its complex and still under investigation. We have assigned a guy with strong Linux skills to review.<br /> <br /> My current take is that users who make use of Apps and VMs are getting the benefits of their RAM. No major issues.<br /> Users with a primary storage-only workload need a better configuration option.. 75-80% would be a major improvement.<br /> We shouldn't let the desire to be perfect delay the need to be good.<br /> <br /> Does that align with the views here? </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>For me personally that would be alright as it is the ratio I am going to split memory anyway.<br /> As long as its stable that'd be awesome.</div>

 

[danb35]

<div class="bbWrapper"><blockquote data-attributes="member: 84138" data-quote="morganL" data-source="post: 764323" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=764323" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-764323">morganL said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> My current take is that users who make use of Apps and VMs are getting the benefits of their RAM. </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote>I use (well, used, until they completely stopped working almost a week ago) lots of apps--over 20 of them--and my server was still sitting with over 40 GB of RAM free according to the TrueNAS dashboard. My ARC hit ratio was still well over 90%, so I guess it isn't that critical of a problem, but that's still about a third of my RAM being wasted.</div>

 

[Cytomax]

<div class="bbWrapper">Is there a bug for this problem that i can follow to see when it gets fixed?<br /> Is there a planned release date for Cobia?</div>

 

[morganL]

<div class="bbWrapper"><blockquote data-attributes="member: 54638" data-quote="Cytomax" data-source="post: 766147" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=766147" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-766147">Cytomax said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> Is there a bug for this problem that i can follow to see when it gets fixed?<br /> Is there a planned release date for Cobia? </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote><br /> There are a coupl of bug IDs.<br /> <div class="bbCodeBlock bbCodeBlock--unfurl js-unfurl fauxBlockLink" data-unfurl="true" data-result-id="39125" data-url="https://ixsystems.atlassian.net/browse/NAS-117879" data-host="ixsystems.atlassian.net" data-pending="false"> <div class="contentRow"> <div class="contentRow-main"> <h3 class="contentRow-header js-unfurl-title"> <a href="https://ixsystems.atlassian.net/browse/NAS-117879" class="link link--external fauxBlockLink-blockLink" target="_blank" rel="noopener" data-proxy-href=""> Jira </a> </h3> <div class="contentRow-snippet js-unfurl-desc"></div> <div class="contentRow-minor contentRow-minor--hideLinks"> <span class="js-unfurl-favicon"> <img src="https://ixsystems.atlassian.net/browse/NAS-117879/" alt="ixsystems.atlassian.net" class="bbCodeBlockUnfurl-icon" data-onerror="hide-parent"/> </span> ixsystems.atlassian.net </div> </div> </div> </div> <br /> Cobia is planned for Q4.</div>

 

[Cytomax]

<div class="bbWrapper">ty for the reply when i click on your link this is where it takes me<br /> and when i search for NAS-117879<br /> it doesnt find anything<br /> <div class="bbImageWrapper js-lbImage" title="2023-06-23_12-17.png" data-src="https://www.truenas.com/community/attachments/2023-06-23_12-17-png.67646/" data-lb-sidebar-href="" data-lb-caption-extra-html="" data-single-image="1"> <img src="https://www.truenas.com/community/attachments/2023-06-23_12-17-png.67646/" data-url="" class="bbImage" data-zoom-target="1" style="" alt="2023-06-23_12-17.png" title="2023-06-23_12-17.png" width="1764" height="926" loading="lazy" /> </div></div>

 

[morganL]

<div class="bbWrapper"><blockquote data-attributes="member: 54638" data-quote="Cytomax" data-source="post: 766187" class="bbCodeBlock bbCodeBlock--expandable bbCodeBlock--quote js-expandWatch"> <div class="bbCodeBlock-title"> <a href="/community/goto/post?id=766187" class="bbCodeBlock-sourceJump" rel="nofollow" data-xf-click="attribution" data-content-selector="#post-766187">Cytomax said:</a> </div> <div class="bbCodeBlock-content"> <div class="bbCodeBlock-expandContent js-expandContent "> ty for the reply when i click on your link this is where it takes me<br /> and when i search for NAS-117879<br /> it doesnt find anything </div> <div class="bbCodeBlock-expandLink js-expandLink"><a role="button" tabindex="0">Click to expand...</a></div> </div> </blockquote><br /> This one might be better:<br /> <br /> <div class="bbCodeBlock bbCodeBlock--unfurl js-unfurl fauxBlockLink" data-unfurl="true" data-result-id="23551" data-url="https://ixsystems.atlassian.net/browse/NAS-112185" data-host="ixsystems.atlassian.net" data-pending="false"> <div class="contentRow"> <div class="contentRow-main"> <h3 class="contentRow-header js-unfurl-title"> <a href="https://ixsystems.atlassian.net/browse/NAS-112185" class="link link--external fauxBlockLink-blockLink" target="_blank" rel="noopener" data-proxy-href=""> [NAS-112185] - iXsystems TrueNAS Jira </a> </h3> <div class="contentRow-snippet js-unfurl-desc"></div> <div class="contentRow-minor contentRow-minor--hideLinks"> <span class="js-unfurl-favicon"> <img src="https://ixsystems.atlassian.net/browse/NAS-112185/" alt="ixsystems.atlassian.net" class="bbCodeBlockUnfurl-icon" data-onerror="hide-parent"/> </span> ixsystems.atlassian.net </div> </div> </div> </div> <br /> There is no target date until we have identified a resolution. Its still being explored.</div>