<div class="bbWrapper">I'm looking into building a <a href="https://www.reddit.com/r/zfs/comments/l1a2p8/hyperconverged_allinone_homeserver_with_zfs/" target="_blank" class="link link--external" rel="nofollow ugc noopener">hyperconverged homelab</a> like I mention in the original thread. The context is, that I've got 10Gb symmetric internet and I need a NAS / Hypervisor combo.<br />
<br />
For the NAS the workload would be fairly small, albeit 10Gb internet is definitely a lot more parallel downloads than just 1Gb. <br />
<br />
On the other hand, for the hypervisor, I need raw power. That's why I'm getting 2x2TB Samsung PM9A1, 256GB ECC RAM, and a 3960x or 3970x Threadripper.<br />
<br />
If I split the boxes, I'd need to connect them with a 100Gbe interconnect to get anywhere near the performance, that's why I was hoping to make them into one hyperconverged server.<br />
<br />
From what I gather TrueNAS SCALE may very well be what I'm looking for. TrueNAS can take care of storage and the light workloads like background downloading, backup, etc. And then I can either create a container or a KVM vm and pass-through 48 / 64 threads and, say, 128GB RAM to the high-performance vm.<br />
<br />
Here are my storage considerations:<br />
<ul>
<li data-xf-list-type="ul">The motherboard has 8xSATA port and 3xM.2 ports</li>
<li data-xf-list-type="ul">Get 8x8TB WD Gold drives. They can do about 250MB sustained, so I need at least a 4x mirrors to saturate the 10Gb for downloads.</li>
<li data-xf-list-type="ul">I'd stick in 2x2TB PM9A1 in mirror.</li>
</ul><b>What would you suggest to do with the last M.2 slot?</b> I could stick in, say, a 500GB 980 Pro as L2ARC (probably not worth it with the amount of available RAM?), I could stick in a 59GB Optane 800p as (non-mirrored) SLOG? Or maybe stick in a 3rd 2TB PM9A1 and RAIDZ1 them together?<br />
<br />
Additionally, I'd like to use some of ZFS's flexibility with partitions:<br />
<ul>
<li data-xf-list-type="ul">shave off e.g. 20GB partitions for a mirrored boot pool (I could theoretically boot off a USB stick, but would prefer to use the NVMe drives)</li>
<li data-xf-list-type="ul">shave off e.g. 10-20GB for a SLOG for the spinning rust pool, can be mirrored if we already have 2 NVMe drives. Alternatively, I could use the 58GB Optane 800p, if we get it.</li>
<li data-xf-list-type="ul">shave off e.g. 20GB partitions for a mirrored metadata vdev for the spinning rust pool.</li>
<li data-xf-list-type="ul">Use rest of the NVMe drives for data for the high-performance VM / container.</li>
</ul>Given, I know ZFS lets you use partitions like that, because I did similar things when I was running on NixOS; <b>how do you use partitions in TrueNAS SCALE?</b><br />
<br />
It could also be, that my requirements are somehow completely at odds with TrueNAS SCALE... <b>What else should I use if TrueNAS SCALE is a poor choice?</b></div>
