Recommended HDD chassi for adding more disks to a TrueNAS Core server

[Forza]

I want to expand my TrueNAS Core installation with more disks, but I don't have space. What should I look for in order to add more disks externally - preferably SATA 3.5 disks. Most stuff I find is expensive NAS servers or USB/eSATA stuff for 1-4 drives.

 

[HoneyBadger]

Most stuff I find is expensive NAS servers or USB/eSATA stuff for 1-4 drives.

Unfortunately you'll have to lean towards the former - although "expensive" is of course relative. External USB/eSATA often use some manner of port consolidation or port multiplication, neither of which are particularly well-supported under TrueNAS.

Silverstone used to make a couple of external SFF SAS JBODs, the TS431S and RS831S (4 and 8-drive 3.5" chassis) although they're likely more expensive to find now instead of something like a Supermicro 825 or 826 chassis. You can also look for repurposed SAN units like the Lenovo SA120, or HP/Dell units - however, you might be in for a fair amount of noise by using one of those.

How many disks do you have in your pool now, and would purchasing a system that has more bays (eg: a Dell or Supermicro unit with 12/16 bays) be an option?

 

[Forza]

Only 4 hot swap bays plus one internal 3.5 and nvme.

I think I might go with building a supermicro server with their chassis made for disk storage. Ultimately not much more expensive and I get a proper setup!

Thanks for the suggestions.

 

[SweetAndLow]

Only 4 hot swap bays plus one internal 3.5 and nvme.

I think I might go with building a supermicro server with their chassis made for disk storage. Ultimately not much more expensive and I get a proper setup!

Thanks for the suggestions.

Yeah building a single system with more drives is probably a better solution. Adding more jbods will just create more complexity. Eventually it happens though.

 

[Constantin]

Cost doesn't have to be super high. Used SuperMicro chassis are purpose-built, overengineered, and get the job done for less than $300 delivered on ebay. That's 12 bays, two 720W power supplies, and all the fans you'll ever need.

Just make sure the backplane is compatible with your needs, such as having the same SATA/SAS connectors as your motherboard or HBA. True, adapter cables exist but with so many servers being thrown out on a daily basis, why settle? See here for a SAS/SATA Cable Guide.

 

[Forza]

Thanks! I'm looking at our local dealer and they have a few SuperMicro mainboards and chassis, but I'm sure they could bring in more from their huge range if asked.

Building a storage only server what kind of CPU is needed? I rather spend money on disks, ram and network cards etc and not on a hugely expensive CPU. I imagine various storage usage as VM storage, archive and general office NAS type. Nothing that is high IOPS.

What seems ok is:
Super Micro X11SCM-F
Xeon E3-1275V6 / 3.8 GHz
64GB ECC (8x8)
Super Micro Chassis: SC825 TQC-R740LPB - 740W dual PSU with 8 3.5" hot-swap bays.

 

[HoneyBadger]

Super Micro X11SCM-F
Xeon E3-1275V6 / 3.8 GHz

Unless I'm missing something, the X11SCM-F only lists the E-2100 and E-2200 series Xeons as supported - that's a Coffee Lake board and won't support the E3 v6 Xeons. Supermicro split their X11 series into different sub-versions, so review the compatibility lists carefully.

So, you’ve decided to buy a Supermicro X11 Xeon E3 v5/6 board...

In case someone still doesn't get the reference, click here. Now that Xeon E3 v5 is here, motherboard manufacturers have finally released their server lineups. Much like the Supermicro X10 guide, the purpose of this guide is to clarify the...

www.truenas.com

CPU wise the E3 itself is a fine choice, you're not likely to be leaning on it too hard. However if you do go with a newer E-2100/E-2200 series and supporting 8-DIMM board, I'd suggest not filling all the DIMM slots completely - eg, go with 4x16GB instead of 8x8GB. ZFS derives a lot of (read) performance from RAM capacity.

For your VM storage writes, to increase performance you may also need to invest in an Optane device for an SLOG. Based on your other thread you're using NFS to export them and that does do "sync by default" in a manner of speaking, so if you're seeing slow write speeds this could be the root cause. Moving to a pair of SSDs in a mirror will help that too (versus HDD's) but if those SSDs don't quickly respond to sync write then you may still need an SLOG device. Most Supermicro boards take M.2 2280 or 22110 devices, so both the cheap M10 (16/32GB) as well as the newer DC P1600X and P4800X devices will be viable options there.

 

[Constantin]

Agree re reviewing RAM compatibility lists VERY carefully. Got bit by RAM incompatibility on my newest board because the die revision of the RAM modules on it was off by one revision.

Also agree that using fewer larger modules is a better choice than more smaller ones. Cost is about equal but leaves room for expansion.

 

[Forza]

Unless I'm missing something, the X11SCM-F only lists the E-2100 and E-2200 series Xeons as supported - that's a Coffee Lake board and won't support the E3 v6 Xeons. Supermicro split their X11 series into different sub-versions, so review the compatibility lists carefully.

So, you’ve decided to buy a Supermicro X11 Xeon E3 v5/6 board...

In case someone still doesn't get the reference, click here. Now that Xeon E3 v5 is here, motherboard manufacturers have finally released their server lineups. Much like the Supermicro X10 guide, the purpose of this guide is to clarify the...

www.truenas.com

Good catch! Also valuable suggesting regarding the ssd/nvme. I have not yet thought for exactly how I want to set things up, but I want to be flexible and have room to change things without being too constrained in the case. Maybe 2-4 ssds, 4-6hdds,boot disk, plus spares. Not to mention the m.2. Adds up quickly.

Ohh but I would love a full nvme storage rack!

 

[Stux]

For SMB, last I checked, Samba was predominately single threaded per client, which makes it beneficial to have high clock speed CPUs.

If you are interested in a new motherboard you may want to consider a Supermicro board with a built-in LSI HBA. And likewise, its beneficial to have a chassis with a SAS expander backplane. Just makes everything so much simpler.

The other option worth considering is 10gbe as well.

 

[Forza]

The Supermicro cases for 10+ disks are very expensive. For about half the price I get an Inter-Tech 24 bay 4U case.

Anyone have experience with them?

4U 4424 - Inter-Tech GmbH

Inter-Tech Elektronik Handels GmbH - Gehäuse, Netzteile und vieles mehr aus der Hardwarewelt

www.inter-tech.de

4U 4416 - Inter-Tech GmbH

Inter-Tech Elektronik Handels GmbH - Gehäuse, Netzteile und vieles mehr aus der Hardwarewelt

www.inter-tech.de

The 4u-4416 is interesting as I can add 2 5.25"->4x 2.5" cases as well - giving me 16 3.5" and 8 2.5" slots.

Would SuperMicro server boards fit in there? What about CPU coolers. :)

 

[Stux]

You may want to take a look at this thread: Norco RPC-4224 Build Report

 

[Forza]

Hi again! So I have been looking and looking ;D The Xeon and SuperMicro naming schemes leaves lots to wish for... :)

I _think_ this would be a compatible option.

https://ark.intel.com/content/www/us/en/ark/products/147324/intel-c242-chipset.html lists the E-2126G as compatible.

I also need to find a good SAS controller/s than can feed the 24 port backplane. (though the MB has six SATA ports itself).