Another Guy
Cadet
- Joined
- Jan 10, 2023
- Messages
- 4
Hey guys,
We are currently looking at replacing two of our current storage setups with TrueNAS core deployments running on Supermicro servers and I've ended up with the following config. If anyone here can spot any problems in this setup it would be awesome. (I will compensate with a few drinks if we ever meet in real life).
For some background, we had a look at many MANY other options including Lenovo, Dell, Promise, VSAN and TrueNAS enterprise solutions, but we are in a situation where our storage requirements is beyond our budget even with the amazing prices the TrueNAS team have presented us. I know a lot of you guys will point back at those options, but with
main storage:
Since its a pure NVME storage server we are not sure if dedicated caching drives hold much value?
We also need to replace our current NAS, which is primarily used as a backup target and for cold storage.
NAS:
The idea is to make the two system provide some redundancy to the other.
If the "NAS/JBOD" unit's server fails - we can migrate all the drives by moving the JBOD to the "main" unit and importing the disks.
The other way around (if the "main" storage fails) is a lot more risky since it involves moving the 10 NVME drives into the "NAS" server and importing the volumes. We plan to do some testing with this before we move to production. we've written these risks in big red bold letters to business.
I'm happy to go into more details if anyone wants, but felt this was probably a big enough favour to ask from a community I haven't actively contributed to yet. (we do plan to give feedback if anyone is interested)
We are currently looking at replacing two of our current storage setups with TrueNAS core deployments running on Supermicro servers and I've ended up with the following config. If anyone here can spot any problems in this setup it would be awesome. (I will compensate with a few drinks if we ever meet in real life).
For some background, we had a look at many MANY other options including Lenovo, Dell, Promise, VSAN and TrueNAS enterprise solutions, but we are in a situation where our storage requirements is beyond our budget even with the amazing prices the TrueNAS team have presented us. I know a lot of you guys will point back at those options, but with
main storage:
- Supermicro 2114S-WN24RT running AMD EPYC 7313P (16 core, 3GHz) with 256GB RAM
- Networking: Intel XL710-QDA 10/40GbE - 2 x QSFP+ and 2 x 10GbE on-board
- OS Volume: 2x800GB Micron MAX 7450 M.2 NVME
- Storage Volume: 10 x 6.4TB Micron MAX 7450 NVME drives.
- Extra Bits: Broadcom HBA 9500-8e (this is purely for redundancy - see second unit below for detail)
Since its a pure NVME storage server we are not sure if dedicated caching drives hold much value?
We also need to replace our current NAS, which is primarily used as a backup target and for cold storage.
NAS:
- Supermicro 2114S-WN24RT running AMD EPYC 7313P (16 core, 3GHz) with 256GB RAM
- Networking: Intel XL710-QDA 10/40GbE - 2 x QSFP+ and 2 x 10GbE on-board
- OS Volume: 2x800GB Micron Max 7450 M.2 NVME
- Extra Bits: Broadcom HBA 9500-8e (will handle JBOD)
- Supermicro SuperChassis 847E1C-R1K23JBOD (44 x 3.5" SAS bays)
- Storage Volume: 18 x 14TB UltraStar DC HC530 SAS drives
- SLOG/ZIL: 2 x 3.8TB Micron 5400 MAX SATA
- Read Cache: 2 x 7.68TB Micron 5400 PRO SATA
The idea is to make the two system provide some redundancy to the other.
If the "NAS/JBOD" unit's server fails - we can migrate all the drives by moving the JBOD to the "main" unit and importing the disks.
The other way around (if the "main" storage fails) is a lot more risky since it involves moving the 10 NVME drives into the "NAS" server and importing the volumes. We plan to do some testing with this before we move to production. we've written these risks in big red bold letters to business.
I'm happy to go into more details if anyone wants, but felt this was probably a big enough favour to ask from a community I haven't actively contributed to yet. (we do plan to give feedback if anyone is interested)