firesyde424
Contributor
- Joined
- Mar 5, 2019
- Messages
- 155
I just received approval for what is likely to be a ridiculous project. The background is that a very large customer is paying us "stupid" money to quickly process and archive a 300TB+ proprietary database that requires a lot of processing and will require embedded images to be extracted and converted to a standard format. Given the size, estimated workload, and timeline, the only real option is NVME, never mind that NVME is at price parity with SAS. With that in mind, as I've sat down to engineer this, is occurs to me that I have no idea what kind of CPU power would be required to drive the storage of this project. I came up with the following:
As far as networking goes, the plan is to use either 200Gbe or 400Gbe network cards with the database and storage servers connected directly to each other. Since we're using AMD for this build, that effectively means TrueNAS Scale so networking support should be fairly good. We'll likely go with 200Gbe given that I don't know if the database server would be able to push more than that. The card we are looking at is the Nvidia ConnectX-7.
So, after that wall of text, two questions.
1: Are there any good sources out there for the kind of CPU I'd need to support these drives or does anyone have experience at this scale?
2: IXSystems does sell an NVME model of TrueNAS Scale with 100Gbe cards so I'm assuming I should be able to get 200Gbe working as well. Does anyone have good information on this?
- Dell PowerEdge R7525(Has to be 15th gen because, for whate
- 2 x AMD 7H12 CPUs, 128 cores\256 threads total @ 2.6Ghz
- 1024GB DDR4 Registered ECC RAM @ 3200MT/sec
- Configured at 16 x 64GB due to 8 channels of memory per CPU.
- 400\200Gbe networking
- See below
- 24 x 30.72TB Micron 9400 Pro Gen 4 NVME U.3 drives
As far as networking goes, the plan is to use either 200Gbe or 400Gbe network cards with the database and storage servers connected directly to each other. Since we're using AMD for this build, that effectively means TrueNAS Scale so networking support should be fairly good. We'll likely go with 200Gbe given that I don't know if the database server would be able to push more than that. The card we are looking at is the Nvidia ConnectX-7.
So, after that wall of text, two questions.
1: Are there any good sources out there for the kind of CPU I'd need to support these drives or does anyone have experience at this scale?
2: IXSystems does sell an NVME model of TrueNAS Scale with 100Gbe cards so I'm assuming I should be able to get 200Gbe working as well. Does anyone have good information on this?