Btw a bit unrelated but do you think all nvme storage is a good idea for a 10Gbe capable LAN? Don't think a network upgrade is on the tables anytime soon so I'm thinking of maybe going down to SAS SSD instead.
I'm not familiar with the servers you mentioned above, at least not enough to have any commentary that I'd be comfortable making.
However, I am quite comfortable poking at this question. It comes down to this: if you have an array of 24 drives, how fast can that go?
For SATA HDD, if we were to consider a lower end IOPS of 50 IOPS doing 4KB each, times 24 drives, that is 4.800MBytes/sec or about 40Mbits/sec.
For consumer SATA SSD, let's pretend that the numbers normally presented (100k IOPS? really?) are bull. I can definitely see these sustaining 5000 IOPS, again doing 4KB each, and 24 drives winds you up at 4000Mbits/sec.
So first let's acknowledge that these ought to be pessimistic numbers. Highly pessimistic numbers. It should almost always go faster. Often MUCH faster. Especially if you had something slightly better than consumer SATA SSD. But pay attention to claimed and benchmarked numbers. If you were willing to fill an array with 24 modern consumer SATA SSD's, I have trouble seeing how you wouldn't be able to flatline the thing at 10Gbps in normal operations.
That's my perspective. Take it for what little it is worth.