- Joined
- Jul 3, 2015
- Messages
- 926
Hi Guys,
Im looking for a sounding board for trying to find the bottleneck on a new system so would appreciate your input.
The system is a 36 bay Supermicro SSG-5049P-E1CTR36L running 36 x Micron 5100 Pro 7.68TB SSD drives, SAS3 embedded Broadcom 3008 controller.
Initially I've ran @jgreco sonnet-array-test to give me some benchmarks (see attached) and it became immediately apparent that there were bottlenecks. Its worth mentioning that I actually purchased two of these systems but the backup is running standard 8TB SAS drives (which also bottlenecks).
I haven't actually checked how the controller is cabled inside yet (as the system is remote) but given the bottleneck my guess is that only one port of the controller is being used as it appears the limit is approx 6000MB/s.
So my question is do you agree with my initial findings and if so will I be able to easily re-cable the system to utilise both ports? Perhaps front 24 into one port and rear 12 into the other? Still not ideal but should be much better.
PCIe 3 = 8000MB/s
Controller = 6000MB/s per port x 2 = 12000MB/s
Theoretical Max of SSDs combined = 16668MB/s
Theoretical Max of HDDs combined = 7236MB/s
Many thanks in advanced.
Im looking for a sounding board for trying to find the bottleneck on a new system so would appreciate your input.
The system is a 36 bay Supermicro SSG-5049P-E1CTR36L running 36 x Micron 5100 Pro 7.68TB SSD drives, SAS3 embedded Broadcom 3008 controller.
Initially I've ran @jgreco sonnet-array-test to give me some benchmarks (see attached) and it became immediately apparent that there were bottlenecks. Its worth mentioning that I actually purchased two of these systems but the backup is running standard 8TB SAS drives (which also bottlenecks).
I haven't actually checked how the controller is cabled inside yet (as the system is remote) but given the bottleneck my guess is that only one port of the controller is being used as it appears the limit is approx 6000MB/s.
So my question is do you agree with my initial findings and if so will I be able to easily re-cable the system to utilise both ports? Perhaps front 24 into one port and rear 12 into the other? Still not ideal but should be much better.
PCIe 3 = 8000MB/s
Controller = 6000MB/s per port x 2 = 12000MB/s
Theoretical Max of SSDs combined = 16668MB/s
Theoretical Max of HDDs combined = 7236MB/s
Many thanks in advanced.
Attachments
Last edited:
