PhiloEpisteme
Guru
- Joined
- Oct 18, 2018
- Messages
- 969
Hi folks,
I'm considering upgrade paths for my system.
At the time of writing my system specs are as follows:
Case: Fractal Design Define R6 (Build Report)
FreeNAS Release: FreeNAS-11.2-RELEASE-U2
Board: SuperMicro X11SSM-F
Processor: Intel Core i3-7100
Memory: 32 GB
HBA: LSI/Broadcom SAS9207-8i
NIC: Chelsio T520-CR
Storage Pool 1: 1x RAIDZ2 vdev @ 6x3TB disks
Storage Pool 2 (encrypted): 1x RAIDZ2 vdev @ 6x2TB disks
Boot pool: 1x mirrored vdev @ 2x 64GB SATA DOM
My current PCIe slot usage is as follows
x8: LSI 9207-8i HBA
x8: Chelsi T520-CR 10Gbps NIC
x4: empty
x4: empty
Longer-term, I'd like to add SLOG devices as well as grow my storage space. I figure in a year or two I'll be in a position to need to upgrade my storage capacity and because my case is out of drive bays I'll likely make use of an additional chassis or replace the one I have.
Option 1
Keep my current chassis, add the mirrored SLOG devices via a PCIe8x -> 2x PCIe4x M2 adapter, and use an additional JBOD chassis w/expanders for extra HDDs.
Proposed PCIe slot usage
x8: LSI 9207-8e HBA (or faster/larger if ever a need arrises)
x8: AOC-SLG3-2M2 with 2x 100GB Intel Optane DC P4801X SSDs
x4: LSI 9207-8i HBA (this is running max 8 HDDs. The 4x port should have plenty of bandwidth)
x4: Chelsi T520-CR 10Gbps NIC (per an email from Chelsio, this card should perform just fine an x4 PCIe 3.0 slot)
Note that the add on card is not listed as compatible with my board but an email from supermicro states that it does work
New Parts + Cost
AOC-SLG-2M2 - $40
2x 100GB DC P4801x - $590 ($290 each)
LSI-9207-8e - $60
Option 2
Keep my current chassis, add the mirrored SLOG devices via both x4 PCIe 3.0 slots, and use an additional JBOD chassis w/expanders for extra HDDs.
Proposed PCIe slot usage
x8: Broadcom/LSI 9400-8e8i Tri-Mode Storage Adapter
x4: Chelsi T520-CR 10Gbps NIC
x4: Intel Optane 900P SSD 280GB
x4: Intel Optane 900P SSD 280GB
New Parts + Cost
2x 280GB 900P - $510 ($255 each)
9400-8e8i - $550 I don't see a ton but those I do see are pricy
Option 3
Keep or replace my current chassis entirely, add the mirrored SLOG devices via both x4 PCIe3.0 slots, use the final 8x slot for a single HBA to run all of my drives.
Proposed PCIe slot usage
x8: LSI 9207-8e (or faster) and move all drives to an external case
x4: Chelsi T520-CR 10Gbps NIC
x4: Intel Optane 900P SSD 280GB
x4: Intel Optane 900P SSD 280GB
New Parts + Cost
2x 280GB 900P - $510 ($255 each)
LSI-9207-8e - $60
If the additional/replacement chassis is roughly equal across all three options it looks like the cheapest option would be option 3 but only barely. Option 1 seems the most flexible to me though. My current thinking is to pick up the AOC-SLG3-2M2 and test it out on two drives I have at home which don't have PLP to see if it works. If it does work just fine I think I like option 1 the best.
I'm curious what folks think of the above options and whether folks have any experience with that specific PCIe -> M2 adapter card or other similar cards made by other manufacturers.
I'm considering upgrade paths for my system.
At the time of writing my system specs are as follows:
Case: Fractal Design Define R6 (Build Report)
FreeNAS Release: FreeNAS-11.2-RELEASE-U2
Board: SuperMicro X11SSM-F
Processor: Intel Core i3-7100
Memory: 32 GB
HBA: LSI/Broadcom SAS9207-8i
NIC: Chelsio T520-CR
Storage Pool 1: 1x RAIDZ2 vdev @ 6x3TB disks
Storage Pool 2 (encrypted): 1x RAIDZ2 vdev @ 6x2TB disks
Boot pool: 1x mirrored vdev @ 2x 64GB SATA DOM
My current PCIe slot usage is as follows
x8: LSI 9207-8i HBA
x8: Chelsi T520-CR 10Gbps NIC
x4: empty
x4: empty
Longer-term, I'd like to add SLOG devices as well as grow my storage space. I figure in a year or two I'll be in a position to need to upgrade my storage capacity and because my case is out of drive bays I'll likely make use of an additional chassis or replace the one I have.
Option 1
Keep my current chassis, add the mirrored SLOG devices via a PCIe8x -> 2x PCIe4x M2 adapter, and use an additional JBOD chassis w/expanders for extra HDDs.
Proposed PCIe slot usage
x8: LSI 9207-8e HBA (or faster/larger if ever a need arrises)
x8: AOC-SLG3-2M2 with 2x 100GB Intel Optane DC P4801X SSDs
x4: LSI 9207-8i HBA (this is running max 8 HDDs. The 4x port should have plenty of bandwidth)
x4: Chelsi T520-CR 10Gbps NIC (per an email from Chelsio, this card should perform just fine an x4 PCIe 3.0 slot)
Note that the add on card is not listed as compatible with my board but an email from supermicro states that it does work
Yes, the AOC-SLG3-2M2 can support on X11SSM-F with:
1. Install it on PCIe-Slot 7 -> 2x M.2 SSDs.
2. Install it on other PCIe slots -> only 1x M.2 SSD.
New Parts + Cost
AOC-SLG-2M2 - $40
2x 100GB DC P4801x - $590 ($290 each)
LSI-9207-8e - $60
Option 2
Keep my current chassis, add the mirrored SLOG devices via both x4 PCIe 3.0 slots, and use an additional JBOD chassis w/expanders for extra HDDs.
Proposed PCIe slot usage
x8: Broadcom/LSI 9400-8e8i Tri-Mode Storage Adapter
x4: Chelsi T520-CR 10Gbps NIC
x4: Intel Optane 900P SSD 280GB
x4: Intel Optane 900P SSD 280GB
New Parts + Cost
2x 280GB 900P - $510 ($255 each)
9400-8e8i - $550 I don't see a ton but those I do see are pricy
Option 3
Keep or replace my current chassis entirely, add the mirrored SLOG devices via both x4 PCIe3.0 slots, use the final 8x slot for a single HBA to run all of my drives.
Proposed PCIe slot usage
x8: LSI 9207-8e (or faster) and move all drives to an external case
x4: Chelsi T520-CR 10Gbps NIC
x4: Intel Optane 900P SSD 280GB
x4: Intel Optane 900P SSD 280GB
New Parts + Cost
2x 280GB 900P - $510 ($255 each)
LSI-9207-8e - $60
If the additional/replacement chassis is roughly equal across all three options it looks like the cheapest option would be option 3 but only barely. Option 1 seems the most flexible to me though. My current thinking is to pick up the AOC-SLG3-2M2 and test it out on two drives I have at home which don't have PLP to see if it works. If it does work just fine I think I like option 1 the best.
I'm curious what folks think of the above options and whether folks have any experience with that specific PCIe -> M2 adapter card or other similar cards made by other manufacturers.