New build for the house. 4x3TB(raidZ2)/plex/bhyve/partying

[jaaassh]

Hi All,
Working on a new build today. I've read through the 2016 hardware guide and have generally been trying to follow that. My goal is to build a box that has a small form factor for home file storage and a Plex server. It'd be nice, if bhyve worked somewhat okay, as professionally I'm a software developer and spinning up free VMs would be nice. Strong performance in that area is *not* required.

Generally, I'm weighing this against simply buying the iXSystems FreeNAS mini. I've built many a computer in the past, so piecing things together isn't a concern. If I can save a couple hundred by doing it myself, that'd be the preferred route. That said, if there is value-added by iXSystems' build that aren't addressed by the parts I've chosen below I'd be curious to hear what those are.

Questions:
- Not including SATA cables, does the chasis/PSU come with everything I need to hook things up?
- I'm pretty sure everything below supports ECC, but would like confirmation there :)
- The Chasis I chose looks a heck of a lot like the one that iXSystems uses for the Mini. Is it the same or similar? Any concerns about airflow/heat? Is there room for additional fans?

Thanks!

Motherboard:
ASRock E3C236D2I Mini ITX Server Motherboard LGA 1151 Intel C236
https://www.newegg.com/Product/Product.aspx?Item=N82E16813599005&ignorebbr=1

CPU:
Intel Core i3-6300 Skylake Dual-Core 3.8 GHz LGA 1151 65W BX80662I36300 Desktop Processor Intel HD Graphics 530
https://www.newegg.com/Product/Product.aspx?Item=9SIA2F84FW9416&ignorebbr=1

Chasis/PSU:
SUPERMICRO CSE-721TQ-250B Black Mini-Tower Server Case 250W Flex ATX Multi-output Bronze Power Supply
https://www.newegg.com/Product/Product.aspx?Item=N82E16811152589&ignorebbr=1
https://www.supermicro.com/products/chassis/tower/?chs=721
QUESTIONS: The newegg listing and the supermicro listing don't confirm that the PSU comes with all necessary power cabling. Can someone please confirm?

Memory:
Crucial 16GB (2 x 8GB) 288-Pin DDR4 SDRAM ECC DDR4 2133 (PC4 17000) Server Memory Model CT2K8G4RFS4213
https://www.newegg.com/Product/Product.aspx?Item=N82E16820148839&ignorebbr=1

Storage Drives:
4x 3TB WD Red in RaidZ2
https://www.newegg.com/Product/Product.aspx?Item=N82E16822236344&cm_re=WD_REd-_-22-236-344-_-Product

FreeNAS Drive:
I have a Samsung 256GB SSD that I realize is overkill, but is onhand and available.

Backup drives:
2x Seagate Baracuda 3TB (7200 RPM) - ST3000DM001
https://www.seagate.com/staticfiles/docs/pdf/datasheet/disc/barracuda-ds1737-1-1111us.pdf
I have these on hand in a dual USB enclosure. They both pass SMART Tests.
So, I'm thinking I can stripe them and get enough space for a full backup.

 

[Redcoat]

The Chasis I chose looks a heck of a lot like the one that iXSystems uses for the Mini. Is it the same or similar? Any concerns about airflow/heat? Is there room for additional fans?

I have a Mini - the case looks the same.
I had cooling issues (see here, starts with a memory problem) - the Mini comes with an Asrock board with a passive heat sink and the CPU got very toasty. There's not much room in the case but I was able to rig a fan directly on top of the passive heat sink. I also modified the front of the chassis (behind the plastic fascia) to accept a side by side arrangement of 2, 2", thin fans to bring room air in through the perforated fascia and blow directly towards the ram and CPU heatsink. I put a more beefy fan than the original supply in the rear fan mounting of the back panel of the case to improve the flow past the four HDD's. All fans are running at 100% speed, no control.
I have all the temps under control as a result:

Code:

CPU 0: 31 C
CPU 1: 32 C
CPU 2: 30 C
CPU 3: 30 C
CPU 4: 31 C
CPU 5: 32 C
CPU 6: 30 C
CPU 7: 31 C
ada0: 27 C
ada1: 25 C
ada3: 27 C
ada4: 27 C

Given how limited the space is inside this case, I would want to check that your chosen MB/CPU/stock cooler will actually fit inside this case (that the cooler doesn't interfere with the drive cage).

 

[jaaassh]

I've seen pictures of that passive iX heatsink.. You're saying you rigged a fan on top of that? That must mean there's 2-3 inches of clearance, right?

 

[Redcoat]

That's a maybe - the fan I used is 1" thick and is sitting directly on the top edges of the ram chips that are just above the level of the top of the passive heatsink's fins. I have a design for a very short duct section (really a very short rectangle to round "adapter") to better mount the fan waiting on the delivery of my 3D printer ...
I just slid the case back and measured - there's 3.5" between the top face of the MB and the bottom of the drive cage.

 

[Chris Moore]

Hi All,
Working on a new build today. I've read through the 2016 hardware guide and have generally been trying to follow that. My goal is to build a box that has a small form factor for home file storage and a Plex server. It'd be nice, if bhyve worked somewhat okay, as professionally I'm a software developer and spinning up free VMs would be nice. Strong performance in that area is *not* required.

Generally, I'm weighing this against simply buying the iXSystems FreeNAS mini. I've built many a computer in the past, so piecing things together isn't a concern. If I can save a couple hundred by doing it myself, that'd be the preferred route. That said, if there is value-added by iXSystems' build that aren't addressed by the parts I've chosen below I'd be curious to hear what those are.

Questions:
- Not including SATA cables, does the chasis/PSU come with everything I need to hook things up?
- I'm pretty sure everything below supports ECC, but would like confirmation there :)
- The Chasis I chose looks a heck of a lot like the one that iXSystems uses for the Mini. Is it the same or similar? Any concerns about airflow/heat? Is there room for additional fans?

Thanks!

Motherboard:
ASRock E3C236D2I Mini ITX Server Motherboard LGA 1151 Intel C236
https://www.newegg.com/Product/Product.aspx?Item=N82E16813599005&ignorebbr=1

CPU:
Intel Core i3-6300 Skylake Dual-Core 3.8 GHz LGA 1151 65W BX80662I36300 Desktop Processor Intel HD Graphics 530
https://www.newegg.com/Product/Product.aspx?Item=9SIA2F84FW9416&ignorebbr=1

Chasis/PSU:
SUPERMICRO CSE-721TQ-250B Black Mini-Tower Server Case 250W Flex ATX Multi-output Bronze Power Supply
https://www.newegg.com/Product/Product.aspx?Item=N82E16811152589&ignorebbr=1
https://www.supermicro.com/products/chassis/tower/?chs=721
QUESTIONS: The newegg listing and the supermicro listing don't confirm that the PSU comes with all necessary power cabling. Can someone please confirm?

Memory:
Crucial 16GB (2 x 8GB) 288-Pin DDR4 SDRAM ECC DDR4 2133 (PC4 17000) Server Memory Model CT2K8G4RFS4213
https://www.newegg.com/Product/Product.aspx?Item=N82E16820148839&ignorebbr=1

Storage Drives:
4x 3TB WD Red in RaidZ2
https://www.newegg.com/Product/Product.aspx?Item=N82E16822236344&cm_re=WD_REd-_-22-236-344-_-Product

FreeNAS Drive:
I have a Samsung 256GB SSD that I realize is overkill, but is onhand and available.

Backup drives:
2x Seagate Baracuda 3TB (7200 RPM) - ST3000DM001
https://www.seagate.com/staticfiles/docs/pdf/datasheet/disc/barracuda-ds1737-1-1111us.pdf
I have these on hand in a dual USB enclosure. They both pass SMART Tests.
So, I'm thinking I can stripe them and get enough space for a full backup.

Out of curiosity, what is the total for all this?

 

[jaaassh]

Out of curiosity, what is the total for all this?

Without drives, it's $763.

Drives are ~115 each.

 

[jaaassh]

Without drives, it's $763.

Drives are ~115 each.

Well, actually, I found the memory for a bit cheaper on Amazon, so I might buy that there. Newegg had the best prices for the other items.

 

[Chris Moore]

Well, actually, I found the memory for a bit cheaper on Amazon, so I might buy that there. Newegg had the best prices for the other items.

Would it be worth a few hundred extra to have a lot more resources to run virtualization? I guess it depends on if small and quiet are a big part of what you want?

 

[jaaassh]

Are you suggesting that bhyve won't work well with just 16GB and I should bump that to 32?

 

[Chris Moore]

Are you suggesting that bhyve won't work well with just 16GB and I should bump that to 32?

More like, you can get so much more:
https://www.ebay.com/itm/Supermicro...8x-8gb-10600R-24-Bay-SAS2-846EL1/372160071137

 

[jaaassh]

No - probably not something like that.

 

[jaaassh]

@Redcoat What kind of processor do you have that's showing 8 cores?

I have a Mini - the case looks the same.
I had cooling issues (see here, starts with a memory problem) - the Mini comes with an Asrock board with a passive heat sink and the CPU got very toasty. There's not much room in the case but I was able to rig a fan directly on top of the passive heat sink. I also modified the front of the chassis (behind the plastic fascia) to accept a side by side arrangement of 2, 2", thin fans to bring room air in through the perforated fascia and blow directly towards the ram and CPU heatsink. I put a more beefy fan than the original supply in the rear fan mounting of the back panel of the case to improve the flow past the four HDD's. All fans are running at 100% speed, no control.
I have all the temps under control as a result:

Code:

CPU 0: 31 C
CPU 1: 32 C
CPU 2: 30 C
CPU 3: 30 C
CPU 4: 31 C
CPU 5: 32 C
CPU 6: 30 C
CPU 7: 31 C
ada0: 27 C
ada1: 25 C
ada3: 27 C
ada4: 27 C

Given how limited the space is inside this case, I would want to check that your chosen MB/CPU/stock cooler will actually fit inside this case (that the cooler doesn't interfere with the drive cage).

 

[Redcoat]

That's a C2750 Atom - see https://ark.intel.com/products/77987/Intel-Atom-Processor-C2750-4M-Cache-2_40-GHz

 

[tvsjr]

More like, you can get so much more:
https://www.ebay.com/itm/Supermicro...8x-8gb-10600R-24-Bay-SAS2-846EL1/372160071137

I'm all for more capabilities... and there's certainly no kill like overkill. But jumping from FreeNAS Mini to 4U rack mount seems a bit... optimistic?

 

[Chris Moore]

I'm all for more capabilities... and there's certainly no kill like overkill. But jumping from FreeNAS Mini to 4U rack mount seems a bit... optimistic?

It might be a little much.