Mid-Range FreeNAS Build

[Gaspetaahl]

Hey,
so Ive been researching different NAS topics the last week and settled on a build that Im more or less happy with. My Budget is kinda limited but I still want to have a system that is easily upgradable. Also I wanted to use ECC RAM, so this is what I came up with. (Its more or less build upon this German guide if you are interested: https://www.elefacts.de/test-32-nas_advanced_1.0__intel_kaby_lake_mit_ecc_ram_6x_sata_und_m.2)
Also encryption is really important to me. OpenZFS encryption isnt there yet unfortunatly so I have to use geli for now. Shouldnt be a big problem with a AES-Ni processor-though

Motherboard: Gigabyte GA-X150M-PRO ECC https://www.amazon.de/dp/B01AVPAJWW...&creativeASIN=B01AVPAJWW&tag=geizhalspre03-21
My idea here was to have a cheap Mainboard that supports ECC RAM. It has also got a Intel C Chipset but unfortunatly no onboard-gpu. Thats why the GPU is in the list(for first install).

CPU: Intel Pentium Gold G4560, 2x 3.50GHz https://www.amazon.de/Intel-Pentium-G4560-50GHz-Boxed/dp/B01N7U18M1/ref=olp_product_details?_encoding=UTF8&me=
I think this is enough CPU for me. I dont want to do that much on the NAS. Maybe use pyload or plex. But thats not what I actually need it for.

RAM: Kingston ValueRAM Intel DIMM 8GB, DDR4-2133, CL15-15-15, ECC (KVR21E15D8/8I) https://www.amazon.de/dp/B01FSUOY2Q...&creativeASIN=B01FSUOY2Q&tag=geizhalspre03-21
I wasnt able to find any of the Vendors reccommodations from here: download.gigabyte.eu/FileList/Memory/mb_memory_ga-x150m-pro-ecc.pdf
Maybe you have a tip for me? (I needs to be shipeed to Germany)
I wanted to start with 8GB an then upgrade later.

System SSD: Intel SSD E 6000p 128GB, M.2 (SSDPEKKR128G7XN) https://www.amazon.de/dp/B01LWR6QLN?smid=ACMIUR0TOLYDM&linkCode=df0&creative=22510&creativeASIN=B01LWR6QLN&childASIN=B01LWR6QLN&tag=geizhals10-21
The Idea here was to have a NVMe SSD to not use one of the 6 SATA Ports from the Mainboard. Its not that fast but cheap. Could I use the left over space for cache? Should I buy a better SSD then?

PSU: be quiet! System Power 9 400W ATX 2.4 (BN245) https://www.amazon.de/quiet-Netzteil-System-Power-BN245/dp/B079KG3TZ5/ref=olp_product_details?_encoding=UTF8&me=
GPU: Sapphire Radeon R5 230, 1GB DDR3 https://www.amazon.de/dp/B00JM49ECK?smid=A1HTKBNYG718CQ&linkCode=df0&creative=22514&creativeASIN=B00JM49ECK&childASIN=B00JM49ECK&tag=geizhals10-21
Case: Fractal Design Node 804 https://www.amazon.de/dp/B00JBBH93K?linkCode=xm2&camp=2025&creative=165953&smid=A3JWKAKR8XB7XF&creativeASIN=B00JBBH93K&tag=geizhalspre03-21
This is a nice Case but also a bit expensive. Actually I wanted to use a Xigmatek Asgard II (https://www.amazon.de/gp/product/B0...eASIN=B003D0ET2O&linkCode=as2&tag=elefacts-21) but its not available at the moment. Any other suggestions?

HDDs: Not quite sure yet but I was thinking about 4x 4TB WD Red in a RAIDZ2 an upgrading later when OpenZFS RAIDZ Upgrading is supported.

Thank you very much for any help

 

[Chris Moore]

Why is the GPU in there?

Sent from my SAMSUNG-SGH-I537 using Tapatalk

 

[Gaspetaahl]

Why is the GPU in there?

Sent from my SAMSUNG-SGH-I537 using Tapatalk

Because the Mainboard has no onboard-gpu. I need the GPU for the first install and maybe for later.

 

[Ericloewe]

Then get a different motherboard. Any residual cost savings after considering the GPU are not worth the hassle (and the less-appropriate motherboard).

 

[Chris Moore]

The Supermicro system board that you should buy would be this one:
https://www.amazon.de/Supermicro-X1...=1536850603&sr=1-1&keywords=supermicro+x11ssh
It includes a dedicated video chip on the board. It also includes IPMI which allows for remote management of the board over the network. If you use the KVM over IP capability of the board, you will never need to connect a monitor, keyboard, mouse or CD drive to the board because they can all be connected remotely over the network as virtual devices from your desktop computer. It also has support for eight hard drives.
The cost of the board and video card you suggested was about 143 EUR, where this is about 211 EUR. A little more expensive but it will easily last six to ten years because it is a quality component and it is what you should use.

 

[Chris Moore]

I really dislike the use of desktop computer boards, with built in audio circuits, in a server application. That Gigabyte board even includes two 32bit PCI slots. What would you ever use those for? Nothing. They are a total waste of space that the manufacturer puts on the board to make it compatible with legacy hardware, most people will never need for anything and certainly not with FreeNAS.

 

[KrisBee]

@Gaspetaahl You'll have to bit the bullet and take the advice to buy a server grade motherboard. Which really means picking a supermicro motherboard. You might get lucky and find something s/hand, but compared to the US the s/hand market in the EU is pretty small. A possible alternative is to buy a s/hand pre-built branded server (Del, HP , Lenovo, Fujitsu) but this can have drawbacks if you not familiar with server hardware.

Personally, if buying new is beyond your budget, I'd try to find a s/hand supermicro x10 series m/board to match with compatible CPU and memory .

 

[Gaspetaahl]

Yeah ok. I think a SuperMicro board would be a reasonably choice considering the price of the GPU an the other benefits from the server mainboard.

What about the SSD and the Case? Any recommendations there?

 

[Gaspetaahl]

So I got a X10SLM-F for 40€ on ebay today.
accourding to the guide on the forum here this RAM should fit. Which one should I choose here? Samsung or Crucial? Other RAM isnt available in Germany. What are the chances of it still being available in a few years?
https://www.amazon.de/dp/B008EM9GVA...&creativeASIN=B008EM9GVA&tag=geizhalspre03-21
https://www.amazon.de/dp/B00IXM0GSI...XM0GSI&childASIN=B00IXM0GSI&tag=geizhals10-21
Im looking for used Xeon E3-* on ebay now. I dont think I will find the exact RAM there.
Also I need another System Storage device now. Whats the best solution there?
Thank you very much so far

 

[Chris Moore]

Samsung or Crucial?

I prefer Samsung. I have Samsung memory in both of my servers and in my wife's desktop computer. Either of them should work.

What are the chances of it still being available in a few years?

This kind of memory is common and should be readily available for a decade or more.

Im looking for used Xeon E3-* on ebay now. I don't think I will find the exact RAM there.

Availability might not be as good in Germany, but both the CPU and RAM should be available on eBay. That is where I buy all the gear I use at home because I am not willing to pay 'new' pricing.

Also I need another System Storage device now. Whats the best solution there?

Do you mean a boot device? I would suggest a small SSD.
I am looking at buying some of these to replace the spinning disks I am currently using:
https://www.ebay.com/itm/Sandisk-64GB-SSD-U110-64GB-SDSA6GM-064G/263928939928
However, you can also boot from mechanical drives. I have been using a mirrored pair of these to boot from for over two years now with no problems at all:
https://www.ebay.com/itm/TOSHIBA-MK...-1-5Gb-s-2-5-Hard-Disk-Drive-HDD/123189847411

 

[Chris Moore]

Im looking for used Xeon E3-* on ebay now. I don't think I will find the exact RAM there.

A processor like this would be a good choice:
https://www.ebay.com/itm/Intel-Xeon...et-H3-5-GT-s-SR152-CPU-Processor/323436053916

Also, if you can order from this vendor, I have used their memory before and they make good on their warranty.
https://www.ebay.com/itm/16GB-2X8GB...10SLM-F-X10SLM-LN4F-X10SLM-F-B89/301371619117

 

[Gaspetaahl]

Hi thanks for the tips.
i got this from ebay the
Serverboard Supermicro X10SLL-F
Intel Xeon E3-1231 v3 3,40GHz Turbo 3,80GHz
2x 8GB M391B1G73BH0-CK0

Can I still use the same psu from above or do you suggest something else?
Any tips on the case?

 

[Chris Moore]

Intel Xeon E3-1231 v3 3,40GHz Turbo 3,80GHz

I literally pulled the specs on the processor you picked and the processor I suggested and even though the model numbers are different, the specs appear to be identical. It irritates me when Intel does that:
https://ark.intel.com/products/75055/Intel-Xeon-Processor-E3-1240-v3-8M-Cache-3_40-GHz
https://ark.intel.com/products/80910/Intel-Xeon-Processor-E3-1231-v3-8M-Cache-3_40-GHz

Can I still use the same psu from above or do you suggest something else?

I prefer to go with a larger capacity Power Supply just so I don't need to replace it in a few years when I want to do something else that takes more power. If you have a good (Gold or Silver) rated supply, it should be very efficient and last for six to eight years easily. I used this model in the last build I did using a smaller capacity PSU: https://www.evga.com/products/product.aspx?pn=220-GS-0550-V1
I have had no trouble out of it.

Any tips on the case?

My favorite is theFractal Design Define R5. I like it better than the R6. If you can pick one of those up used, I think it would be better because it is easier to get the drives in and out of. The mounting for the drives in the Node 804 is cumbersome and it makes replacing drives a chore.

 

[Ericloewe]

I literally pulled the specs on the processor you picked and the processor I suggested and even though the model numbers are different, the specs appear to be identical. It irritates me when Intel does that:

IIRC, the 1231 was a later release, from when their yields improved and they gave "everyone" free 100 MHz bumps to clock speeds. Power performance should also be slightly better than on original 1240s, since the 1231 always has the small process improvements.

 

[Gaspetaahl]

Hey,
so Im nearly done and only missing a system drive and a CPU Fan.
So I wanted to use the internal usb 3.0 Port on the mainboard to save a sata port for hdds. But a ssd for a system drive would also be nice so I thought abut using a m2 SATA to USB 3.0 converter stick like this: https://www.amazon.de/QUMOX-tragbar...00XBT2OAG/ref=cm_cr_arp_d_product_top?ie=UTF8
With a cheap 64GB SSD like this one: https://www.amazon.de/dp/B075P1HZXZ...eizhals10-21&ascsubtag=XNknivF5Eb6GHco52mxVAA
But couldnt find anything about them on the forums. Is there a reason not to do it like this?
Also I wondered if there would be a reason to prefer a Top-Blow CPU-Fan over a tower one. These would be my favorites:
https://www.amazon.de/dp/B00PQ5LV1G...eizhals10-21&ascsubtag=bLtSqDgIIlh40EgTXzgHow
https://www.amazon.de/dp/B00CYW2SNO...geizhals10-21&ascsubtag=nXpWDRFqygMpQfdgJZl1A

I bought a Node 804 as a case if it matters for air-flow

 

[Chris Moore]

So I wanted to use the internal usb 3.0 Port on the mainboard to save a sata port for hdds. But a ssd for a system drive would also be nice so I thought abut using a m2 SATA to USB 3.0 converter stick like this: https://www.amazon.de/QUMOX-tragbar...00XBT2OAG/ref=cm_cr_arp_d_product_top?ie=UTF8
With a cheap 64GB SSD like this one: https://www.amazon.de/dp/B075P1HZXZ...eizhals10-21&ascsubtag=XNknivF5Eb6GHco52mxVAA

You could just put one of these in there:
https://www.amazon.de/SanDisk-Cruze...&qid=1537979068&sr=1-1&keywords=usb+2.0+stick
There is no need to spend all that money for a big, fast boot drive. It doesn't need to be fast, just reliable, and make regular backups of your config so that when it fails, you can just re-install on a new one and reload your config from the backup.

But couldn't find anything about them on the forums. Is there a reason not to do it like this?

Too much money and adds another layer of complexity. One more thing that could break. Simple is better.

Also I wondered if there would be a reason to prefer a Top-Blow CPU-Fan over a tower one.

That is all about how much room you have in your case to accommodate a fan. I use a tower fan on my system because it makes less noise and cools better. The thin, flat ones are usually louder with higher fan speed to get the same cooling.

I bought a Node 804 as a case if it matters for air-flow

You should have plenty of room in there for a tower cooler. I got one from Noctua that is very quiet for my wife's desktop, but the one I use in my server is from Dynotron and it is only a little louder.

CPU Fan: Dynatron R27 Side Fan CPU Cooler 3U for Intel Socket LGA2011 (Narrow ILM) - - US $39.59
https://www.ebay.com/itm/401284811045

Depends on what board and CPU you are running though, you might be just as well served by the factory cooler that comes with the CPU.

 

[Gaspetaahl]

Allright so I think a simple flash drive should do.
Now the really last thing would be to decide on HDD.
I want to have a RAID Z2 and my budget is around 900€. So I was thinking about either

5 x 6 TB WD Red (177€ each) = 18TB usable space (885€)
or
4 x 8 TB WD Red (222€ each) = 16 TB usable space (888€)

So obviously the 6TB drives give me more usable space/€ but the 8TB drives are better to expand in a year or two giving me 8 TB per new drive instead of 6TB (I've got 6 SATA ports on the system so far)
Also the 8TB drives are helium filled. Is this good or bad? Is there any long term experience on helium filled drives? do they leak in lets say 5 years?

Also where exactly is the differnece between these two 8TB drives? Should I prefer one over the other?
https://geizhals.de/?cmp=1401865&cmp=1816589

 

[Stux]

Helium drives use less power. Which means less heat. Which is good.

 

[Chris Moore]

4 x 8 TB WD Red (222€ each) = 16 TB usable space (888€)

I guess the question here is how are you figuring that usable space?

If you are planning to use RAIDz2, which should always be the plan if you are using drives larger than 1TB, you will only have 10 TiB of usable space because you have space used for overhead and you need to keep 20% free space because of the copy on write nature of ZFS.
I would suggest going with six data drives either capacity that works for you.

Here is a good, easy to use, capacity calculator that is reasonably accurate: https://wintelguy.com/zfs-calc.pl