Hardware Checkup Raw File Server

[FabianX2]

Hey there,

we are building a new Storage Nas for big RAW Video Files. We have usually 2 - 5 Useres (more often 2 - 3 than 4 - 5) wirting or reading big Files 200Gb+- each File and in total up to about 2TB per User simultainously. Source is mostly Sata SSDs over 10GbE or 1GbE.
It would be nice to be able to edit some videos occasionally direct from the Server but thats not the primary use case. Most times the data will be copied to the interal SSDs of the Workstations before editing.
The most importand files will Back up to a Synology 220+ 36TB. I plan to additionaly Back up all Files to google dirve.

For now I only have experiance in using the freebsd true Nas and am leaning against trying the scale linux version now.

Here is what I plan to buy. Any help is appriciated. Power consumtion is no isssue.

Ram:
Auswahl: https://geizhals.de/?cat=ramddr3&xf=1454_65536~15903_DDR4~15903_keinSO~15903_mitECC
4x 64GB 3200 ECC: 653€

CPU:
Auswahl: https://geizhals.de/?cat=cpuamdam4&xf=12114_15+-+Zen+3+(ab+2020)~14840_8~820_AM4
R7 5700X: 190€ or R9 5900X: 345€

Mainboard: ASRock https://geizhals.de/asrock-rack-x570d4u-2l2t-bcm-90-sxg9b7-a0uayl-a2868344.html
Rack X570D4U-2L2T/BCM: 606€ (Mainly for the 2x 10GbE, 8x Sata, 2xM2 and IPMI)

HDD: https://geizhals.de/?cat=hde7s
6*18TB: 1620€ (RZ1 or RZ2) -> as soon as those are full we plan to add an aditional pcie controller and another pool of 6HDDs with the best price per TB at that time.

SSD: https://geizhals.de/samsung-ssd-870-evo-250gb-mz-77e250b-a2458834.html?hloc=de
2*Samsung 870EVO 250GB: 62€ (System Mirror)

NVMe: https://geizhals.de/?cat=hdssd&xf=1...plz=&dist=&mail=&sort=t&bl1_id=30#productlist
1 TB 980 PRO: 108€ or 2 TB 980 PRO: 189€ for Cache. We will probably not use VMs so a second one is useless right?

Gehäuse:
R7 XL: 235€ https://geizhals.de/fractal-design-define-7-xl-black-fd-c-def7x-01-a2239847.html?hloc=de

Netzteil:
BQ Straight Power 11 550W: 92€ https://geizhals.de/be-quiet-straight-power-11-550w-atx-2-4-bn281-a1753710.html?hloc=de (not shure how to connenct all the satas in case of expanding to 12 hdds 2ssds ind total)

Kühlung:
BQ Pure Rock 2: 34€ https://geizhals.de/be-quiet-pure-rock-2-silver-bk006-a2279763.html?hloc=de

3836€


Thanks :)

 

[NugentS]

As this is for "proper" work I would consider a dual PSU for redundancy. Also I would use a bigger PSU anyway. 550 is probably fine, but I like to have lots of spare

 

[joeschmuck]

2 TB 980 PRO

Make sure the most current firmware is installed, these have a previous bad firmware issue.

R7 5700X

EDIT: The User Manual for the motherboard selected says that you need a PRO series to use ECC RAM in your system.

It would be nice to be able to edit some videos occasionally direct from the Server but thats not the primary use case

6*18TB: 1620€ (RZ1 or RZ2)

This drive configuration does not support online real-time video editing. You are better off to continue editing on the local workstation.

 

[NickF]

Make sure the most current firmware is installed, these have a previous bad firmware issue.


You need a PRO series to use ECC RAM in your system.



This drive configuration does not support online real-time video editing. You are better off to continue editing on the local workstation.

Hi Joe, it’s not true that you need a PRO series Ryzen for ECC. They all support it, it’s dependent on the board properly implementing it. In the case of the AsrockRack board it is.

 

[joeschmuck]

Hi Joe, it’s not true that you need a PRO series Ryzen for ECC. They all support it, it’s dependent on the board properly implementing it. In the case of the AsrockRack board it is.

The user manual for that specific motherboard had the statement that it must be a PRO version CPU to support ECC RAM. I've never heard of that either but when someone asks if some hardware will work, I tend to check the user manual for little things like this. I will edit my comment above to state that the User Manual says...

 

[FabianX2]

As this is for "proper" work I would consider a dual PSU for redundancy. Also I would use a bigger PSU anyway. 550 is probably fine, but I like to have lots of spare

As there is no GPU I calculated about 300 Watt max consumption. Thought 550 is plenty. But I will use 750 Watt insted. Thx.

How does a dual PSU work in the consumer hardware segment? I tend to ignor that risk as express shiment will bring a new power supply same day or in the worst case next day. Thats a downtime I can handle.

Make sure the most current firmware is installed, these have a previous bad firmware issue.

Will do thx. Would not have thought about that.

EDIT: The User Manual for the motherboard selected says that you need a PRO series to use ECC RAM in your system.

My NAS at home runs with an asrock rac x470d4u, 2700x and 128gb ECC. So I didnt expect any problems there. To my knowledge only the G-CPUs with inntegrated GPUs have ECC disabled. Can anbody confirm that it will work?

This drive configuration does not support online real-time video editing. You are better off to continue editing on the local workstation.

Thats not the main focus. Redinering direct on Server is out of the question due to the lak of the gpu. But even just occasionaly editing files directly from the server seems to be a problem i guess. I was initialy thinking about a huge sata SSD Pool like 12x2tb mx500 for example. But a lot of people advied against as of the tcpip limitations. And stuff like iscsi is out of my league.
So the Server will act as Data storage and we will trasnsfer the data to the worksations ssds when needed. In my experiance with 8*8Tb at home transfers will be arround 400 mbs wich is tollerable.

The user manual for that specific motherboard had the statement that ...

Beside the ECC problem the manuale also states a max of 128gb ram and 32gb in a singel module. Any insides about that?

 

[jgreco]

As there is no GPU I calculated about 300 Watt max consumption. Thought 550 is plenty. But I will use 750 Watt insted. Thx.

550 isn't plenty. See

Proper Power Supply Sizing Guidance

I've seen about 1,000 threads like this one where people decide that they can power a dozen hard drives off a 360 watt supply. DO NOT DO THIS. I've seen another 1,000 threads where people decide to buy the cheapest power supply that they can find. DO NOT DO THIS. Your NAS lives or dies by...

www.truenas.com

How does a dual PSU work in the consumer hardware segment? I tend to ignor that risk as express shiment will bring a new power supply same day or in the worst case next day. Thats a downtime I can handle.

Consumer systems generally don't handle dual PSU's, as they're complicated. Plus expensive, as in you could probably buy a cold spare PSU plus your live PSU for less.

 

[FabianX2]

I have be quiet! Straight Power 11 in all my Systems in diffrent Wattage from 550Watt to 850Watt. In my personal NAS working 24/7 for about 3 Jears+ now. I know thats far away from proffessional grade but I thought of thouse Power Supplys as Okish.

What do you recommend? Diffrent Manufacture, modle, more wattage?

 

[NugentS]

I was thinking more wattage

 

[FabianX2]

If I stay with the be quiet Straight Power 11 Platinum series there is 11 Sata plugs with and above 750watt. Thats a good argument as I was wondering how to plug all those drives. There is allthow 850, 1000 or 1200 but no additional satas. Whats would you recommend and why? For starters there will be 6 HDDs, 3SSDs (2xsata 1xm2), a cpu with arround 125 Watt max in 99,99% of the cases much less and no GPU. Even if 6 additional dives come in to path with a controller there is a max consumption of way under 500 Watt. So whats a good headroom?

So even if all the dirves spinn up nearly the same time at boot the CPU will be far away from full throttel. The draw of slow ddr 4 ram is should be neglectable. The rest of the components are not that thirsty either. 750Watt should be 30% headroom even in the worst of cases. Please correct me if I´m wrong.

 

[jgreco]

Even if 6 additional dives come in to path with a controller there is a max consumption of way under 500 Watt. So whats a good headroom?

Please see the definitive resource on this topic:

Proper Power Supply Sizing Guidance

I've seen about 1,000 threads like this one where people decide that they can power a dozen hard drives off a 360 watt supply. DO NOT DO THIS. I've seen another 1,000 threads where people decide to buy the cheapest power supply that they can find. DO NOT DO THIS. Your NAS lives or dies by...

www.truenas.com

 

[NugentS]

I would be happier with 750 Watts. You are talking about 12 HDD's in total