Help with parts list for a 20TB NAS for an Video Editor

Kuma

Cadet
Joined
Feb 10, 2019
Messages
5
Hi,
My friend is a video editor and he's ask me if I can build him a 20TB NAS system. NAS is totally not in my territories, I normally build gaming PC.
What he want is, is that the system is made of new parts and have to be as cheap as possible and also 20TB drive space in it.
Can anyone help me compiled a list?
I'm based in the Netherlands but please just give me any reference.

If possible I would like to have a full list of part I need to get.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
as cheap as possible
A dollar amount would be good here because if the person is thinking $500, that isn't happening with new parts.
Can anyone help me compiled a list?
Yes, we can help.
If possible I would like to have a full list of part I need to get.
We need to get some questions answered first, so we can get a clear picture of what you are wanting.

Is this to be a free-standing system or a rack mounted server chassis?
Do you want hot-swap drive bays, or is a fixed mounting adequate?
Fixed mounting increases difficulty when a drive fails and needs to be replaced but it is usually a little less in the initial cost of hardware.
Is this system intended simply for archiving historical footage or do they want to be able to edit files directly from this system?
Having a system that is fast enough to edit live is going to make everything more expensive because you will also need 10Gb network from the editing station to the storage system and the storage system will need to be faster to keep up with the network connection.

Design of a network storage subsystem is much more complicated than a gaming system as it also requires thinking of the data transfer rate between the sever and client and the data transfer rate between the server and it's internal disk system which are measured differently.

It will be much simpler if this is just an archive system as that doesn't need to be as fast as a system that they want to edit from.

If it is for a company, they also need to consider the rate at which their storage needs will increase. How long is 20TB going to be sufficient? The organization I am managing storage for is increasing the data stored by a little more than 100TB every year and they need to keep it all online so it can be indexed in a manner similar to a database. The current server has about 550TB of capacity and it replaced a server that was only two years old that has 330TB of capacity. We will likely buy another at the end of the year this year. So, rate of growth is an important consideration.
 

Kuma

Cadet
Joined
Feb 10, 2019
Messages
5
A dollar amount would be good here because if the person is thinking $500, that isn't happening with new parts.

Yes, we can help.

We need to get some questions answered first, so we can get a clear picture of what you are wanting.

Is this to be a free-standing system or a rack mounted server chassis?
Do you want hot-swap drive bays, or is a fixed mounting adequate?
Fixed mounting increases difficulty when a drive fails and needs to be replaced but it is usually a little less in the initial cost of hardware.
Is this system intended simply for archiving historical footage or do they want to be able to edit files directly from this system?
Having a system that is fast enough to edit live is going to make everything more expensive because you will also need 10Gb network from the editing station to the storage system and the storage system will need to be faster to keep up with the network connection.

Design of a network storage subsystem is much more complicated than a gaming system as it also requires thinking of the data transfer rate between the sever and client and the data transfer rate between the server and it's internal disk system which are measured differently.

It will be much simpler if this is just an archive system as that doesn't need to be as fast as a system that they want to edit from.

If it is for a company, they also need to consider the rate at which their storage needs will increase. How long is 20TB going to be sufficient? The organization I am managing storage for is increasing the data stored by a little more than 100TB every year and they need to keep it all online so it can be indexed in a manner similar to a database. The current server has about 550TB of capacity and it replaced a server that was only two years old that has 330TB of capacity. We will likely buy another at the end of the year this year. So, rate of growth is an important consideration.

Hi,

Sorry for taking so long, I was waiting for my friend to answers some questions, but sadly he only answers just a couple...

He said:
1. He is using it only for archive.
2. Just as cheap as possible...

He also said that if the used part make a lot of difference than I can put in a used part.

Next to it seem he want more storage than backup.
 

Kuma

Cadet
Joined
Feb 10, 2019
Messages
5
Hi,
My friend is a video editor and he's ask me if I can build him a 20TB NAS system. NAS is totally not in my territories, I normally build gaming PC.
What he want is, is that the system is made of new parts and have to be as cheap as possible and also 20TB drive space in it.
Can anyone help me compiled a list?
I'm based in the Netherlands but please just give me any reference.

If possible I would like to have a full list of part I need to get.

So in conclusion, he said:
1. He is using it only for archive.
2. Just as cheap as possible...

He also said that if the used part make a lot of difference than I can put in a used part.

Next to it seem he want more storage than backup.
 

Bozon

Contributor
Joined
Dec 5, 2018
Messages
154
Kuma, search some of the recent build threads. Check for frequent posters, many of them have signatures with important articles to read to help you understand FreeNAS.

You can save a lot of money with used parts.

You need to understand some terminology to understand the options.Things that did not come into play with gaming systems.

When you are reading understand that you almost certainly need RAIDZ2 for redundancy. This will mean that you need 6 or 8 disks. To get 20TB with that many disks 6 - 8TB disks.

Supermicro or ASROCK boards predominate the choices that FreeNAS experts choose.

ECC Ram is another feature that is basically a requirement.
 

Kuma

Cadet
Joined
Feb 10, 2019
Messages
5
Hi,

My friend ask me if I can build a cheaper NAS then on the market.
He need 20TB and ONLY will be using it archive old raw footage.

Do I have to much ram?

Right now the part list are:
- Intel Celeron G4900 / €50
- ASRock H310M-HDV / €55
- Corsair Vengeance LPX 2*8GB / €110
- Cooler Master N300 / €45
- Corsair VS450 / €35
- SanDisk 16GB / €10

€305


For drive:
- Seagate IronWolf 6TB(256MB cache) / 4*€185 / €740

In total of €1045



Or should I replace the system with:
- Synology DiskStation DS418j / €300
- QNAP TS-431P / €300
- Asustor AS1004T / €265

What do you think I should do?
 

Heracles

Wizard
Joined
Feb 2, 2018
Messages
1,401
Hi Kuma,

You asked about RAM, but there is a much bigger concern with your setup.... Space!

Your description asks for 20 TB of storage and you plan for only 4x 6T drives. As such, you can not achieve that capacity other way than Raid0, a structure without ANY redundancy that will destroy and loose everything at the very first incident.

Even RaidZ1 is not recommended.

As such, if you go with a setup of only 4 drives, you have to go with 4x 10TB RaidZ2. That will give you the usable space of 2 drives, so the 20 TB you are looking for.

If you can increase to 5 or 6 drives, you can do 6 drives RaidZ2 and there, 6x 6TB will answer your need.

So I clearly recommend you to re-design your pool (how many drive, what size, what logical structure for your vDevs) before even starting to design the server that will operate such a pool.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
My friend is a video editor and he's ask me if I can build him a 20TB NAS system.
You have started several threads on the same question. Just give it some time and stop creating new threads.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
You might first want to go here and look to see how many disks and what size disks you need to use to get 20TB of usable space:

https://wintelguy.com/zfs-calc.pl

This is my suggestion:

1550039452507.png
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
I am not sure what price you will have to pay for 6 TB drives where you are, but $1400 for drives is an optimistic estimate on my part:
https://www.amazon.com/Red-6TB-NAS-Hard-Drive/dp/B00LO3KR96
These WD Red drives are running $216 each on Amazon.

Here are some documents to review that may help you understand the things that would be appropriate to a 'low end' server :

FreeNAS® Quick Hardware Guide
https://forums.freenas.org/index.php?resources/freenas®-quick-hardware-guide.7/

Hardware Recommendations Guide Rev 1e) 2017-05-06
https://forums.freenas.org/index.php?resources/hardware-recommendations-guide.12/

Slideshow explaining VDev, zpool, ZIL and L2ARC
https://forums.freenas.org/index.ph...ning-vdev-zpool-zil-and-l2arc-for-noobs.7775/

The other hardware you need for a build could vary a lot depending on what you can source locally, but here is an example:

Intel Xeon E3-1230V2 SR0P4 3.30GHz Processor
https://www.ebay.com/itm/SR0P4-Inte...d-Core-CM8063701098101-Processor/202572624908
US $74.00

Super Micro X9SCM-F, LGA 1155, Intel C204, Micro ATX server motherboard
https://www.ebay.com/itm/New-SuperM...rd-Accessoreis-are-not-included-/352358089215
US $77.77

16GB 2X8GB Memory RAM Intel Xeon E3 ONLY DDR3, 1600MHz, ECC, CL11, 2R, X8, 1.5V, Unbuffered, DIMM, 240-pin
https://www.ebay.com/itm/16GB-2X8GB...-CMT-SFF-Intel-Xeon-E3-ONLY-B89-/301855376261
US $126.00

Dell H310 6Gbps SAS HBA LSI 9211-8i P20 IT Mode
https://www.ebay.com/itm/Dell-H310-...-IT-Mode-for-ZFS-FreeNAS-unRAID-/162834659601
US $56.55

1M Mini SAS 4i SFF-8087 36-Pin Male to 4 SATA 7-Pin Splitter Adapter Cable NEW
https://www.ebay.com/itm/1M-Mini-SA...7-Pin-Splitter-Adapter-Cable-NEW/272098511869
US $7.39

You just need a case large enough to accommodate the 8 drives.
I like these Fractal Design Define R5 cases:
https://www.ebay.com/itm/Fractal-De...R5-BK-2-Fractal-Design-Case-Fans/143125156314
 
Top