first of all .....thanks to all who commented on
www.truenas.com
because my case is extremely similar
the only difference Bigger
some video Formats uses TIFF files sizes from 10 MB the smaller to 75 MB the biggest ...... in a train of like 24 or 30 files per second
so you can guess 1 hour of video is 30 * 3600 *75 MB meaning 8 TB of data
that is a incredible humongous amount of files and data
and that is the bread & butter everyday
so we really need to write as fast as possible.... and read too.
we are evaluating 90 disk Storage server for HDD
and 24 disk storage server for NVMe SSDs
so with which storage I can get better write performance
or
where I can have a good Online ZFS Calculator
RAM I have plenty ( 1TB)
dual port 100 GBE NIC (Mellanox ConnectX-4 )
I would like not to sacrifice too much Space ( like mirror ) ....but if I have to, I will have to do it
any advices ?????
my main concerns is ...... too many big files on too fast NICs ..... meaning Very High CPU usage
unfortunatelly ....will have to pay to try .........
thanks in advance
Gustavo
Zfs layout - best write performance?
Hello, I have a truenas system built with 256gb ram, and a 100gbe fiber card in it, with 16 bays of toshiba drives 7200 drives. I also have a 2tb nvme that can be used as cache. I am in need to make it work as fast as technically possible, handling write performance as high as possible, read...
www.truenas.com
because my case is extremely similar
the only difference Bigger
some video Formats uses TIFF files sizes from 10 MB the smaller to 75 MB the biggest ...... in a train of like 24 or 30 files per second
so you can guess 1 hour of video is 30 * 3600 *75 MB meaning 8 TB of data
that is a incredible humongous amount of files and data
and that is the bread & butter everyday
so we really need to write as fast as possible.... and read too.
we are evaluating 90 disk Storage server for HDD
SSG-640SP-E1CR90 | 4U | SuperServer | Products | Supermicro
4U top-loading storage server with 90 hot-swap 3.5" SAS/SATA bays and PCIe 4.0
www.supermicro.com
and 24 disk storage server for NVMe SSDs
AS -2124US-TNRP | 2U | SuperServer | Products | Supermicro
2U Ultra with 24 NVMe bays and dual 10GbE + dual 10G SFP+
www.supermicro.com
so with which storage I can get better write performance
or
where I can have a good Online ZFS Calculator
RAM I have plenty ( 1TB)
dual port 100 GBE NIC (Mellanox ConnectX-4 )
I would like not to sacrifice too much Space ( like mirror ) ....but if I have to, I will have to do it
any advices ?????
my main concerns is ...... too many big files on too fast NICs ..... meaning Very High CPU usage
unfortunatelly ....will have to pay to try .........
thanks in advance
Gustavo
