Hello,
I'm starting my adventure (actually more of a science) with NAS as a result I have a few questions, but before I start I'll introduce the HW (maybe it will be useful?):
MB: Asrock Z690 Extreme (2 NICs: 1G Intel I219V, 2.5G Realtek Dragon RTL8125BG)
CPU: Intel i5-13600K (14 cores - 20 threads, iGPU)
FAN: NH-D15
RAM: Corsair Vengeance LPX 64GB DDR4-3200 (I know - not ECC, but more on that later)
PSU: Seasonic Prime Ultra 750 W Titanium
CASE: Cooler Master HAF XB Evo Cube
and now a brief explanation of why only PC HW - once I know exactly what I need then I will buy the appropriate server-class components. I know that ZFS requires ECC RAM, but this is a "test environment" that will go to PC after my longer education.
On the software side, currently there is only TrueNAS, but eventually there is to be PROXMOX and under it TrueNAS, OPNsense and about 3 VMs. Also including (either in VMs or as plug-ins) PLEX (Audio only lossless Hi-Res: FLAC, DSF, DFF, etc. Video up to 4K 60FPS with DTS, DD, ATMOS audio), NextCloud (up to 6-8 devices), OpenVPN, AdGuard, SMB, NFS, etc...). Overall 1 "heavy" user and up to 4 "light" users.
And finally getting to the point: currently I can put 3x NVMe and 6-8x SATA into this MB, which I would like to move to the target NAS later. And here are my questions:
How to arrange these 3 NVMe most optimally?
Example:
1st m.2 (512GB?) for the system (currently under TrueNAS, but later PROXMOX):
- I have heard that both take up all the capacity and it is impossible to use the remaining space, right?
- how much should be the IOPS and TBW?
2nd m.2 (2TB?) for VM (TrueNAS, OPNsense and up to 2-3 Linux/Windows/others)
3rd m2 (2TB?) (???)
Here I would see Solidigm P44 Pro 512GB (TBW 0.5PB, good IOPS, DDR4 cache, good perf/power ratio, 256bit AES, 5 year warranty) and Seagate FireCuda 530 SSD (TBW 2.55PB and the rest like P44 Pro).
6x SATA - here I am considering 3 options:
A) 6x SSD like Crucial MX500 4TB or Samsung SSD 870 QVO 4TB.
B) 6x HDD of the likes of Toshiba Enterprise MG08ACA 12-16TB or Seagate Exos X - X18 12-16TB
C) 6x HDD 8TB + 2 SSD 4TB (???).
For A and B is it best to use RAID-Z2?
I know there is a big capacity spread (RAW: 24TB vs 72-96TB), but <> equal cost.
Based on current data, there would be up to 100GB of data to write in a peak per day - often much less (up to 30GB) with most of it to overwrite anyway. Generally much more data would be readable.
What if option A and the disks fill up?
What are your suggestions in both of these cases (NVMe and SATA) and why?
I'm starting my adventure (actually more of a science) with NAS as a result I have a few questions, but before I start I'll introduce the HW (maybe it will be useful?):
MB: Asrock Z690 Extreme (2 NICs: 1G Intel I219V, 2.5G Realtek Dragon RTL8125BG)
CPU: Intel i5-13600K (14 cores - 20 threads, iGPU)
FAN: NH-D15
RAM: Corsair Vengeance LPX 64GB DDR4-3200 (I know - not ECC, but more on that later)
PSU: Seasonic Prime Ultra 750 W Titanium
CASE: Cooler Master HAF XB Evo Cube
and now a brief explanation of why only PC HW - once I know exactly what I need then I will buy the appropriate server-class components. I know that ZFS requires ECC RAM, but this is a "test environment" that will go to PC after my longer education.
On the software side, currently there is only TrueNAS, but eventually there is to be PROXMOX and under it TrueNAS, OPNsense and about 3 VMs. Also including (either in VMs or as plug-ins) PLEX (Audio only lossless Hi-Res: FLAC, DSF, DFF, etc. Video up to 4K 60FPS with DTS, DD, ATMOS audio), NextCloud (up to 6-8 devices), OpenVPN, AdGuard, SMB, NFS, etc...). Overall 1 "heavy" user and up to 4 "light" users.
And finally getting to the point: currently I can put 3x NVMe and 6-8x SATA into this MB, which I would like to move to the target NAS later. And here are my questions:
How to arrange these 3 NVMe most optimally?
Example:
1st m.2 (512GB?) for the system (currently under TrueNAS, but later PROXMOX):
- I have heard that both take up all the capacity and it is impossible to use the remaining space, right?
- how much should be the IOPS and TBW?
2nd m.2 (2TB?) for VM (TrueNAS, OPNsense and up to 2-3 Linux/Windows/others)
3rd m2 (2TB?) (???)
Here I would see Solidigm P44 Pro 512GB (TBW 0.5PB, good IOPS, DDR4 cache, good perf/power ratio, 256bit AES, 5 year warranty) and Seagate FireCuda 530 SSD (TBW 2.55PB and the rest like P44 Pro).
6x SATA - here I am considering 3 options:
A) 6x SSD like Crucial MX500 4TB or Samsung SSD 870 QVO 4TB.
B) 6x HDD of the likes of Toshiba Enterprise MG08ACA 12-16TB or Seagate Exos X - X18 12-16TB
C) 6x HDD 8TB + 2 SSD 4TB (???).
For A and B is it best to use RAID-Z2?
I know there is a big capacity spread (RAW: 24TB vs 72-96TB), but <> equal cost.
Based on current data, there would be up to 100GB of data to write in a peak per day - often much less (up to 30GB) with most of it to overwrite anyway. Generally much more data would be readable.
What if option A and the disks fill up?
What are your suggestions in both of these cases (NVMe and SATA) and why?