FreeNAS NVMe Build

Geek Baba

Explorer
Joined
Sep 2, 2011
Messages
73
I am building a NVMe SSD NAS for XCP-ng (open source alternative of Citrix Xen), it will be connected to each host directly via fiber (no switch), I already use a similar setup but with SATA SSD. I have been reading about NVMe support and mixed reviews and responses. I am listing the spec of my buildout and would like to see if anyone have some advice to optimize this build.
  1. SuperServer 2028U-TN24R4T+
  2. SuperMicro X10DRU-i+
  3. 2 x Intel Xeon E5-2620 v3
  4. 384GB (24 x 16GB) 2RX4 PC4-2133P DDR4 MEMORY
  5. 24 x Intel DC P3600 SSD 800GB NVMe PCIe 3.0
This will be connected via fiber to each XCP-ng hosts serving as iSCSI target which will have all the VM's. I am wondering if out of the box install will be good enough or should consider adding ZFS ZIL and SLOG, and any other considerations...
 
Last edited:

Geek Baba

Explorer
Joined
Sep 2, 2011
Messages
73
@markmuehlbauer it went almost well, except only 16 drives are usable and rest start to throw errors, I was hoping with the new 11.3, that would be fixed but it did not.
 

Geek Baba

Explorer
Joined
Sep 2, 2011
Messages
73

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,702
How many PCIe lanes do your processor and MB support? (NVME devices need 2 or 4 lanes each).
 
Top