5mall5nail5
Dabbler
- Joined
- Apr 29, 2020
- Messages
- 14
Hey all - not new to FreeNAS or ZFS as a whole, but it's been a while. I have 3 large-ish ESXi hosts in my lab each with (2) E5-2680v2 CPUs and 384GB of RAM and various amounts of spindles and SSDs within on local hardware RAID controllers. My RAID controllers are no longer on the vSphere 7 HCL and so I am looking to go to a storage server and 2 ESXi hosts in my lab.
The FreeNAS server will be a 36-bay (3.5"), (2) E5-2680v2 CPUs, and 384GB of RAM. I have a LSI 9207-8i controller ready to go in. I plan on the following vdev/pools:
I haven't created an all-SSD pool yet, so I am not sure if there are any special options I should set during creation of the pool such as ashift or anything. And I haven't done much with zvols/iSCSI in ZFS/FreeNAS so is there any special considerations about block size or anything for VM storage (VMFS 6). I am going from hardware RAID with FastPath IO or whatever its called to shared storage, so I just want to make sure I see the same or similar performance on the flash tier. I am not opposed to putting the spinning disks and SSDs on separate 9207-8i controllers if need be - they are going to be on separate backplanes anyway.
I have built a ~832TB ZFS on Linux storage platform before but I was doing NFS datastores to vSphere and had Intel P3700 NVMe SSDs for SLOG, etc. I have a blog post on that build here: https://www.jonkensy.com/832-tb-zfs-on-linux-project-cheap-and-deep-part-1/
Do you think it's worth it to get an Optane-based SLOG device for my SATA spinning pool? If so which? Any general pointers on config? I have a FreeNAS 9.10 setup still running for another lab but it's all 7,200 RPM enterprise disks and I don't touch it, it just runs (obviously, at that patch level).
Thanks for any advice all!
The FreeNAS server will be a 36-bay (3.5"), (2) E5-2680v2 CPUs, and 384GB of RAM. I have a LSI 9207-8i controller ready to go in. I plan on the following vdev/pools:
- (16) SATA Samsung PM863 960GB SSDs - mirrors
- (10) SATA Intel S3710 400GB SSDs - mirrors
- (10) SATA 8TB 5400 RPMs - some configuration of spanned RAIDZ1 I think with a NVMe SLOG device - just need capacity for large data (media, logs..) mostly read IO here. I do some DVR to a VM so it might be good to have SOME write performance but nothing like the flash-tier. If I can add a SLOG
I haven't created an all-SSD pool yet, so I am not sure if there are any special options I should set during creation of the pool such as ashift or anything. And I haven't done much with zvols/iSCSI in ZFS/FreeNAS so is there any special considerations about block size or anything for VM storage (VMFS 6). I am going from hardware RAID with FastPath IO or whatever its called to shared storage, so I just want to make sure I see the same or similar performance on the flash tier. I am not opposed to putting the spinning disks and SSDs on separate 9207-8i controllers if need be - they are going to be on separate backplanes anyway.
I have built a ~832TB ZFS on Linux storage platform before but I was doing NFS datastores to vSphere and had Intel P3700 NVMe SSDs for SLOG, etc. I have a blog post on that build here: https://www.jonkensy.com/832-tb-zfs-on-linux-project-cheap-and-deep-part-1/
Do you think it's worth it to get an Optane-based SLOG device for my SATA spinning pool? If so which? Any general pointers on config? I have a FreeNAS 9.10 setup still running for another lab but it's all 7,200 RPM enterprise disks and I don't touch it, it just runs (obviously, at that patch level).
Thanks for any advice all!