Hello Everyone,
I just setup a 96TB-ish (usable) NAS for home storage and home-lab use. Here are the specs (i put the specs in my sig, but not sure if there is a policy for short sigs, and if so let me know and I'll remove it):
FreeNAS 9.3.1 Virtualized on ESXi 6.0
SuperMicro X9SRH-7TF (2x10GBase-T, LSI SAS2308--IT mode) Mobo
E5-1650v2 3.5ghz 6core Processor
64GB RAM (8x8gb DDR3 ECC Unbuffered)
2xM1015 (SAS2008) w/SAS9217-8i Firmware (IT)
22 x WD60EFRX 6TB WD Disks (96TB usable by using two 11 disk raidz3 vdevs)
2x120G SSDs (storage for VMs)
Norco RPC-4224
Corsair CS550M (550W) PSU
187W (idle)
410W (spinup)
It will be mainly used for:
I've physically built the box, installed ESXi & FreeNAS (32GB RAM assigned to FreeNAS), and created the main pool, plus a few datasets. I'm using two 120GB SSDs (I had them laying around) for VMs, including FreeNAS. I create a vmdk on each of the ESXi and FreeNAS is setup as mirrored. ESXi is booting off a USB. And ran a quick local benchmark of the pool and its writing at around 1.3GB/s. Next steps:
And a little about me: I'm a Systems Engineer/Administrator/DevOps (Insert other Buzzword 2.0 compliant moniker here) by trade, for about 20 years. Started off (first 6 years) on Solaris (2.6/2.7) mainly, and eventually went to Linux. So now I'm mainly a Linux guy. I've managed some thumper boxes off & on, but I'm relearning ZFS etc.
This is the first time setting up a discrete storage, for my home. Previously, I was just exporting shares from different HDs, and running VMs from my windows box on my home machine (i7-3930k six-core w/32gig ram & 20TB of storage with 8 3tb to 6tb drives). I've lost a few drives over the past couple of years. All that I've lost I didn't really care about (PVR'd tv shows, movie rips etc). But would be nice not to have to rip it again. Anything of importance, personal photos/videos, documents etc., is backed up to crashplan (which has saved my hide a few times).
Anyway, hopefully I'll be able to contribute, and maybe get answers here.
Thanks,
Imran
I just setup a 96TB-ish (usable) NAS for home storage and home-lab use. Here are the specs (i put the specs in my sig, but not sure if there is a policy for short sigs, and if so let me know and I'll remove it):
FreeNAS 9.3.1 Virtualized on ESXi 6.0
SuperMicro X9SRH-7TF (2x10GBase-T, LSI SAS2308--IT mode) Mobo
E5-1650v2 3.5ghz 6core Processor
64GB RAM (8x8gb DDR3 ECC Unbuffered)
2xM1015 (SAS2008) w/SAS9217-8i Firmware (IT)
22 x WD60EFRX 6TB WD Disks (96TB usable by using two 11 disk raidz3 vdevs)
2x120G SSDs (storage for VMs)
Norco RPC-4224
Corsair CS550M (550W) PSU
187W (idle)
410W (spinup)
It will be mainly used for:
- Shared storage for the 4 PCs (including kids computers) and couple of laptops (documents, video editing etc.)
- I usually do quite a bit of photography and 24megapixel dslr raws, gopro/camcorder storage etc. uses quite a bit of storage after maybe 5 to 10 heavy photo/video outtings
- Media serving to 3 TVs (Kodi on FireTV, HTPC, XBOX360)
- Running personal VMs for learning & experimenting/testing
- Eventually an Emulator game box (have some Raspberry Pi + v2 & other extra PCs laying around)
I've physically built the box, installed ESXi & FreeNAS (32GB RAM assigned to FreeNAS), and created the main pool, plus a few datasets. I'm using two 120GB SSDs (I had them laying around) for VMs, including FreeNAS. I create a vmdk on each of the ESXi and FreeNAS is setup as mirrored. ESXi is booting off a USB. And ran a quick local benchmark of the pool and its writing at around 1.3GB/s. Next steps:
- Figure out the CIFS shares/permissions -- more of what I want it do, rather than how to accomplish it--FreeNAS config seems fairly straightforward
- Setup sabnzb, sickbeard etc.
- Test the setup & copy my files over
- Migrate my desktop's crashplan config over
- Create some additional VMs (over iSCSI)
- Maybe tune the OS/FS
- I had some difficulty installing some additional packages under FreeBSD, so I need to figure that out; will clone the VM and play with package installer
- Eventually get a 10GBe card for my main desktop
And a little about me: I'm a Systems Engineer/Administrator/DevOps (Insert other Buzzword 2.0 compliant moniker here) by trade, for about 20 years. Started off (first 6 years) on Solaris (2.6/2.7) mainly, and eventually went to Linux. So now I'm mainly a Linux guy. I've managed some thumper boxes off & on, but I'm relearning ZFS etc.
This is the first time setting up a discrete storage, for my home. Previously, I was just exporting shares from different HDs, and running VMs from my windows box on my home machine (i7-3930k six-core w/32gig ram & 20TB of storage with 8 3tb to 6tb drives). I've lost a few drives over the past couple of years. All that I've lost I didn't really care about (PVR'd tv shows, movie rips etc). But would be nice not to have to rip it again. Anything of importance, personal photos/videos, documents etc., is backed up to crashplan (which has saved my hide a few times).
Anyway, hopefully I'll be able to contribute, and maybe get answers here.
Thanks,
Imran
Last edited: