ndboost
Explorer
- Joined
- Mar 17, 2013
- Messages
- 78
Hey all I need some advice/info/thoughts/comments/gripes on moving my FreeNAS box to a bigger memory footprint...
so my current build is below:
My New Build
Time Limited Graphs - I just bounced the box because of a power outage so stats aren't more than a few days old unforunately.
My Thoughts
I have a spare DL380 G6 sitting here with 96GB of memory in it and dual xeon x5650? proc's, I possibly could even add another 48GB to it if needed making the total ram 144GB. With my arc hit ratio being at 40-50%, I began thinking about increasing the memory footprint of my NASs and realized I had this spare DL380 sitting here powered off, originally i was going to use it as a third esxi host but I have enough compute as it is. I know the recommendation is to add memory before adding ZIL or L2ARC, now I don't have any direct complaints about performance but I'm always trying to get more outta my setup.
So what are your thoughts? Should I swap over to the DL380 Or leave the NAS in place and be happy with what I got.
so my current build is below:
- NORCO RPC-4224 24 Bay 4U Rack Mount Case
- Super Micro X9SCM-F Motherboard
- 32GB DDR3 1333 Memory
- Intel(R) Xeon(R) CPU E3-1220 V2 @ 3.10GHz CPU
- 3x IBM M1015 in IT Mode
- Dual Port Intel 10G NIC - connected LACP to a 10G Switch
- 3x - 4xRZ1 (12 total SSDs) - Samsung 840/850 Pro 128GB SSDs - 700GB~ Thin Provisioned (280GB Actual Used) / 1.1TB Usable
- 24x - 2TB Hitachi Spinners (In a NetApp DS4243 DAS Shelf) - 25TB consumed / 36TB Usable
- Homelab but production use at home
- esxi 6.5, vmdk storage (ssd zpool) - 20 VMs mix of windows and linux, relatively low iops requirements, mostly just plex/sab/sonarr/radarr/deluge
- the esxi hosts and NAS are all connected via 10G DAC or fiber to a US-16-XG switch
- general media/backups/slower IOPs vmdk storage (although no VMDKs are provisioned on it yet) (DS4243)
- No plugins or jails, NAS is used strictly as AD connected storage
- AD/CIFS/AFP/FTP/SMB/ISCSI/NFSv3 Services Used
My New Build
- DL380 G6
- 96-144GB DDR3 ECC 1333 RAM
- 1 M1015 in IT Mode
- 1 Intel 10G NIC
- Use the 8 ports from the onboard PERC to build out a new SSD zpool of ~500GB SSDs in a 2x4 - RZ1
- Use the M1015 for the 24x - 2TB Hitachi Spinners (In a NetApp DS4243) - 25TB consumed /36TB Usable
- I will be getting another identical DS4243 in the near future and will daisy chain them together so my zpool03 storage will effectively double to 72TB
- I also have an HP SAS Expander sitting here that I could make use of instead just not sure how to mount it in the DL380 since it only has 1U and only two PCI-e slots
Time Limited Graphs - I just bounced the box because of a power outage so stats aren't more than a few days old unforunately.
My Thoughts
I have a spare DL380 G6 sitting here with 96GB of memory in it and dual xeon x5650? proc's, I possibly could even add another 48GB to it if needed making the total ram 144GB. With my arc hit ratio being at 40-50%, I began thinking about increasing the memory footprint of my NASs and realized I had this spare DL380 sitting here powered off, originally i was going to use it as a third esxi host but I have enough compute as it is. I know the recommendation is to add memory before adding ZIL or L2ARC, now I don't have any direct complaints about performance but I'm always trying to get more outta my setup.
So what are your thoughts? Should I swap over to the DL380 Or leave the NAS in place and be happy with what I got.