Hi, I am building a NAS for the business I work for. We want to have a volume close to 100TB.
The initial use will be to store 20TB of files and it will slowly fill from there. Performance is not that important.
The hardware is already purchased:
- 15 x Seagate ST8000NE0001 8TB SATA 6GB/S ; 8*15=120TB raw disk space.
- ASRock X99 Extreme 11 Motherboard Intel I7
- Intel Core I7-5820K 3.30GHZ (3.6GHZ Turbo Mode) Six Core 15MB Hyperthreading LGA2011-V3 Processor
- 4 x Corsair Vengeance Lpx 16GB 2X8GB DDR4 3200MHZ C16 1.35V Memory Kit
network cards: integrated on motherboard.
I'd like to use Freenas with this hardware if at all possible, even if the RAM totals 64GB which is below the 8GB + 1GB per TB rule. (the RAM is also non-ECC but I decided non-ECC is acceptable for me given the RAM passed a memory test).
So I am testing at the moment if Freenas works with this amount of memory. The issue I'm running into is:
1) created a raidz2 volume using all 15 of the 8TB disks, resulting in 94.5TB as per the setup dialog and
2) created a dataset on it (87TB is available on it initially)
3) shared the dataset via NFS
4) mounted that NFS share from another server and started rsync to copy files to the new dataset.
After around 4 hours about 50GB are written (that speed is fine, it's only the initial population of the filesystem) but the memory is basically fully used, mostly by the ARC cache and I have the impression rsync slows down at that same time. The top command shows that only a few MB are free now. Is that a problem? I rebooted the box (which took a long time shutting down) and when it came back it had 61GB free. Resuming rsync is causing ARC to consume RAM again however (df -h shows 80G is used now, and ARC is using 31GB again) . Is this high ARC RAM usage a problem?
I am still in the testing process but I wanted to know the chances of getting Freenas to work with this hardware. What settings a worth adjusting? I can't change the hardware at this stage. Would you recommend to use OpenMediaVault since it doesn't need as much RAM?
Any advice is much appreciated,
Madtsoia
The initial use will be to store 20TB of files and it will slowly fill from there. Performance is not that important.
The hardware is already purchased:
- 15 x Seagate ST8000NE0001 8TB SATA 6GB/S ; 8*15=120TB raw disk space.
- ASRock X99 Extreme 11 Motherboard Intel I7
- Intel Core I7-5820K 3.30GHZ (3.6GHZ Turbo Mode) Six Core 15MB Hyperthreading LGA2011-V3 Processor
- 4 x Corsair Vengeance Lpx 16GB 2X8GB DDR4 3200MHZ C16 1.35V Memory Kit
network cards: integrated on motherboard.
I'd like to use Freenas with this hardware if at all possible, even if the RAM totals 64GB which is below the 8GB + 1GB per TB rule. (the RAM is also non-ECC but I decided non-ECC is acceptable for me given the RAM passed a memory test).
So I am testing at the moment if Freenas works with this amount of memory. The issue I'm running into is:
1) created a raidz2 volume using all 15 of the 8TB disks, resulting in 94.5TB as per the setup dialog and
2) created a dataset on it (87TB is available on it initially)
3) shared the dataset via NFS
4) mounted that NFS share from another server and started rsync to copy files to the new dataset.
After around 4 hours about 50GB are written (that speed is fine, it's only the initial population of the filesystem) but the memory is basically fully used, mostly by the ARC cache and I have the impression rsync slows down at that same time. The top command shows that only a few MB are free now. Is that a problem? I rebooted the box (which took a long time shutting down) and when it came back it had 61GB free. Resuming rsync is causing ARC to consume RAM again however (df -h shows 80G is used now, and ARC is using 31GB again) . Is this high ARC RAM usage a problem?
I am still in the testing process but I wanted to know the chances of getting Freenas to work with this hardware. What settings a worth adjusting? I can't change the hardware at this stage. Would you recommend to use OpenMediaVault since it doesn't need as much RAM?
Any advice is much appreciated,
Madtsoia