Herr_Merlin
Patron
- Joined
- Oct 25, 2019
- Messages
- 200
Hi all,
we are running a freenas on an "old" HP Server for our VMWare cluster as "slow" storage in addition to our full flash FC SAN. But this slow storage is way to slow currently.
The hardware:
HP DL (number I need to look up) with 14x LFF slots
OS Version:FreeNAS-11.2-U6 (Build Date: Sep 17, 2019 0:16)
Processor:Intel(R) Xeon(R) CPU E5-2430L 0 @ 2.00GHz (24 cores)
Memory:192 GiB
We have 2 Expansion shelf attached via SAS and multipathed those.
We have dual 10G uplink running in failover.
25x1.8TB 10k SAS 12G
22x4TB 7.2k SAS 12G
2x 0.48TB SAS 12G SSD with PLP
1x 0.96TB SAS 12G SSD with PLP
1x 0.48TB SATA 6G SSD with PLP
currently we are running the following:
one volume consisting of 2x Z2 with 10x 4TB 7.2k each
This pool has 2x 0.48TB SAS 12G SSD in mirror as ZIL
and 1x 0.96TB SAS 12G SSD as L2ARC
plus 1x 4TB as hot spare
from this pool we getting in max 250MB/s write speed, which is freaking slow, even for long sequential writes. Usually it drops down to 120MB/s, which is single disk performance more or less.. on the read side it looks a bit brighter with up to 300MB/s..
how to improve?
the second volume consisting of 5x Z1 with 5x 1.8TB 10k each and a single 0.48TB SATA 6G SSD as ZIL
for this pool the performance is horrible. write at max at 90MB/s for sequential, which is less than half than a single disk would do..
I am looking for a way to get way more performance out of this machine. I can move the data temporary to the full flash FC SAN to reconfigure one pool after the other.
Goal would be to have a large( 40TB+), high redundant volume for backups and a smaller(20+ TB) with more speed but still good redundancy for some some VMs.
I am open to any suggestions.
We recyclend the 1.8TB SAS 12G drives from an HP MSA iSCSI SAN, this with its old AMD Athlon 2700 and 1GB of Memory was way faster than the then volume of those disk are right now with freenas.
CPU load peaks to about 50% in worst case.
Dedub is off for both
compression is on with lz4
sync writes enabled
we are running a freenas on an "old" HP Server for our VMWare cluster as "slow" storage in addition to our full flash FC SAN. But this slow storage is way to slow currently.
The hardware:
HP DL (number I need to look up) with 14x LFF slots
OS Version:FreeNAS-11.2-U6 (Build Date: Sep 17, 2019 0:16)
Processor:Intel(R) Xeon(R) CPU E5-2430L 0 @ 2.00GHz (24 cores)
Memory:192 GiB
We have 2 Expansion shelf attached via SAS and multipathed those.
We have dual 10G uplink running in failover.
25x1.8TB 10k SAS 12G
22x4TB 7.2k SAS 12G
2x 0.48TB SAS 12G SSD with PLP
1x 0.96TB SAS 12G SSD with PLP
1x 0.48TB SATA 6G SSD with PLP
currently we are running the following:
one volume consisting of 2x Z2 with 10x 4TB 7.2k each
This pool has 2x 0.48TB SAS 12G SSD in mirror as ZIL
and 1x 0.96TB SAS 12G SSD as L2ARC
plus 1x 4TB as hot spare
from this pool we getting in max 250MB/s write speed, which is freaking slow, even for long sequential writes. Usually it drops down to 120MB/s, which is single disk performance more or less.. on the read side it looks a bit brighter with up to 300MB/s..
how to improve?
the second volume consisting of 5x Z1 with 5x 1.8TB 10k each and a single 0.48TB SATA 6G SSD as ZIL
for this pool the performance is horrible. write at max at 90MB/s for sequential, which is less than half than a single disk would do..
I am looking for a way to get way more performance out of this machine. I can move the data temporary to the full flash FC SAN to reconfigure one pool after the other.
Goal would be to have a large( 40TB+), high redundant volume for backups and a smaller(20+ TB) with more speed but still good redundancy for some some VMs.
I am open to any suggestions.
We recyclend the 1.8TB SAS 12G drives from an HP MSA iSCSI SAN, this with its old AMD Athlon 2700 and 1GB of Memory was way faster than the then volume of those disk are right now with freenas.
CPU load peaks to about 50% in worst case.
Dedub is off for both
compression is on with lz4
sync writes enabled