Brezlord
Contributor
- Joined
- Jan 7, 2017
- Messages
- 189
Hi all I'm looking for any tips for improving performance of NFS as VM backing for XCP-ng 8.1.0. I feel that my setup should be much faster. I was previously running vmware over fibre channel which was lightning fast. Below are the specs of the hardware I'm using.
Storage
Version:
TrueNAS-12.0-RC1
Hardware:
Dell PowerEdge T320
Intel Xeon E5-2470 v2 10 cores @ 2.40GHz
96GB DDR3 PC3L 1333MHz (6 x 16GB DIMMs)
1 x Intel X520-DA2 10GbE (Various vLANs for Management and network shares)
1 x Dell PERC H310 flashed to IT mode (LSI SAS9211-8i HBA)
1 x Dell H200 HBA flashed to IT
2 x EMC KTN-STL3 DAE 15 x 3.5" enclosure
Storage Pool 3: VM storage
12 x HGST HUSML4040ASS600 400GB SAS SSD (6 x 2 way mirror)
log 1 x Intel Optane 900p 280GB SLOG
XCP-ng Server
XCP-ng 8.1.0
Dell PowerEdge R720
2 x Intel Xeon CPU E5-2660 v2 10 cores @ 2.20GHz
128GB DDR3 PC3 1866MHz (8 x 16GB DIMMs)
1 x Intel X520-DA2 10GbE (Various vLANs for VM Traffic, Management and IP Storage)
Switch
Ubiquity EdgeSwitch 16 XG
I know the following tests are not the best but they do give indication of performance.
I ran the following on a test data set on the pool that holds the VMs.
Running the same command in a CentOS 7 VM with guest tools installed i get;
815 MB/s for 2G
695 MB/s for 4G
Using iperf I get the following.
VM --> TrueNAS 870 MBytes 7.29 Gbits/sec
TrueNAS --> VM 569 MBytes 4.77 Gbits/sec
Windows VM
Does anyone have any ideas on tuning TrueNAS network stack. I have the 2 10G ports in LACP but NFS can only use 1 connection so I doubt network topology will be the issue. When will pNFS be coming to TrueNAS Core?
Storage
Version:
TrueNAS-12.0-RC1
Hardware:
Dell PowerEdge T320
Intel Xeon E5-2470 v2 10 cores @ 2.40GHz
96GB DDR3 PC3L 1333MHz (6 x 16GB DIMMs)
1 x Intel X520-DA2 10GbE (Various vLANs for Management and network shares)
1 x Dell PERC H310 flashed to IT mode (LSI SAS9211-8i HBA)
1 x Dell H200 HBA flashed to IT
2 x EMC KTN-STL3 DAE 15 x 3.5" enclosure
Storage Pool 3: VM storage
12 x HGST HUSML4040ASS600 400GB SAS SSD (6 x 2 way mirror)
log 1 x Intel Optane 900p 280GB SLOG
XCP-ng Server
XCP-ng 8.1.0
Dell PowerEdge R720
2 x Intel Xeon CPU E5-2660 v2 10 cores @ 2.20GHz
128GB DDR3 PC3 1866MHz (8 x 16GB DIMMs)
1 x Intel X520-DA2 10GbE (Various vLANs for VM Traffic, Management and IP Storage)
Switch
Ubiquity EdgeSwitch 16 XG
I know the following tests are not the best but they do give indication of performance.
I ran the following on a test data set on the pool that holds the VMs.
time sh -c "dd if=/dev/zero of=testfile bs=1900K count=1K && sync"
. I get 1327.733912 MB/s, which is good.Running the same command in a CentOS 7 VM with guest tools installed i get;
815 MB/s for 2G
695 MB/s for 4G
Using iperf I get the following.
VM --> TrueNAS 870 MBytes 7.29 Gbits/sec
TrueNAS --> VM 569 MBytes 4.77 Gbits/sec
Windows VM
Does anyone have any ideas on tuning TrueNAS network stack. I have the 2 10G ports in LACP but NFS can only use 1 connection so I doubt network topology will be the issue. When will pNFS be coming to TrueNAS Core?
Last edited: