System:
FreeNAS-8.0.4-RELEASE-p1-x64 (11059)
Supermicro X8DT3 LN4F
2 x Intel(R) Xeon(R) CPU E5645 @ 2.40GHz
24 GB Ram
6 x WD500 RE4
RaidZ2
Hi,
i have 2 ESXi hosts (iscsi->Freenas) that are connected over dual 1Gb/s using MPIO Round Robing to a HP1910 Switch.
The Freenas box is connected with 3 x 1Gb/s to the same Switch.
Freenas
igb0 192.168.17.1
igb2 192.168.18.1
igb3 192.168.19.1
ESX_0
vmnic0 192.168.17.10
vmnic3 192.168.18.10
ESX_1
vmnic0 192.168.17.11
vmnic3 192.168.19.11
dd if=/dev/zero of=testfile bs=4M count=10k on the freenas box gives me about 230 MB per second. Playing around with block size, etc. gives the same performance 210 - 230 MB/sec.
Read with dd same file about 210MB
So, to my problems - I have multiple ones :) .
1. Bandwith
To simplify things i've booted up 1 Esx host with one VM. In this VM i copy 1GB File. Systat on freenas tells me that trafic is incomming on 2 Interfaces, as expected. On esx i see in esxtop that he is sending over both vmnics as expected.
But i can't get past 60-62 MB throughput. First time i copy i see he fetches data from Nas and writes it back so the sum of in and out traffic on each interaface is about 60MB. See screenshot upload.
Repeating it - File is cached and only the in line gets penetrated, but the sum is again about 60MB. See screenshot upload.
Copying a 2GB File inside a Windows XP VM gives 1st Time 6.5MB and repeating 20.3MB
2. Read Performance
when i boot up a VM or load a file etc. that doesn't hit the freenas cache i get read speeds between 1MB and 5MB. The read speeds are like a "4K random test".
Could this be a fragmentation problem? zpool list says:
NAME SIZE USED AVAIL CAP HEALTH ALTROOT
XXXX 2.70T 859G 1.86T 31% ONLINE /mnt
But the volumes are quite full:
Volume1 used over 90%
Volume2 used over 80%
So, any hints, explanations, things i should test?
Best regards and thanks
Tobias
FreeNAS-8.0.4-RELEASE-p1-x64 (11059)
Supermicro X8DT3 LN4F
2 x Intel(R) Xeon(R) CPU E5645 @ 2.40GHz
24 GB Ram
6 x WD500 RE4
RaidZ2
Hi,
i have 2 ESXi hosts (iscsi->Freenas) that are connected over dual 1Gb/s using MPIO Round Robing to a HP1910 Switch.
The Freenas box is connected with 3 x 1Gb/s to the same Switch.
Freenas
igb0 192.168.17.1
igb2 192.168.18.1
igb3 192.168.19.1
ESX_0
vmnic0 192.168.17.10
vmnic3 192.168.18.10
ESX_1
vmnic0 192.168.17.11
vmnic3 192.168.19.11
dd if=/dev/zero of=testfile bs=4M count=10k on the freenas box gives me about 230 MB per second. Playing around with block size, etc. gives the same performance 210 - 230 MB/sec.
Read with dd same file about 210MB
So, to my problems - I have multiple ones :) .
1. Bandwith
To simplify things i've booted up 1 Esx host with one VM. In this VM i copy 1GB File. Systat on freenas tells me that trafic is incomming on 2 Interfaces, as expected. On esx i see in esxtop that he is sending over both vmnics as expected.
But i can't get past 60-62 MB throughput. First time i copy i see he fetches data from Nas and writes it back so the sum of in and out traffic on each interaface is about 60MB. See screenshot upload.
Repeating it - File is cached and only the in line gets penetrated, but the sum is again about 60MB. See screenshot upload.
Copying a 2GB File inside a Windows XP VM gives 1st Time 6.5MB and repeating 20.3MB
2. Read Performance
when i boot up a VM or load a file etc. that doesn't hit the freenas cache i get read speeds between 1MB and 5MB. The read speeds are like a "4K random test".
Could this be a fragmentation problem? zpool list says:
NAME SIZE USED AVAIL CAP HEALTH ALTROOT
XXXX 2.70T 859G 1.86T 31% ONLINE /mnt
But the volumes are quite full:
Volume1 used over 90%
Volume2 used over 80%
So, any hints, explanations, things i should test?
Best regards and thanks
Tobias
Attachments
Last edited:
