David E
Contributor
- Joined
- Nov 1, 2013
- Messages
- 119
Hi all-
System Specs:
Xeon E3-1240v2, 32GB RAM, m1015 (9211 IT mode), 6xSeagate NAS 3TB drives
ESXi 5.5, FreeNAS 9.1.1 in a VM with 16GB of RAM, encrypted 2xraidz
I've been doing some testing over NFS with a new Haswell MBP. I've mounted it with wsize/rsize = 1MB, and on the ZFS side set sync to disabled. I've also enabled 9k jumbo frames everywhere.
From my MBP I can issue a dd to the mounted NFS: dd if=/dev/zero of=tmp.dat bs=2048k count=5k, and cap out at ~70MB/s. If I add a second stream (from the same machine) I can get a combined total of around 120MB/s (2x60). I also checked iperf in to the machine and it can achieve 1Gb/s no problem.
So the main question, why is a single stream only able to get 70MB/s? I would expect it to max out the bandwidth at 120MB/s. Is there something I need to tweak to enable this? Is anyone else able to get a single 120MB/s write stream over NFS on 1Gbe?
Thanks!
System Specs:
Xeon E3-1240v2, 32GB RAM, m1015 (9211 IT mode), 6xSeagate NAS 3TB drives
ESXi 5.5, FreeNAS 9.1.1 in a VM with 16GB of RAM, encrypted 2xraidz
I've been doing some testing over NFS with a new Haswell MBP. I've mounted it with wsize/rsize = 1MB, and on the ZFS side set sync to disabled. I've also enabled 9k jumbo frames everywhere.
From my MBP I can issue a dd to the mounted NFS: dd if=/dev/zero of=tmp.dat bs=2048k count=5k, and cap out at ~70MB/s. If I add a second stream (from the same machine) I can get a combined total of around 120MB/s (2x60). I also checked iperf in to the machine and it can achieve 1Gb/s no problem.
So the main question, why is a single stream only able to get 70MB/s? I would expect it to max out the bandwidth at 120MB/s. Is there something I need to tweak to enable this? Is anyone else able to get a single 120MB/s write stream over NFS on 1Gbe?
Thanks!