Chris Tobey
Contributor
- Joined
- Feb 11, 2014
- Messages
- 114
Hi everyone,
I'm trying to read as much as I can with every spare moment, so be gentle.
Here is my problem: I set up FreeNAS 9.1 on top of a vSphere server a few months ago and the work arounds to get it all going were a pain. We weren't seeing great performance but everything I can find says that ZFS + NFS + EXSi = bad. Now that we have the NAS we are highly dependent on it (as can be expected), but I gave up and went down over the weekend to get rid of the hypervisor. Now I am left with a straight up NAS but we aren't seeing the NFS performance we were hoping for. I also updated to FreeNAS 9.2.1 while I was at it. Our biggest usage for the NAS is to host Jenkins (Continuous Integration) data for our projects. This involves a lot of SVN checkouts which is where our main concern is. On an SVN checkout that takes 5 minutes on local disk, it's usually 15 minutes on the NAS, but can vary up to 2 hours (this makes me sad). Everything is live right now but I can go down for a short period if needed.
What I want: To optimize my configuration based on the hardware I am using to get the best possible speeds for NFS.
Hardware:
First, I know this is overkill. It was intended to host the VM server but that just made things complicated.
1 x SuperMicro 4RU Chassis - SC848A-R1K62B
4 x AMD Opteron(tm) Processor 6284 SE (for a total of 64 cores @ 2.7GHz)
256 GB DDR3 ECC RAM @ 1333MHz
1 x Adaptec RAID 72405 (24 SAS support)
6 x 4TB SAS HDD - Seagate Constellation ES.3 ST4000NM0023
1 x 120GB SSD - Samsung SM843T
I have the basics set up with NFS and CIFS enabled and working, the only problem is speed. ZFS was setup in RAIDZ-1 because I only had 5 drives at the time, as far as I am aware I can't migrate to a RAIDZ2 even though I have a sixth now, so it's sitting there as a spare.
Any ideas on settings I can try?
Any commands I can run to help understand my setup better?
I'm trying to read as much as I can with every spare moment, so be gentle.
Here is my problem: I set up FreeNAS 9.1 on top of a vSphere server a few months ago and the work arounds to get it all going were a pain. We weren't seeing great performance but everything I can find says that ZFS + NFS + EXSi = bad. Now that we have the NAS we are highly dependent on it (as can be expected), but I gave up and went down over the weekend to get rid of the hypervisor. Now I am left with a straight up NAS but we aren't seeing the NFS performance we were hoping for. I also updated to FreeNAS 9.2.1 while I was at it. Our biggest usage for the NAS is to host Jenkins (Continuous Integration) data for our projects. This involves a lot of SVN checkouts which is where our main concern is. On an SVN checkout that takes 5 minutes on local disk, it's usually 15 minutes on the NAS, but can vary up to 2 hours (this makes me sad). Everything is live right now but I can go down for a short period if needed.
What I want: To optimize my configuration based on the hardware I am using to get the best possible speeds for NFS.
Hardware:
First, I know this is overkill. It was intended to host the VM server but that just made things complicated.
1 x SuperMicro 4RU Chassis - SC848A-R1K62B
4 x AMD Opteron(tm) Processor 6284 SE (for a total of 64 cores @ 2.7GHz)
256 GB DDR3 ECC RAM @ 1333MHz
1 x Adaptec RAID 72405 (24 SAS support)
6 x 4TB SAS HDD - Seagate Constellation ES.3 ST4000NM0023
1 x 120GB SSD - Samsung SM843T
I have the basics set up with NFS and CIFS enabled and working, the only problem is speed. ZFS was setup in RAIDZ-1 because I only had 5 drives at the time, as far as I am aware I can't migrate to a RAIDZ2 even though I have a sixth now, so it's sitting there as a spare.
Code:
FreeNAS 9.2.1 pool: SG1 state: ONLINE scan: scrub repaired 0 in 10h56m with 0 errors on Tue Feb 11 01:43:07 2014 config: NAME STATE READ WRITE CKSUM SG1 ONLINE 0 0 0 raidz1-0 ONLINE 0 0 0 gptid/87cd9f83-560a-11e3-a185-000c29e0733d ONLINE 0 0 0 gptid/884c73c9-560a-11e3-a185-000c29e0733d ONLINE 0 0 0 gptid/88ca162e-560a-11e3-a185-000c29e0733d ONLINE 0 0 0 gptid/8947f033-560a-11e3-a185-000c29e0733d ONLINE 0 0 0 gptid/dadf2c63-5866-11e3-b40f-000c29e0733d ONLINE 0 0 0 spares gptid/9dab55e6-6674-11e3-b84a-000c29e0733d AVAIL
Any ideas on settings I can try?
Any commands I can run to help understand my setup better?