Slow cifs. atune,iperf,dd,tried multiple machines

[aznegg]

Hi,
Ive been lurking the forums for the past week trying to get a grasp on freenas, and what might be causing my problem. As per cyberjocks constant repetition of intel nic + no user paramaters will usually give better performance, I have ensured that both my nas nic and my computer nic are intel.

Specs:

Server: Freenas 9.2
Cpu: i5-4570 CPU
Mobo: ASUS H87I-PLUS (newest firmware)
Onboard GLan : Intel® I217
Ram: 16gb
HDD: 4x 3tb wd reds
USB: 8gb kingston data traveler


Modem: R7000 Nighthawk by netgear
Gigabyte lan (got this specifically because its listed as a gigabyte lan)


Comp.

CPU: 2700k
Mobo: asus P8Z68-V PRO
Onboard lan: Intel® 82579

However i am using wireless...
Asus PCE-AC68 Dual-band PCIE adapter (it reads 1100Mbps)



The problem i am having is extremely slow transfer speeds. When I move anything to the server the transfer speed remains between 12-19 MB/s (i have tried using 3 other computers, the result appears to be in that range) (first I tried with zfs, then realized that was a ticking time bomb without ecc, so moved onto ufs) I have tried both ftp and cifs, both offered similar performance.

Atune is on

vfs.zfs.arc_max -- 10517225563
vm.kmem_size – 11685806182
vm.kmem_size_max – 14607257728

No sysctls yet



Test:

Code:

[root@freenas /mnt/drive]# dd if=/dev/random of=./tempfile bs=4096 count=262144
262144+0 records in
262144+0 records out
1073741824 bytes transferred in 12.760222 secs (84147582 bytes/sec)

Read : http://forums.freenas.org/threads/cifs-slow-with-windows-7-sharing.13001/ and performed everything from post #3



Ssd -> Nas same speed as hdd-> nas

iperf

If you want me to try a different DD test file (bigger, smaller, buffer size change) please let me know and ill post the results. Unfortunately after reading so many of the problems, 7/10 times its a cable or a non-intel nic. Ive tried changing the Ethernet cable and both nics are intel...

 

[cyberjock]

Ok, few things:

Autotune hurts performance unless you have lots of RAM(128GB+). So disable that. Also, you'll need to manually delete the tunables that were added.

If you are going over wireless, expect performance to SUCK. That's the reality of wireless. I'm fuzzy on if your tests are over wireless or not.

What is your pool's configuration? That dd test shows you're never likely to go over 60MB/sec or so over your LAN because of your pool's performance, so we need to see if that's expected or not.

You *should* be using ECC, but that's not a performance problem. That's a "lose your data if things go bad" problem.

 

[aznegg]

Thanks for the quick reply. Real world transfer tests have been performed between the nas and 2 separate wired devices (laptop and a computer), a third computer with a 500mbits posed adapter And lastly an ac wireless (connection between 1100 and 1300 mbits)

http://www.newegg.com/Product/Product.aspx?Item=N82E16833320173

Currently have a raid3 pool with 3 WD 3tb reds, second volume is a stripped single drive, I'm going to post more tests from the different machines and the second volume tomorrow.

Is there any way my router could be the problem?

Again Ty for any insight you Or anyone else on this forum can offer.

 

[aznegg]

Tunables have been deleted.

IF config

Wired connection #1 (9' cat 5)

Wired connection #2 (about a 80' cat 5)

High speed wireless cable

currently unable to get to the powerline adapter. not sure what else i can do to test this.

Side note: is windows 8 better than windows 7 for this kind of stuff? would upgrading help the situation?

thanks!!

 

[cyberjock]

One thing you did was use /dev/random for your test. That alone invalidates your test results.. try this instead:

dd if=/dev/zero of=./tempfile bs=4k count=1000k

Also you may have to reboot for the tunables to no longer apply to the system.

 

[aznegg]

Test on raid 3 volume windows cif

Code:

[root@freenas /mnt/drive]# dd if=/dev/zero of=./tempfile bs=4k count=1000k
1024000+0 records in                                                     
1024000+0 records out                                                   
4194304000 bytes transferred in 16.405418 secs (255665782 bytes/sec)

Test on Strip single drive windows cif

Code:

[root@freenas /mnt/Test]# dd if=/dev/zero of=./tempfile bs=4k count=1000k 
1024000+0 records in                                                       
1024000+0 records out                                                     
4194304000 bytes transferred in 28.591567 secs (146697241 bytes/sec)    

iperf test to strip drive

 

[cyberjock]

See, that dd test is 255MB, sec. That pretty much validates that your pool can perform at far more than 1Gb speeds. So your limitation is certainly your network.

 

[cyberjock]

Ug.. you edited your post and added details...

So your first test looks like its capped at 100Mb.. so you need to figure out where your limit was there.

Your test #2 is a mess. Not sure what is going on there. You should go check your cabling and network switches to see what is up. Something is wrong there.

#3 is pointless. Wireless can vary widely from second to second and there's no point in even doing tests over wireless.

Powerline adapters just suck. Almost as bad as wireless, but usually somewhat vaster than wireless.

In short, if you are using powerlines or wireless(anything except rj-45 cat5 or cat6 cabling) between any 2 points expect to artifically bottleneck yourself and have disappointing speeds.

 

[cyberjock]

And updating to Windows 8 isn't going to help you. I'm using Windows 7 and I can do 110MB/sec+ every time.

 

[aznegg]

damn... so all the hype about AC wireless being same or faster than a gigabyte lan are false??? when i look at my hardware monitor my network capacity isnt even 20%.... im so confused ...

my connection speed says 1100-1300 Mbit thats at or above gigabyte lan if im not mistaken?

am i missing something?

thanks again jock for the quick replies.

 

[cyberjock]

Hell yeah. That is theoretical "best case" scenario in a lab where all conditions are controlled. Reality is MUCH worse than that.

 

[no_connection]

Any real speed would be unlikely.
The top performing in their chart is 125.9Mbps:
http://www.smallnetbuilder.com/lanwan/powerline-charts/view

 

[aznegg]

well hell maybe i should take back the $300 piece of shit wireless modem + wireless card and save 200 bucks and pick up that 125Mbps.... id transfer at same speed but save 200 bucks ..... .... damnitall

 

[no_connection]

What performance do you actually get with your AC adapter?
What adapter do you have?

Read around on the site I linked as they have some useful info in using powerline adapters.

 

[aznegg]

What performance do you actually get with your AC adapter?
What adapter do you have?

Read around on the site I linked as they have some useful info in using powerline adapters.

I have the asus PCE-AC68 wireless adapte for ac1300 capability

http://www.hardwarecanucks.com/foru...asus-rt-ac68u-pce-ac68-802-11ac-review-9.html


the wireless router i use is the R7000 netgear Nighthawk

http://www.smallnetbuilder.com/wire...st-look-netgear-r7000-a-asus-rt-ac68u?start=1


Going strictly off the data above, (i have -25 to -35 dba signal strength) i should be able to achieve between 30 - 40 MBytes/s transfer speed.... i dont understand why im losing 30-50%

Ive come to the realization that 80+ is just not going to happen without wired connection. But hell it takes a day to transfer 300gigs... its rediculous... im not even sure if i can stream my bluray backups at that speed...

 

[aznegg]

so by dumb luck i found out today that i can have 3 simultaneous transfers to the same drive / folder, and the total of the 3 is about 38MB/s .... wtf? 20.2MB/s + 10.8 MB/s + 7 MB/s ..... why would this happen?

 

[drini]

Hello, were you able to figure out the issue you were having? I'm having same issue but my is varied, it sticks right at 11.3 mb/s

 

[cyberjock]

Hello, were you able to figure out the issue you were having? I'm having same issue but my is varied, it sticks right at 11.3 mb/s

Money says someone is using 100Mb LAN somewhere......

 

[drini]

You are very quick on the responses. I have 2 other NAS (LG N2A2DD2 and a Seagate STCG2000100) and I have been able to transfer to both at 45-50mb/s all running off the same switch. I'm using the FreeNAS as a media server but taking hours upon hours to put my videos on the hard drive using CIFS. My switch is a ASUS GX-D1081 and my router is a TP-Link 300M Wireless N Gigabit router. So all my connections are Gigabit but only getting 11.3 mb/s. I've done countless searches but I have not been able to find anything to help my situation.

300M Wireless N Gigabit Router​

Model No. TL-WR1043ND​

 

[cyberjock]

Ok.. and 100Mb LAN maxes out at 12MB/sec(before overhead). I'd say check your LAN connections. Just because you've transferred stuff from your hard drive at 45MB/sec doesn't mean that the connection from your server to your LAN isn't 100Mb because of a bad cable or something.

I'm sorry, far more than a coincidence that you are ending up stuck at 11.3MB/sec. I've been around here long enough to know better!

Post the output of "ifconfig".