Slow write speeds

[Juvx]

Hi gents, Sorry for the questions but i'm really new to freeNas and pretty much a newb to networking in general. So PLEASE bare with me and treat me like a child. haha
My system:
freeNAS system running 9.3.
Intel Xeon e3-1246 v3
Asrock c226 WS
Crucial 32GB ECC mem
1 x WD Green 2 TB
6x WD RED 4TB will run Z2 total of 16TB
Single 1GbE
Linksys EA8500 mu-mimo wireless router

I'm running CIFS for my main share.
My issue seems to be with write speeds... they hang around 5MB/sec... my read speeds iv tested with LAN speed test are good for 1Gbe.. about 110+MB/sec so I dont think its my network or cables since i can max out my reads.... but not sure why my writes are soooooooo slow, surely my system can max out writes as well on paper. Please help a newbie out.

 

[SweetAndLow]

How are you testing this?

 

[Juvx]

How are you testing this?

Well im in the process of sending 800 GB from my main desktop PC worth of movies... and it's at 4MB/sec. but i've tried sending from my macbook pro as well.
My main desktop PC easily hits 90-120MB/sec on speedtest. (150MB/sec connection from isp).

(See the image i've uploaded for more stats)

 

[SweetAndLow]

How do yiu know your source isn't the bottle neck?

You need to use dd to test speeds locally on freenas. Then use iperf to test your networking.

 

[Juvx]

How do yiu know your source isn't the bottle neck?

You need to use dd to test speeds locally on freenas. Then use iperf to test your networking.

Is there a guide on how to do that for dumb people like me?

 

[SweetAndLow]

Yes there are all over the internet just do a Google search.

 

[Juvx]

Code:

[root@freenas ~]# dd if=/dev/zero of=/mnt/Main/Vlad/ddfile bs=2048k count=10000
10000+0 records in                                                             
10000+0 records out                                                            
20971520000 bytes transferred in 3.740342 secs (5606845367 bytes/sec

 

[SweetAndLow]

Create a new dataset and disable compression on that dataset. These result have compassion turned on. You will ask need to write and read a file that is larger than the amount of memory you have.

 

[Juvx]

Create a new dataset and disable compression on that dataset. These result have compassion turned on. You will ask need to write and read a file that is larger than the amount of memory you have.

Code:

[root@freenas /mnt/Main/Test]# dd if=/dev/zero of=/mnt/Main/Test/ddfile bs=2048k
count=34000                                                                   
34000+0 records in                                                             
34000+0 records out                                                            
71303168000 bytes transferred in 297.187549 secs (239926499 bytes/sec)

 

[Juvx]

As for reads

Code:

[root@freenas /mnt/Main/Test]# dd of=/dev/null if=/mnt/Main/Test/ddfile bs=2048k
count=34000                                                                   
34000+0 records in                                                             
34000+0 records out                                                            
71303168000 bytes transferred in 148.171393 secs (481220879 bytes/sec)

 

[SweetAndLow]

Looks like your local disk speeds are a little slow when it comes to writes. Are all your disks healthy? You should also test your networking speeds using iperf.

 

[Juvx]

its in z2. its 240 MB/sec.... thats a FAR cry from the 4 MB/sec write i'm seeing from the clients. Yeah all the disks are healthy. Im currently transferring to them from another client so that might impacted the write test.
I'm trying to figure out how to use ipref with freenas... no idea what im doing here.

 

[SweetAndLow]

On freenas run iperf -s and then use an iperf client on a different machine on your network. If you have a Linux box you can just run iperf with the freenas IP as an argument.

 

[Juvx]

Ahh this is super frustrating lol keep getting
iperf3: error - unable to connect to server: Connection refused

 

[SweetAndLow]

From what type of client?

 

[Juvx]

From what type of client?

Mac iperf301

 

[Juvx]

Switched to windows

Code:

bin/iperf.exe -c 192.168.1.109 -P 1 -i 1 -p 5001 -f k -t 10
------------------------------------------------------------
Client connecting to 192.168.1.109, TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[236] local 192.168.1.124 port 55100 connected with 192.168.1.109 port 5001
[ ID] Interval       Transfer     Bandwidth
[236]  0.0- 1.0 sec  2032 KBytes  16646 Kbits/sec
[236]  1.0- 2.0 sec  2576 KBytes  21103 Kbits/sec
[236]  2.0- 3.0 sec  2776 KBytes  22741 Kbits/sec
[236]  3.0- 4.0 sec  2408 KBytes  19726 Kbits/sec
[236]  4.0- 5.0 sec  2328 KBytes  19071 Kbits/sec
[236]  5.0- 6.0 sec  2344 KBytes  19202 Kbits/sec
[236]  6.0- 7.0 sec  2360 KBytes  19333 Kbits/sec
[236]  7.0- 8.0 sec  2584 KBytes  21168 Kbits/sec
[236]  8.0- 9.0 sec  2696 KBytes  22086 Kbits/sec
[236]  9.0-10.0 sec  2544 KBytes  20840 Kbits/sec
Done.

bin/iperf.exe -c 192.168.1.109 -P 1 -i 1 -p 5001 -f k -t 20
------------------------------------------------------------
Client connecting to 192.168.1.109, TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[136] local 192.168.1.124 port 55101 connected with 192.168.1.109 port 5001
[ ID] Interval       Transfer     Bandwidth
[136]  0.0- 1.0 sec  2208 KBytes  18088 Kbits/sec
[136]  1.0- 2.0 sec  2464 KBytes  20185 Kbits/sec
[136]  2.0- 3.0 sec  2648 KBytes  21692 Kbits/sec
[136]  3.0- 4.0 sec  2632 KBytes  21561 Kbits/sec
[136]  4.0- 5.0 sec  2568 KBytes  21037 Kbits/sec
[136]  5.0- 6.0 sec  2160 KBytes  17695 Kbits/sec
[136]  6.0- 7.0 sec  2672 KBytes  21889 Kbits/sec
[136]  7.0- 8.0 sec  2552 KBytes  20906 Kbits/sec
[136]  8.0- 9.0 sec  2592 KBytes  21234 Kbits/sec
[136]  9.0-10.0 sec  2592 KBytes  21234 Kbits/sec
[136] 10.0-11.0 sec  2424 KBytes  19857 Kbits/sec
[136] 11.0-12.0 sec  2736 KBytes  22413 Kbits/sec
[136] 12.0-13.0 sec  2440 KBytes  19988 Kbits/sec
[136] 13.0-14.0 sec  2368 KBytes  19399 Kbits/sec
[136] 14.0-15.0 sec  2360 KBytes  19333 Kbits/sec
[136] 15.0-16.0 sec  2608 KBytes  21365 Kbits/sec
[136] 16.0-17.0 sec  2496 KBytes  20447 Kbits/sec
[136] 17.0-18.0 sec  2544 KBytes  20840 Kbits/sec
[136] 18.0-19.0 sec  2552 KBytes  20906 Kbits/sec
[136] 19.0-20.0 sec  2472 KBytes  20251 Kbits/sec

 

[Juvx]

I have intel NICs on both my desktop Z97E-ITX/ac and freenas NAS btw

 

[diedrichg]

I have intel NICs on both my desktop Z97E-ITX/ac and freenas NAS btw

What's inbetween your desktop and FreeNAS though?

 

[Juvx]

Lynksys ea8500 wireless router.