slow transfer rates

[Psychoteur]

Hello,
I've got slow transfert rates. I'm backing my laptop with rsync and I only get around 15MB/s.
I always have like 120/130 MB/s with this box.

I tried to reboot to 11.0-U1, and the rates did got up again like for 2 minutes and then it slowed down again.
I check my switch, everything is ok.

I've no memory overload, no cpu overload. I've got a Z1 raid with 5x3T hdd and 32G of ram.

Code:

igb0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500

options=2400b9<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,RXCSUM_IPV6>

ether d0:50:99:0a:63:05

nd6 options=9<PERFORMNUD,IFDISABLED>

media: Ethernet autoselect (1000baseT <full-duplex>)

status: active

igb1: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500

options=2400b9<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,RXCSUM_IPV6>

ether d0:50:99:0a:63:05

nd6 options=9<PERFORMNUD,IFDISABLED>

media: Ethernet autoselect (1000baseT <full-duplex>)

status: active

lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384

options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>

inet6 ::1 prefixlen 128

inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3

inet 127.0.0.1 netmask 0xff000000

nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>

groups: lo

lagg0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500

options=2400b9<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,RXCSUM_IPV6>

ether d0:50:99:0a:63:05

inet 192.168.178.10 netmask 0xffffff00 broadcast 192.168.178.255

nd6 options=9<PERFORMNUD,IFDISABLED>

media: Ethernet autoselect

status: active

groups: lagg

laggproto loadbalance lagghash l2,l3,l4

laggport: igb0 flags=4<ACTIVE>

laggport: igb1 flags=4<ACTIVE>

bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500

ether 02:ca:19:6d:b2:00

nd6 options=1<PERFORMNUD>

groups: bridge

id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15

maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200

root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0

member: epair4a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>

		ifmaxaddr 0 port 10 priority 128 path cost 2000

member: epair3a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>

		ifmaxaddr 0 port 9 priority 128 path cost 2000

member: epair2a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>

		ifmaxaddr 0 port 8 priority 128 path cost 2000

member: epair1a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>

		ifmaxaddr 0 port 7 priority 128 path cost 2000

member: epair0a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>

		ifmaxaddr 0 port 6 priority 128 path cost 2000

member: lagg0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>

		ifmaxaddr 0 port 4 priority 128 path cost 10000

epair0a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500

options=8<VLAN_MTU>

ether 02:ff:20:00:06:0a

nd6 options=1<PERFORMNUD>

media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)

status: active

groups: epair

epair1a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500

options=8<VLAN_MTU>

ether 02:ff:20:00:07:0a

nd6 options=1<PERFORMNUD>

media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)

status: active

groups: epair

epair2a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500

options=8<VLAN_MTU>

ether 02:ff:20:00:08:0a

nd6 options=1<PERFORMNUD>

media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)

status: active

groups: epair

epair3a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500

options=8<VLAN_MTU>

ether 02:ff:20:00:09:0a

nd6 options=1<PERFORMNUD>

media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)

status: active

groups: epair

epair4a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500

options=8<VLAN_MTU>

ether 02:ff:20:00:0a:0a

nd6 options=1<PERFORMNUD>

media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)

status: active

groups: epair

 

[joeschmuck]

While this answer is likely not the definative answer, I do know that RSync is a slow way to transfer data. I can't explain why because I haven't dug into that aspect but I see a lot of complaints about it here and the aswers always seem to come back as "that is the way it is". You stating that you have some very high transfer rates, I suspect that is via a different protocol like SMB (CIFS) or SSH or FTP, and that you are not using WiFi. Or are you stating that you have previously used RSync and it has had sustained performance of 120/130MB/sec? Also those are a bit high for a Gbit Ethernet connection, sounds more like a burst speed, not sustained speed.

 

[Psychoteur]

Well, I'm not using WiFi, I use cable.
I use "rsync -Pav" and 120/130 was "cruising" speed.
Now seeing your message, I'm putting some VM back on my computer and I use smb and I got around 50MB/sec.

 

[joeschmuck]

I use "rsync -Pav" and 120/130 was "cruising" speed.

That is impressive. Do you think some of the slowdown could be from other network traffic? I doubt it but gotta ask.

 

[Psychoteur]

I'm quite alone on my network. That's my home NAS.
I thought it's was due to something in one of my jail, plex, transmission.
I'm starting to think that it is a problem with my chipset, it's an asrock c2550.

 

[alext104]

Hi,
I have a problem like this....
When I transfer movie to my Freenas usign a wired computer, I obtain 10Mb/s.
What I can send you to you for checking my configuration?

 

[Psychoteur]

Hi.
did you check the cables, switch, etc ?
It seems you're using 100M hardware ;)

 

[alext104]

Yes, I have cat5e, cat6 for the cable.
My router is 10/100/1000 and the card of my pc and nas is GBE 10/100/1000.

 

[joeschmuck]

Yes, I have cat5e, cat6 for the cable.
My router is 10/100/1000 and the card of my pc and nas is GBE 10/100/1000.

He's saying you have something in your network that is running at 100Mbit. This could be a switch, bad cable, NIC, device driver for NIC. I have to agree, if you are getting 10 Mb/sec then you are not running at 1Gb/sec speeds from your server to your computer. Use a direct Cat 5e/6 connection between your computer and server and retest.

Also, if you still have this problem after checking this properly, open your own thread. The OP has not fixed the problem and you are just adding confusion to this thread.

 

[joeschmuck]

I'm quite alone on my network. That's my home NAS.
I thought it's was due to something in one of my jail, plex, transmission.
I'm starting to think that it is a problem with my chipset, it's an asrock c2550.

Your NIC's are Intel i210 so I don't think it's your NICs. And many people have this motherboard so I don't think it's the chipset.

Glad to know that you are alone on your network, I didn't think that was the issue but we need to isolate things.

So you have LAGG setup. How about turning that off and rerun the test.

Also you should change your testing to something a bit more standard like using iPerf. Run it going in both directions and establish a baseline. Also make a direct connection between your server and computer, do not use any switches. With any luck you will start having some good transfer rates using iPerf. Once that is done then place your system into your LAN as you had it before and run the iPerf test again. If all checks out then you should be all good again. and ready to test Rsync again.

 

[Psychoteur]

Sorry, I didn't see your reply. I will test as soon as possible !
But going straight to the nas involves climbing a ladder. My Nas is hidden in my garage up to the roof :D
And to put the ladder, I've to move some boxes !
Yeah my lagg setup can be an issue. When I tried corral. It was not running -> bug.
I know what I'm going to do this week-end.

Thank you.

 

[Psychoteur]

Hello,

so I did some "iperf" tests.

Code:

------------------------------------------------------------
Client connecting to 192.168.178.10, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.178.70 port 47098 connected with 192.168.178.10 port 5001
[ ID] Interval	   Transfer	 Bandwidth
[  3]  0.0-3600.0 sec   393 GBytes   938 Mbits/sec

/CODE]

So as I said my network speed is 117.25 MB.

I did freenas -> laptop; and laptop -> freenas; and even from my old Mac Mini. Always the same results.

I did not try direct connection since the results are pretty good. 

So I retried rsync and 17.5 MB :(
I did copy some movies using smb from my laptop and Mac Mini : around 70 MB.

I think the bottleneck is when the hard disks are involved.

 

[mikensan]

If it's any consolation I'm having slow speeds with 11u2 via NFS and rsync. Only writing to FreeNAS, but reading from FreeNAS I'm getting ~900mbit/s. If you rsync data from freenas to your laptop, what speeds do you see?

 

[Psychoteur]

No, I didn't try that way. I should try.