Severe 10gig rcv speed drop shortly after a reboot

Status
Not open for further replies.

wuxia

Dabbler
Joined
Jan 7, 2016
Messages
49
I have a FreeNAS-9.10.2-U6 server with 4x10g bonded Intel X540. The server was working absolutely fine for months until this very strange problem occurred.
When I do an iperf from the server to Linux machine I get around 9.5Gbits/sec but when I iperf from the client to the server I get only 20-30MBit/sec (yes Mbits). When I restart the server it works for a while at around 9.5Gbits/sec but after awhile it drops to the 20-30MBits/sec and stays like this until a reboot.

Code:
# freshly rebooted server
iperf -c storage
------------------------------------------------------------
Client connecting to storage, TCP port 5001
TCP window size: 92.6 KByte (default)
------------------------------------------------------------
[  3] local 192.168.10.244 port 33628 connected with 192.168.10.15 port 5001
[ ID] Interval  Transfer  Bandwidth
[  3]  0.0-10.0 sec  11.5 GBytes  9.89 Gbits/sec

# server after half an hour
iperf -c storage
------------------------------------------------------------
Client connecting to storage, TCP port 5001
TCP window size: 92.6 KByte (default)
------------------------------------------------------------
[  3] local 192.168.10.244 port 37018 connected with 192.168.10.15 port 5001
[ ID] Interval  Transfer  Bandwidth
[  3]  0.0-10.1 sec  31.4 MBytes  26.1 Mbits/sec


Couldn't find anything suspicious in the logs. iperfs from the server to the clients are always perfect and just to check for cable / switch problems I did iperf between clients - no problem in any direction. Looks to me like a driver or software issue. What do you guys think? Should I revert to previous FreeNAS version? What can I do to diagnose this issue? Thanks

Edit:
It gets even stranger. Restarting the switch also fixes this for a while without restarting the server. Also 1G connections don't have this issue. I reverted to a FreeNAS version to FreeNAS-9.10.2-U1 and also tried to upgrade to FreeNAS 11 - same thing. Maybe it's not FreeNAS related at all but why it gets fixed for a while after a FreeNAS restart is a mystery.
 
Last edited:
Status
Not open for further replies.
Top