I have a FreeNAS-9.10.2-U6 server with 4x10g bonded Intel X540. The server was working absolutely fine for months until this very strange problem occurred.
When I do an iperf from the server to Linux machine I get around 9.5Gbits/sec but when I iperf from the client to the server I get only 20-30MBit/sec (yes Mbits). When I restart the server it works for a while at around 9.5Gbits/sec but after awhile it drops to the 20-30MBits/sec and stays like this until a reboot.
Couldn't find anything suspicious in the logs. iperfs from the server to the clients are always perfect and just to check for cable / switch problems I did iperf between clients - no problem in any direction. Looks to me like a driver or software issue. What do you guys think? Should I revert to previous FreeNAS version? What can I do to diagnose this issue? Thanks
Edit:
It gets even stranger. Restarting the switch also fixes this for a while without restarting the server. Also 1G connections don't have this issue. I reverted to a FreeNAS version to FreeNAS-9.10.2-U1 and also tried to upgrade to FreeNAS 11 - same thing. Maybe it's not FreeNAS related at all but why it gets fixed for a while after a FreeNAS restart is a mystery.
When I do an iperf from the server to Linux machine I get around 9.5Gbits/sec but when I iperf from the client to the server I get only 20-30MBit/sec (yes Mbits). When I restart the server it works for a while at around 9.5Gbits/sec but after awhile it drops to the 20-30MBits/sec and stays like this until a reboot.
Code:
# freshly rebooted server iperf -c storage ------------------------------------------------------------ Client connecting to storage, TCP port 5001 TCP window size: 92.6 KByte (default) ------------------------------------------------------------ [ 3] local 192.168.10.244 port 33628 connected with 192.168.10.15 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.0 sec 11.5 GBytes 9.89 Gbits/sec # server after half an hour iperf -c storage ------------------------------------------------------------ Client connecting to storage, TCP port 5001 TCP window size: 92.6 KByte (default) ------------------------------------------------------------ [ 3] local 192.168.10.244 port 37018 connected with 192.168.10.15 port 5001 [ ID] Interval Transfer Bandwidth [ 3] 0.0-10.1 sec 31.4 MBytes 26.1 Mbits/sec
Couldn't find anything suspicious in the logs. iperfs from the server to the clients are always perfect and just to check for cable / switch problems I did iperf between clients - no problem in any direction. Looks to me like a driver or software issue. What do you guys think? Should I revert to previous FreeNAS version? What can I do to diagnose this issue? Thanks
Edit:
It gets even stranger. Restarting the switch also fixes this for a while without restarting the server. Also 1G connections don't have this issue. I reverted to a FreeNAS version to FreeNAS-9.10.2-U1 and also tried to upgrade to FreeNAS 11 - same thing. Maybe it's not FreeNAS related at all but why it gets fixed for a while after a FreeNAS restart is a mystery.
Last edited: