Slow GLAN tranfer rate after migration FreeNAS v.7.2 to v.8.0 (Release)

Status
Not open for further replies.

hypopo

Cadet
Joined
Jul 26, 2011
Messages
4
Please HELP! I met dramatical reduction of transfer rate uploding CIFS from my WinXP PC to FreeNAS server.

With FreeNAS v.7.2, I had about 60 Mbytes/s in both direction. After migration to v.8.0 (Release) download transfer rate (FreeNAS to PC) remains the same, but upload transfer rate (PC to FreeNAS) falls in couple seconds from 60 Mbytes/s to 1 Mbytes/s or less.

Nothing was changed, just replaced USB flash with FreeNAS v.7.2 image to USB flash with FreeNAS v.8.0 image, that's all. FreeNAS v.8.0 has default setting, just user, volumes and shares are created.

All tranactions were made on PC with mounted FreeNAS CISF shares. Transfer rate is controlled by Total Comander on WinXP.
HDDs speed was tested by
dd if=/dev/null of=/mnt/d1/filename bs=1M count=1000
results no less than 90 Mbytes/s for any combinations of directions and file systems.

The only strange thing I found is ping from PC to FreeNAS:
it's OK for block size 25152 or less, and it gave timeout for block size 25153 or more.

Surfing Internet and this forum, I found that many people met this GLAN problem with FreeNAS 8.0. However, no one solution was proposed.

Hardware:
FreeNAS 8.0 x86
ASRock motherboard with Atom 330 CPU
4G RAM
4x2Tb Seagate SATA II
4 separate UFS volumes 2Tb each
Integrated GLAN NIC

PC
WinXP SP2
ASUS motheboard P5W64 WS Pro
Intel 4300 CPU
4G RAM
2x2Tb Seagate SATA II
Integrated GLAN NIC (Marvell chip)
jumbo frames disabled

Hub
3Com 8 ports GLAN switch.
 

hypopo

Cadet
Joined
Jul 26, 2011
Messages
4
I guess it would be good idea to add netstat for the problem:

Code:
freenas# netstat -w 1
            input        (Total)           output
   packets  errs idrops      bytes    packets  errs      bytes colls
         1     0     0         60          1     0        218     0
         1     0     0         60          1     0        170     0
      1584     0     0     125410        539     0   17331486     0
      3784     0     0     298917       1263     0   41501040     0
      3774     0     0     298203       1259     0   41402385     0
      3740     0     0     295593       1250     0   41040650     0
      3761     0     0     297423       1261     0   41435270     0
^C
freenas# netstat -w 1
            input        (Total)           output
   packets  errs idrops      bytes    packets  errs      bytes colls
      1431     0     0    1294726       1058     0     101898     0
      2497     0     0    1020279       2268     0     261070     0
      2845     0     0    4031908       1600     0      99530     0
      4813     0     0    5477102       3149     0     260925     0
      3296     0     0    4719286       1844     0     114505     0
      4834     0     0    6772869       2753     0     178057     0
      2228     0     0    3212284       1230     0      76056     0
      4003     0     0    5678744       2289     0     142437     0
      4756     0     0    6336946       2820     0     196201     0
      2362     0     0    3350742       1344     0      83514     0
      1872     0     0    2667348       1073     0      66484     0
      4831     0     0    5849813       3080     0     240473     0
         2     0     0        120          1     0        170     0
       450     0     0     679846        241     0      13640     0
       466     0     0     684611        264     0      16092     0
         1     0     0         60          1     0        170     0
      1596     0     0    2321483        897     0      54260     0
            input        (Total)           output
   packets  errs idrops      bytes    packets  errs      bytes colls
      4858     0     0    5291745       3276     0     278671     0
      4048     0     0    5746617       2299     0     143141     0
      6253     0     0    8871978       3526     0     223718     0
      4043     0     0    5770749       2317     0     142827     0
      4293     0     0    6090111       2433     0     151157     0
      5598     0     0    7749919       3196     0     209317     0
      4916     0     0    6978379       2784     0     173417     0
       964     0     0     560776        821     0      89732     0
      2186     0     0    3144612       1234     0      76360     0
      4761     0     0    6706962       2688     0     170219     0
      4373     0     0    6161779       2518     0     156167     0
      1115     0     0     579688        969     0     108348     0
      3778     0     0    5339214       2155     0     134807     0
      5295     0     0    7346422       3084     0     197495     0
      2769     0     0    3900200       1579     0      98827     0
            input        (Total)           output
   packets  errs idrops      bytes    packets  errs      bytes colls
      5259     0     0    7272156       3055     0     198796     0
      4931     0     0    6820715       2835     0     290854     0
      4349     0     0    6029546       2519     0     591313     0
      4695     0     0    6483690       2694     0     175339     0
      4135     0     0    5785126       2370     0     149082     0
      3808     0     0    5216815       2210     0     145000     0
         2     0     0        120          2     0        224     0
         2     0     0        120          2     0        224     0
      1925     0     0    2799132       1083     0      65055     0
      2798     0     0    3532325       1733     0     127761     0
      5166     0     0    6015345       3350     0     269967     0
      5427     0     0    7602907       3111     0     197261     0
      5282     0     0    7212719       3087     0     206399     0
      4855     0     0    6844544       2765     0     172970     0
      4370     0     0    6224853       2482     0     154597     0
      1724     0     0    2460890        974     0      60730     0
      4706     0     0    6642833       2685     0     170341     0
      4168     0     0    5861353       2353     0     151077     0
      3977     0     0    5703533       2233     0     137046     0
       397     0     0     113706        380     0      45128     0
      1476     0     0    2117378        839     0      51452     0
            input        (Total)           output
   packets  errs idrops      bytes    packets  errs      bytes colls
      1079     0     0    1571889        608     0      36823     0
      1939     0     0    2735947       1090     0      68224     0
      1657     0     0    2392968        927     0      57029     0
      1440     0     0    2051722        809     0      50110     0
       739     0     0    1091457        414     0      24762     0
       874     0     0    1231850        497     0      31051     0
^C
freenas# netstat -s -p tcp
tcp:
        451070 packets sent
                143870 data packets (2113720205 bytes)
                0 data packets (0 bytes) retransmitted
                0 data packets unnecessarily retransmitted
                0 resends initiated by MTU discovery
                283898 ack-only packets (350 delayed)
                0 URG only packets
                0 window probe packets
                23107 window update packets
                195 control packets
        840015 packets received
                199204 acks (for 2113708749 bytes)
                154 duplicate acks
                0 acks for unsent data
                705714 packets (853768379 bytes) received in-sequence
                0 completely duplicate packets (0 bytes)
                0 old duplicate packets
                0 packets with some dup. data (0 bytes duped)
                0 out-of-order packets (0 bytes)
                2 packets (2 bytes) of data after window
                2 window probes
                25 window update packets
                1 packet received after close
                0 discarded for bad checksums
                0 discarded for bad header offset fields
                0 discarded because packet too short
                0 discarded due to memory problems
        9 connection requests
        209 connection accepts
        0 bad connection attempts
        0 listen queue overflows
        5 ignored RSTs in the windows
        211 connections established (including accepts)
        247 connections closed (including 48 drops)
                161 connections updated cached RTT on close
                161 connections updated cached RTT variance on close
                0 connections updated cached ssthresh on close
        7 embryonic connections dropped
        131437 segments updated rtt (of 131446 attempts)
        0 retransmit timeouts
                0 connections dropped by rexmit timeout
        0 persist timeouts
                0 connections dropped by persist timeout
        0 Connections (fin_wait_2) dropped because of timeout
        0 keepalive timeouts
                0 keepalive probes sent
                0 connections dropped by keepalive
        120439 correct ACK header predictions
        640286 correct data packet header predictions
        211 syncache entries added
                0 retransmitted
                0 dupsyn
                0 dropped
                209 completed
                0 bucket overflow
                0 cache overflow
                2 reset
                0 stale
                0 aborted
                0 badack
                0 unreach
                0 zone failures
        211 cookies sent
        0 cookies received
        0 SACK recovery episodes
        0 segment rexmits in SACK recovery episodes
        0 byte rexmits in SACK recovery episodes
        0 SACK options (SACK blocks) received
        0 SACK options (SACK blocks) sent
        0 SACK scoreboard overflow
        0 packets with ECN CE bit set
        0 packets with ECN ECT(0) bit set
        0 packets with ECN ECT(1) bit set
        0 successful ECN handshakes
        0 times ECN reduced the congestion window
freenas# netstat -i
Name    Mtu Network       Address              Ipkts Ierrs Idrop    Opkts Oerrs  Coll
nfe0   1500 <Link#1>      00:25:22:24:6c:5d   841936     0     0   451749     0     0
nfe0   1500 192.168.0.0   192.168.0.252       840951     -     -  1798951     -     -
lo0   16384 <Link#2>                             132     0     0      132     0     0
lo0   16384 fe80:2::1     fe80:2::1                0     -     -        0     -     -
lo0   16384 localhost     ::1                     56     -     -       56     -     -
lo0   16384 your-net      localhost               56     -     -       76     -     -
freenas# ifconfig nfe0
nfe0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=8210b<RXCSUM,TXCSUM,VLAN_MTU,TSO4,WOL_MAGIC,LINKSTATE>
        ether 00:25:22:24:6c:5d
        inet 192.168.0.252 netmask 0xffffff00 broadcast 192.168.0.255
        media: Ethernet autoselect (1000baseT <full-duplex,flowcontrol,rxpause,txpause>)
        status: active
freenas# 


ping problem has been solved with
Code:
sysctl net.inet.ip.maxfragsperpacket=44


the magic count 25152 has been explained:
25152 (max ICMP packet size) + 8 (ICMP header) = 25160 = 1480 (MTU=1500 - packet header=20) x 17 (number of fragments, 0…16).
Now:
1500 (MTU)x44(net.inet.ip.maxfragsperpacket)=66000 > 65536 (max packet size)
:)
 

Brand

Moderator
Joined
May 27, 2011
Messages
142
Just so you know there is no such thing as GLAN and it is not an acronym for Gigabit-Ethernet.
 

hypopo

Cadet
Joined
Jul 26, 2011
Messages
4
thanks.
any more suggestions that could actually help to solve the problem?
 
Status
Not open for further replies.
Top