Why not use Wifi in performance test or if you use know what is the limitations

Status
Not open for further replies.

Peter Jakab

Dabbler
Joined
Jun 18, 2015
Messages
37
Hi All,

I performed lot of tests and try to share my results for community. And also worked and actually working in one of biggest mobile communication companies. I use my spare time to consult with old mobile gurus what we do wrongly and how to design.

First of all the Wifi is radio technology so its is limited due:
- shared medium with more clients on same medium (switched cables is dedicated between your PC and switch),
- radio wave just working in air not works in below ground level. Is it possible with more reflection reach level but loosing power. In Gigahertz level the waves could reflecting from wall and passing through doors but also loose power.
- If you have any blocking between receiver and transmitter antenna receive level goes down and if reach Noise floor than end of game. SNR (signal to noise) margin called the expert the budget where we have place to play.
- Transmission could disturbed by other (several times wrongly configured) access points also. I my old block of flats that was WAR for 2.4Ghz range. Yes that is real war with over standard transmitters and about 15-25 overlapping on 2.4Ghz channels . Meanwhile I go to shop and ask for 5Ghz system where I was the only access point.
- Non access point interference typical the microwave oven:
spectrum-analyzer-big_microwave_oven.png

and you own video camera also
spectrum-analyzer-big_video_camera.png

- Stupid channel selection by neighbors. Default setting Auto mean at boot time perform channel scan and make decission at that time. The problem that is changing over time and not automatically rescan. If you set it manually be care channel 3 mean also also use 1, 2, 4 and 5 because the spectrum mask (valid for 5Ghz also).
spectral_mask.png

- Changing over time. If you see 54Mbps, 150Mbps or 300Mbps the link speed that was try few seconds ago. The most problematical in radio data communication change speed real time and change protocol real time. What is see now not valid for future.
- Several access point have processor and/or memory limitation. Same situation as in cheap switches. Enterprise access points much more better just we unable pay for that for home usage.
- You loose also performance based on half-duplex, Acknowledge, CSMA/CA (yes this is close to Ethernet CSMA/CD) meanwhile in cable not really necessary (theoritically not from economy point of view). But in share radio frequency you need have collission avoidance mechanism.
- I was problem when I make test with my old laptop just have 802.11b/g 54Mbps capable card. I not understand why is my other tablet show just 54Mbps. The access point for compatibility switch back to 802.11g operation and my 802.11n just running on 54Mbps speed. So avoid old wifi clients in your range. Most of the access point not able handle independently different protocols for the clients parallel.
Enterprise class
Good access points have more antennas (3 and more) and have possibility to have more SSID parallel put in VLANs. But they also have higher costs of course.

Perf test:
1.Good wifi analysers (non professional on smartphone or tablet) show them: https://play.google.com/store/apps/details?id=com.pzolee.android.localwifispeedtester&hl=en
But I also used Wifi Analyzer https://play.google.com/store/apps/details?id=com.farproc.wifi.analyzer&hl=en
and InSSIDer
2.You can use test programs to check TCP (theoritical), Samba and Ftp speeds: https://play.google.com/store/apps/details?id=com.pzolee.android.localwifispeedtester&hl=en Don't forget in setting the file size and block size settings throughput deppend on that. SMB test so funny on NAS the created file visible in the shared folder. What they download if no upload first time, but it works?

If you would like see full performance: just one client in range, no more access point could detected on same frequency range, close to the access point (max. 1-2 meter)

The different protocols and their limitations. I added the FreeNAS related topic results below
Source: http://www.speedguide.net/faq/what-is-the-actual-real-life-speed-of-wireless-374

1. 802.11b 11Mbps theoritical (2.4Ghz) - real 2-3Mbps (mean 0.25-0.375MByte/sec transfer rate)

FreeNAS: Just enough to check your text based mails no more (forget attachments). This is really old legacy avoid as possible category.

2. 802.11g (2.4Ghz) and 802.11a (5Ghz) 54Mbps theoritical - real about 20Mbps (mean 2.5Mbyte/sec transfer rate).

FreeNAS: I tested for for Samba horror slow download (2.4-2.7Mbyte/sec). Video and file transfer not this category. But could used for DLNA voice transfers succesfully. Example small hifi for my school girl: DLNA server with voice files (ground floor), small old smart phone with phone jack and small 2.1 loudspeakers with built in rectifier (1st floor for 2.4Ghz not problem) .

3. 802.11n this is based on 150Mbps and multiplications (MIMO) you can buy 150Mbps, 300Mbps, 450Mbps and 600Mbps versions (of course cost increased also). Be care avoid the marketing bullshit 600Mbps same time mean 300Mbps on 2.4Ghz and 300 on 5Ghz so that is not same datasheet said 802.11n 5Ghz 600Mhz.

Typically on 2.4Ghz have less speed and 450,600Mbps just available on 5Ghz. 2.4Ghz have longer distance, but are you really would like transmit you network to neighbors also? 5Ghz have cleaner frequency (less neighbor have devices) and due smaller cell less possibility of interference. But 5Ghz mostly room limited meanwhile 2.4Ghz enough for small house also.
Link above said 40-50Mbps and with new boxsed 70-80Mbps in 40Mhz channel width mode.

2.4Ghz. My results was about 20-30Mbps SMB results which is several times dropped to smaller link speed. With 4096byte block size this is more worst about 10Mbps. That is visible in simple Samba file transfers also about 700-1100Kbps.

5Ghz: My wifi router TP-link WDR-3600 just give me 150Mbps in 802.11.n on 2.4Ghz range
300Mbps (on 5Ghz clean frequency) - real I measured with the wifi speed test (URL above) 80-102Mbps TCP test and 30-40Mbps with SMB test 16384byte block size (mean 3.75-5Mbyte/sec transfer rate).

FreeNAS: That is the point when you can see DLNA video streams HD 720p error free and Full-HD 1080p with same errors. Be care for Full-HD 1080p you need also powerfull player several smart phones and tablets have limitation inside. You can easly filter out those ones: copy Full-HD movie not high compressed format (yes it is least 20-30Gbyte) and check locally if drop-outs in the frames where is the most changes in screen. Example I use SciFi movies for this testing with battle in space.
File transfer also slow compared to Fixed Gigabit speeds 80-110Mbyte/sec. Think about that fact 70-80Mbps above mean 8.75-10Mbyte/sec instead.

If you would like see DLAN Full-HD 1080p error free:
- 5Ghz mandatory
- client inside same room as wifi router (because the 5Ghz just allow this). If more room then more access point necessary (and good planning needed: no overlapping on same or close channels).
- I recommend least 600Mbps to reach my 40-60Mbps fixed line bandwidth under DLNA plays from Minidlna. 450Mbps just economical not good 600Mbps wifi routers have small difference.
- Channel width 40Mhz or better (instead of old 20Mhz)
- Think as same in Ethernet way if you would like transmit stable 50Mbyte/sec then radio min.600Mbps. Simple over planning (your budget also).

4. 802.11ac the latest player with theoritical 1300Mbps. Not just access point but also clients have to support it.
Not my play area yet but if my father really want see Full-HD on his tablet then I need to buy it.
URL said 70-100Mbps real mean 8.75-12.5Mbyte/sec. Compare to 80-110Mbyte/sec fixed and forget any wifi
Need check File transfer at this level. Could possible works on very close clients. Why not use gigabit cable instead for small distance?

Good Access point settings:
- Be care set your country in settings. Due we have different frequency laws wordwide. I see goverment nice truck which measure illegal use of other frequencies and have high fine if you do mistake.
- Check you protocol setting in both client and access point (called wifi router in home/SOHO)
- Scan frequency how is use what. if the full mask is free choose those freuqency (yes in 2.4Ghz just 3 channel possible 1, 6, 11 and same countries the 14)
That is the beggining of channel war:
2yVUnQuDeh5u4yoYEM7UGM_itfO3fUxMGRM7SpqMvx8jkL1mSGVIOZ99C3tHXY1TbkY_=h900


- VERY important: Set your transmit rate to minimal and check is it enough or not. Just increase with one step if not enough. If you transmit in full level then not just have security possibility of hacking (yes WPA also just more resource needed) but also you start make the overlapping war with your neighbors. If you have good Wifi device then you are able to set more than High, Medium and Low. I see Ericsson businness access point when you can set the transmit power by mWatt in 15 steps.
- You can transmit in your access point higher than allowed by law (1000mW in my country) but after neighbor unable communicate they also buy big power pack and your client is the limitation. Do you have tablet or smart phone with about goverment power level transmit capability?
- WEP and WPA never use that was also game in 1998 for me to check how many WEP and fully open access point in city meanwhile I drive car. Use least WPA2/PSK and AES instead.

Summary:
Any Cat5/5e/6 cable above 100Mbps always faster, dedicated and could error free (if no cable or NIC errors) so better that wifi you can pay (home users). That is theoritical fact.

I try to avoid consultation about human impact of Ghz frequency. Please don't ask me. Just based on my collected knowledge I try avoide Wifi always on just turn on when needed. The always on systems on stable fixed cable without any problems.

Please don't forget share us your results.

Jackson, as an IT engineer in fixed+mobile networking area
 

Peter Jakab

Dabbler
Joined
Jun 18, 2015
Messages
37
I you read first part you can said that:
"But I have Gigabit capable 802.11ac device where the datasheet said over 1300-1750Mbps capable. Which is support Gigabit speeds"

To understad this you need know what is behing each link speed value.
I also confused how to reach 600Mbps in 2.4Ghz so I put the info together.

Basic 802.11g is 54mbps so how could we make higher in 802.11n:
- 802.11g used 48 modulation (OFDM) mean while 802.11n initially uses 52 so from 54Mbps we go up to 58.5Mbps. Not enough.
- 802.11g has a maximum FEC (Forward Error Correction) coding rate of 3/4. 802.11n squeezes some redundancy out of this with a 5/6 coding rate, boosting the link rate from 58.5 Mbps to 65 Mbps.
- 802.11a has Guard Interval between transmissions of 800ns. 802.11n has an option to reduce this to 400ns, which boosts the throughput from 65 Mbps to 72.2 Mbps. We call this later as "Short GI".
- Thanks to the magical effect of spatial multiplexing, provided there are sufficient multi-path reflections, the throughput of a system goes up linearly with each extra antenna at both ends. Two antennas at each end double the throughput, three antennas at each end triple it, and four quadruple it. The maximum number of antennas in the receive and transmit arrays specified by 802.11n is four. This allows four simultaneous 72.2 Mbps streams, yielding a total throughput of 288.9 Mbps.
- All previous versions of 802.11 have a channel bandwidth of 20MHz. 802.11n has an optional mode (controversial and not usable in many circumstances) where the channel bandwidth is 40 MHz. While the channel bandwidth is doubled, the number of data subcarriers is slightly more than doubled, going from 52 to 108. This yields a total channel throughput of 150 Mbps. So again combining four channels with MIMO, we get 600 Mbps.

Are you confused with lot of numbers? Me too so put together the most common used speeds instead:

802.11n speeds (on both bandwidth 2.4Ghz and 5Ghz)
20Mhz based:
72Mbps 1x1 single spatial stream 20Mhz (52 OFDM, FEC + Short GI)
144Mbps 2x2 MIMO 20Mhz (52 OFDM, FEC + Short GI)
216.7Mbps 3x3 MIMO 20Mhz (52 OFDM, FEC + Short GI) called 200Mbps

If we use higher 40Mhz channel then:
150Mbps 1x1 single spatial stream (40Mhz, 64QAM, Short GI)
300Mbps 2x2 MIMO 2 spatial stream (40Mhz, 64QAM, Short GI)
450Mbps 3x3MIMO 3spatial stream, (40Mhz, 64QAM, Short GI) real speed about 240-288Mbps
theoritically no exist:
600Mbps 4x4MIMO 4spatial stream, (40Mhz bandwidth, 64QAM, Short GI 5/6 code rate)

But we reach 600Mbps on 2.4Ghz as you see in many specification if they just have 3 antenna. The trick is the 256QAM (as came from 802.11ac down to 802.11n)
256QAM called as
- ASUS TurboQAM as proprietary name
- NetGear 2.4Ghz Performance Mode
but have problems: http://www.smallnetbuilder.com/wireless/wireless-features/32238-ac1900-innovation-or-3d-wi-fi (type a captcha to see)

20Mhz 256QAM extra:
78Mbps 1x1 single spatial stream, (20Mhz, 256QAM, 3/4 code rate, no Short GI)
86.7Mbps 1x1 single spatial stream, (20Mhz, 256QAM, 3/4 code rate, with sort GI)
156Mbps 2x2MIMO 2 spatial stream, (20Mhz, 256QAM, 3/4 code rate, no Short GI)
173.3Mbps 2x2MIMO 2 spatial stream, (20Mhz, 256QAM, 3/4 code rate, with sort GI)
234Mbps 3x3MIMO 3 spatial stream, (20Mhz, 256QAM, 3/4 code rate, no Short GI)
260Mbps 3x3MIMO 3 spatial stream, (20Mhz, 256QAM, 3/4 code rate, with sort GI)
with FEC 5/6 code rate
260Mbps 3x3MIMO 3 spatial stream, (20Mhz, 256QAM, 5/6 code rate, no Short GI)
288.9Mbps 3x3MIMO 3 spatial stream, (20Mhz, 256QAM, 5/6 code rate, with sort GI)

40Mhz 256QAM extra, with Short GI:
Could not possible if any interference in background goes back to 20Mhz
180Mbps 1x1 single spatial stream, (40Mhz, 256QAM, 3/4 code rate)
200Mbps 1x1 single spatial stream, (40Mhz, 256QAM, 5/6 code rate)
360Mbps 2x2MIMO 2 spatial stream, (40Mhz, 256QAM, 3/4 code rate)
400Mbps 2x2MIMO 2 spatial stream, (40Mhz, 256QAM, 5/6 code rate)
540Mbps 3x3MIMO 3 spatial stream, (40Mhz, 256QAM, 3/4 code rate)
600Mbps 3x3MIMO 3 spatial stream, (40Mhz, 256QAM, 5/6 code rate)

So we know how to reach 600Mbps with 3 antenna. But this is practically not reachable.
600Mbps on 2.4Ghz you never reach:
1) An AC1900 class router (easy to get)
2) An AC1900 class client (only 3 antenna clients ASUS PCE-AC68, TP-LINK Archer T8E and TP-LINK Archer T9E)
3) 40 MHz bandwidth (no interference by externals) that is normally not possible if you have neighbors


Let's go up to 802.11ac standard bandwidths
802.11ac mean
- Mandatory 5Ghz (not on 2.4Ghz)
- 20, 40 and 80Mhz channel (but higher SINR 3dB for 40Mhz, 6dB for 80Mhz)
- By default goes back to lower channel mode if interference detected
- min 1 spatial streams in clients
- min. 2 spatial streams in APs
- theoritical 160Mhz is possible but frequency range tipically
- 64QAM up to 256QAM (code rate 5/6) but higher SNR necessary for this
(802.11n 4x4MIMO, 40Mhz, 64QAM, Short GI= 600Mbps, 802.11ac 4x4MIMO, 40Mhz, 256QAM, Short GI=800Mbps)
- MU-MIMO (multiple user with smaller channels) let's see later on
- Beamforming – increases reliability of the AP/client link (greater distance).

+------------+-------------+-------------+-------------+----------------+
|No streams| 20 Mhz | 40 Mhz | 80 Mhz | 160 Mhz |
+------------+-------------+-------------+-------------+----------------+
| 1 | 86.7Mbps| 200 Mbps | 433.3Mbps| 866.7Mbps |
| 2 | 173.3Mbps| 400 Mbps | 866.7Mbps| 1733 Mbps |
| 3 | 288.9Mbps| 600 Mbps| 1300 Mbps| 2340 Mbps |
| 4 | 346.7Mbps| 800 Mbps| 1733 Mbps| 3466 Mbps |
| 5 | 433.3Mbps| 1000 Mbps| 2166 Mbps| 4333 Mbps |
| 6 | 577.8Mbps| 1200 Mbps| 2340 Mbps| 5200 Mbps |
| 7 | 606.7Mbps| 1400 Mbps| 3033 Mbps| 6066.7Mbps|
| 8 | 693.3Mbps| 1600 Mbps| 3466 Mbps| 6933 Mbps |
+------------+-------------+-------------+-------------+---------------+
No Access Point (AP) have more than 4 antenna and 160Mhz today (Sept of 2015)

First real AC1900 consumer routers (600Mbps 2.4Ghz +1300Mbps 5Ghz) at 2013
ASUS (RT-AC68U)
NETGEAR (R7000)
Linksys (EA6900)
later:
TP-Link (AC-1900)

80Mhz channel nice but you need carefully plan it: http://www.revolutionwifi.net/revolutionwifi/2013/03/80211ac-channel-planning.html

So you see that speed depend on:
- modulation 64QAM, 256QAM
- channel size 20-40-80Mhz
- MIMO qty of antennas
but you never configure this in your AP.

Example Netgear R7500 configuration said:
2.4Ghz
"up to 600Mbps" (256QAM, 40Mhz), "Up to 289Mbps" (256QAM, 20Mhz), "Up to 54Mbps" (802.11g, 20Mhz)
5Ghz
"up to 1733Mbps"(80Mhz), "Up to 800Mbps"(40Mhz), "Up to 347Mbps"(20Mhz)
But least they have possibility in Advanced home page show which 4 channel used in 80Mhz operation and which is primary ("p") and secondary ("s") if back to 40/20Mhz operation.
In my country in Central-EU 80Mhz channel settings: (36,40,44,48)
DFS: (52,56,60,64) and (100,104,108,112) rate back if radar detected

Real 4x4:4 MIMO 600+1733 routers today (I collected at 24th of Aug 2015)
- ASUS (RT-AC87U) AP mode, 600+1733 MU-MIMO, beamforming
- NETGEAR (R7500) AP mode, 600+1733, Beamforming, no MU-MIMO support (all device could called as R7500v1).
I am waiting for replacement to R7500v2 to my father due (5Ghz not support WPA2 EAP/Enterprise Radius authentication) and MIMO will not possible by firmware upgrade. So Netgear support will replace to v2 at the moment (thanks to new Qualcomm antenna)
-Linksys (EA8500) MU-MIMO tested and works by cnet
- TP-Link (C2600) later arrived to market in my country not reachable at the moment
Thanks to beamforming this is very good long coverage devices.

All of them is 802.11ac Wave1 devices. If you would like know what is Wave1 and Wav2 see this: http://www.cisco.com/c/en/us/soluti...rks/802-11ac-solution/q-and-a-c67-734152.html

Be care MU-MIMO: just downlink direction and four antenna just support 1+1, 1+1+1 or 1+2 configurations! So its limited to 3 devices as best performance.

But the 80Mhz channel also have problems:
Channel map for 802.11ac
+-----------------+-----------------------+-----------------------------+
| |Channels with DFS | Channel Excluding DFS |
+-----------------+----------+-----------+----------+-----------------+
| Channel size | US | Europe | US | Europe |
+-----------------+----------+----------+----------+------------------+
| 40 Mhz | 8 | 9 | 4 | 2 |
+-----------------+----------+----------+----------+------------------+
| 80 Mhz | 4 | 5 | 2 | 1 |
+-----------------+----------+----------+----------+------------------+
| 160 Mhz | 1 | 2 | - | - |
+-----------------+----------+----------+----------+------------------+
DFS = Dynamic Frequency Selection – for avoiding interference with weather radar

Same clients for MIMO
Iphone 6 Non MIMO issue just 433Mbps per MIMO channel :(
http://www.sniffwifi.com/2014/09/whats-new-and-missing-in-wifi-for.html

Actually 2x2:2 MIMO support I tested with those smart devices:
Samsung Galaxy Tab S 10.5 LTE
Samsung Galaxy Note 4
Samsung Galaxy 6

I make about 300 speed tests over those devices with TP-Link WDR3600 (802.11n) and Netgear R7500(v1 on 802.11ac). Look at the Tablet first.

At 2.4Ghz on my old 300Mbps capable WDR on 802.11n link speed show 144Mbps (all value the best numbers I ever see for 10MByte or 100MByte file transfer average)
TCP down 100Mbps, up 106Mbps
Samba down 34MByte/sec, up 30MByte/sec

Same as on 5Ghz 802.11n but at 300Mbps link speed
TCP down 163Mbps, up 137Mbps (do you see that not able reach 300Mbps link speed)
Samba down 40MByte/sec, up 32MByte/sec (no double numbers that mean in client limited)

But on smart phones:
Samsung KZoom 802.11n single MIMO on Freenas9.3 Samba download (150Mbps link speed) 1100KByte/sec
Samsung Galaxy 6 same as KZoom just 2x2:2 MIMO 802.11n (300Mbps link speed) 2200KByte/sec

So see the 802.11ac
On Netgear R7500v1 on 5Ghz link speed 866Mbps (10cm from antenna)
TCP down 318Mbps, up 295Mbps
Samba down 30MByte/sec, up 37MByte/sec
You can see the simple TCP test show the higher bandwidth but Samba unable use this could have any hardware limitation in Tablet.

Could you reach 1Gbps wired LAN speed:
- theoritically yes,
- practically NO!

Any vendor could put nice labels to 802.11ac boxes but:
- no client support only few USB have 3 antenna support
- no smart device could support 3 antenna yet
- all of the Internet review uses two 3x3:3 MIMO AP to check speed because only 2x2 clients available mostly
- you could configure 80Mhz and gigamega bandwidth but your interference and country frequency plan the limitations
- if not 10cm from antenna you definitely get lower speeds.

If you see link speed number in your device check in the speeds above. I hope this helps.

Bye,
Jackson
 
Status
Not open for further replies.
Top