MikroTik 5-Port Desktop Switch, 1 Gigabit Ethernet Port, 4 SFP+ 10Gbps Ports (CRS305-1G-4S+IN)

[melloa]

Initial impression is that could be a good solution for a home user.

Small little box - can you find it?

Up-linked to my Aruba and with my workstation connected via SFP+

Redundant power supplies. Can also be powered from PoE, but didn't try.

GUI showing interfaces

Same internet performances as with Aruba

Unit came pre-configure in bridge mode, so nothing was needed to start using it. I did change the IP address to match my network and have access to the GUI from my workstation.

 

[Chris Moore]

Nice. That is your rack at home?

 

[melloa]

Nice. That is your rack at home?

The switch one.

 

[l@e]

The switch one.

If you have time make some test with iperf with different sizes of packets, i have that tiny box in wish list and still reading around to get real scenarios test results if it works as it is in datashet.
What 10g card are u using on th FN?
Rack is more organized than mine

 

[melloa]

If you have time make some test with iperf with different sizes of packets, i have that tiny box in wish list and still reading around to get real scenarios test results if it works as it is in datashet.

I have one FN on baremetal with a chelsio t320 and a FN VM, on ESi 6.7 with another chelsio t320 in pass through, and other VMs on a vSwitch using a Mellanox ConnectX4. My workstation is on an old Mellanox MT26448. I can run some iperfs to post here, just send me some suggestions.

My workstation is the only one using that switch, by the way.

Scenarios

WS -> FN VM
WS -> FM Baremetal
WS -> ESXi VM
add ...

 

[l@e]

Ws->FN baremetal but with 1500 byte packets 512 and 64. These little guys usualy drop performance on smaller packets. But i see you have to do some rewiring to hook both ws and FN to Mikrotik.

 

[melloa]

WS On Mikrotik to FM Baremetal


mello@olinda:~$ iperf3 -c nas
Connecting to host nas, port 5201
[ 4] local 10.10.10.60 port 56224 connected to 10.10.10.220 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 1.09 GBytes 9.32 Gbits/sec 104 584 KBytes
[ 4] 1.00-2.00 sec 1.07 GBytes 9.16 Gbits/sec 127 506 KBytes
[ 4] 2.00-3.00 sec 1.06 GBytes 9.13 Gbits/sec 87 723 KBytes
[ 4] 3.00-4.00 sec 1.08 GBytes 9.29 Gbits/sec 65 428 KBytes
[ 4] 4.00-5.00 sec 1.08 GBytes 9.30 Gbits/sec 84 652 KBytes
[ 4] 5.00-6.00 sec 1.08 GBytes 9.29 Gbits/sec 65 682 KBytes
[ 4] 6.00-7.00 sec 1.07 GBytes 9.17 Gbits/sec 129 406 KBytes
[ 4] 7.00-8.00 sec 1.08 GBytes 9.29 Gbits/sec 95 564 KBytes
[ 4] 8.00-9.00 sec 1.07 GBytes 9.16 Gbits/sec 463 406 KBytes
[ 4] 9.00-10.00 sec 1.08 GBytes 9.29 Gbits/sec 76 690 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 10.8 GBytes 9.24 Gbits/sec 1295 sender
[ 4] 0.00-10.00 sec 10.8 GBytes 9.24 Gbits/sec receiver

iperf Done.
mello@olinda:~$ iperf3 -c nas -w 64K
Connecting to host nas, port 5201
[ 4] local 10.10.10.60 port 56344 connected to 10.10.10.220 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 995 MBytes 8.35 Gbits/sec 0 194 KBytes
[ 4] 1.00-2.00 sec 991 MBytes 8.31 Gbits/sec 0 194 KBytes
[ 4] 2.00-3.00 sec 990 MBytes 8.31 Gbits/sec 0 194 KBytes
[ 4] 3.00-4.00 sec 985 MBytes 8.27 Gbits/sec 0 194 KBytes
[ 4] 4.00-5.00 sec 985 MBytes 8.26 Gbits/sec 0 194 KBytes
[ 4] 5.00-6.00 sec 980 MBytes 8.22 Gbits/sec 0 194 KBytes
[ 4] 6.00-7.00 sec 975 MBytes 8.18 Gbits/sec 0 194 KBytes
[ 4] 7.00-8.00 sec 982 MBytes 8.24 Gbits/sec 0 194 KBytes
[ 4] 8.00-9.00 sec 989 MBytes 8.30 Gbits/sec 0 194 KBytes
[ 4] 9.00-10.00 sec 985 MBytes 8.26 Gbits/sec 0 194 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 9.63 GBytes 8.27 Gbits/sec 0 sender
[ 4] 0.00-10.00 sec 9.63 GBytes 8.27 Gbits/sec receiver

iperf Done.
mello@olinda:~$ iperf3 -c nas -w 512 K
Connecting to host nas, port 5201
[ 4] local 10.10.10.60 port 56422 connected to 10.10.10.220 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 3.50 KBytes 28.7 Kbits/sec 0 5.00 KBytes
[ 4] 1.00-2.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 2.00-3.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 3.00-4.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 4.00-5.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 5.00-6.00 sec 2.00 KBytes 16.4 Kbits/sec 0 5.00 KBytes
[ 4] 6.00-7.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 7.00-8.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 8.00-9.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 9.00-10.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 25.5 KBytes 20.9 Kbits/sec 0 sender
[ 4] 0.00-10.00 sec 24.0 KBytes 19.7 Kbits/sec receiver

iperf Done.
mello@olinda:~$ iperf3 -c nas -w 1500 K
Connecting to host nas, port 5201
[ 4] local 10.10.10.60 port 56534 connected to 10.10.10.220 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 485 MBytes 4.07 Gbits/sec 0 129 KBytes
[ 4] 1.00-2.00 sec 483 MBytes 4.05 Gbits/sec 0 129 KBytes
[ 4] 2.00-3.00 sec 496 MBytes 4.16 Gbits/sec 0 129 KBytes
[ 4] 3.00-4.00 sec 500 MBytes 4.19 Gbits/sec 0 129 KBytes
[ 4] 4.00-5.00 sec 495 MBytes 4.15 Gbits/sec 0 129 KBytes
[ 4] 5.00-6.00 sec 498 MBytes 4.18 Gbits/sec 0 129 KBytes
[ 4] 6.00-7.00 sec 498 MBytes 4.18 Gbits/sec 0 129 KBytes
[ 4] 7.00-8.00 sec 498 MBytes 4.17 Gbits/sec 0 129 KBytes
[ 4] 8.00-9.00 sec 498 MBytes 4.18 Gbits/sec 0 129 KBytes
[ 4] 9.00-10.00 sec 497 MBytes 4.17 Gbits/sec 0 129 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 4.83 GBytes 4.15 Gbits/sec 0 sender
[ 4] 0.00-10.00 sec 4.83 GBytes 4.15 Gbits/sec receiver

 

[melloa]

WS and FN Baremetal on Aruba S2500

mello@olinda:~$ iperf3 -c nas
Connecting to host nas, port 5201
[ 4] local 10.10.10.60 port 57788 connected to 10.10.10.220 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 1.09 GBytes 9.32 Gbits/sec 72 757 KBytes
[ 4] 1.00-2.00 sec 1.08 GBytes 9.29 Gbits/sec 110 612 KBytes
[ 4] 2.00-3.00 sec 1.08 GBytes 9.30 Gbits/sec 59 744 KBytes
[ 4] 3.00-4.00 sec 1.05 GBytes 9.02 Gbits/sec 235 677 KBytes
[ 4] 4.00-5.00 sec 1.08 GBytes 9.28 Gbits/sec 61 600 KBytes
[ 4] 5.00-6.00 sec 1.07 GBytes 9.16 Gbits/sec 113 667 KBytes
[ 4] 6.00-7.00 sec 1.08 GBytes 9.30 Gbits/sec 88 837 KBytes
[ 4] 7.00-8.00 sec 1.05 GBytes 9.00 Gbits/sec 179 800 KBytes
[ 4] 8.00-9.00 sec 1.08 GBytes 9.29 Gbits/sec 88 660 KBytes
[ 4] 9.00-10.00 sec 1.07 GBytes 9.16 Gbits/sec 117 580 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 10.7 GBytes 9.21 Gbits/sec 1122 sender
[ 4] 0.00-10.00 sec 10.7 GBytes 9.21 Gbits/sec receiver

iperf Done.
mello@olinda:~$ iperf3 -c nas -w 64K
Connecting to host nas, port 5201
[ 4] local 10.10.10.60 port 57852 connected to 10.10.10.220 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 1015 MBytes 8.52 Gbits/sec 0 189 KBytes
[ 4] 1.00-2.00 sec 1021 MBytes 8.57 Gbits/sec 0 189 KBytes
[ 4] 2.00-3.00 sec 948 MBytes 7.95 Gbits/sec 0 189 KBytes
[ 4] 3.00-4.00 sec 1006 MBytes 8.44 Gbits/sec 0 189 KBytes
[ 4] 4.00-5.00 sec 1.00 GBytes 8.60 Gbits/sec 0 189 KBytes
[ 4] 5.00-6.00 sec 1014 MBytes 8.50 Gbits/sec 0 189 KBytes
[ 4] 6.00-7.00 sec 1016 MBytes 8.52 Gbits/sec 0 189 KBytes
[ 4] 7.00-8.00 sec 1019 MBytes 8.55 Gbits/sec 0 189 KBytes
[ 4] 8.00-9.00 sec 1018 MBytes 8.54 Gbits/sec 0 189 KBytes
[ 4] 9.00-10.00 sec 1020 MBytes 8.56 Gbits/sec 0 189 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 9.86 GBytes 8.47 Gbits/sec 0 sender
[ 4] 0.00-10.00 sec 9.86 GBytes 8.47 Gbits/sec receiver

iperf Done.
mello@olinda:~$ iperf3 -c nas -w 512 K
Connecting to host nas, port 5201
[ 4] local 10.10.10.60 port 57938 connected to 10.10.10.220 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 3.50 KBytes 28.7 Kbits/sec 0 5.00 KBytes
[ 4] 1.00-2.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 2.00-3.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 3.00-4.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 4.00-5.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 5.00-6.00 sec 2.00 KBytes 16.4 Kbits/sec 0 5.00 KBytes
[ 4] 6.00-7.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 7.00-8.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 8.00-9.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
[ 4] 9.00-10.00 sec 2.50 KBytes 20.5 Kbits/sec 0 5.00 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 25.5 KBytes 20.9 Kbits/sec 0 sender
[ 4] 0.00-10.00 sec 24.0 KBytes 19.7 Kbits/sec receiver

iperf Done.
mello@olinda:~$ iperf3 -c nas -w 1500 K
Connecting to host nas, port 5201
[ 4] local 10.10.10.60 port 58062 connected to 10.10.10.220 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 500 MBytes 4.19 Gbits/sec 0 132 KBytes
[ 4] 1.00-2.00 sec 503 MBytes 4.22 Gbits/sec 0 132 KBytes
[ 4] 2.00-3.00 sec 503 MBytes 4.22 Gbits/sec 0 132 KBytes
[ 4] 3.00-4.00 sec 503 MBytes 4.22 Gbits/sec 0 132 KBytes
[ 4] 4.00-5.00 sec 503 MBytes 4.22 Gbits/sec 0 132 KBytes
[ 4] 5.00-6.00 sec 499 MBytes 4.18 Gbits/sec 0 132 KBytes
[ 4] 6.00-7.00 sec 504 MBytes 4.23 Gbits/sec 0 132 KBytes
[ 4] 7.00-8.00 sec 502 MBytes 4.21 Gbits/sec 0 132 KBytes
[ 4] 8.00-9.00 sec 505 MBytes 4.24 Gbits/sec 0 132 KBytes
[ 4] 9.00-10.00 sec 504 MBytes 4.23 Gbits/sec 0 132 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 4.91 GBytes 4.22 Gbits/sec 0 sender
[ 4] 0.00-10.00 sec 4.91 GBytes 4.22 Gbits/sec receiver

iperf Done.

 

[melloa]

Two days running

 

[l@e]

Is that normal 40+ deg for spf? Never watched mine

 

[melloa]

From its specs:
Tested ambient temperature-40°C to 70°C

 

[cheezystix]

I am using 10GBe switch MikroTik CRS305-1G-4S
along with 10GBe card(s) Mellanox Connectx-2 PCI-E 10GBe MNPA19-XTR
and 10GBe cable(s) 10G SFP+ DAC Cables

testing speeds from Windows to FreeNAS this is the best I can muster

Still better than my 1GBe network but not maxed out (for some reason)