Any UBNT users out there try the new 10G Unifi switch?

[depasseg]

I just heard about a 16 port 10GbE Ubiquiti Unifi switch for $300 as part of their beta program. Anyone try one?

 

[Ericloewe]

Ooh, that sounds interesting. No SFP at that price, I imagine, which is a shame, since I could use an SFP (not really plus... yet.) port.

 

[melloa]

Anyone try one?

No mula for that, but I can send you my mailing address :D

No, using my old Cisco Gigabit with my Ubiquiti APs.

 

[depasseg]

Ooh, that sounds interesting. No SFP at that price, I imagine, which is a shame, since I could use an SFP (not really plus... yet.) port.

Nope, those are separate.
But UBNT also have SFP's:
https://www.ubnt.com/accessories/fiber-modules-cable/
$150 for 20:
https://www.streakwave.com/itemdesc.asp?ic=UF-MM-1G-20
or $17 for 2:
https://www.streakwave.com/itemdesc.asp?ic=UF-MM-1G

 

[NorCalTechSupport]

Are we talking about the Ubiquiti Networks ES-16-XG EdgeSwitch 16 10G 16-Port Managed Aggregation Switch at $599.00
-12 x SFP+ Ports .......... so I would need $73 cable listed below to plug into the FreeNAS card that is really a Chelsio card
-4 x 10G RJ-45 Ports
-1 x RJ-45 Serial Console Port
-Non-Blocking Throughput: 160 Gbp/s
Has anyone tried this with the FreeNAS Mini 10Gb Dual-Port Upgrade SFP+ Ports Twinax/DAC by IXSYSTEMS, INC ….. $ 249.99 and a Chelsio TAPCABLE3M 3 Meter Twinax Passive Cable ($73) to connect the NIC to the switch?

I hope someone has tried this and had good results. This would bring 10Gb/s networking into the affordable range.

 

[depasseg]

Is similar to that, but it's the Unifi variant (not edge switch) and is half that price because of the beta phase.

 

[NorCalTechSupport]

Does it work well enough to think about production environment? Did you by chance try the Chelso 10Gb NIC?

Are you connected via SFP or RJ45?

Thanks for any info.

 

[depasseg]

I don't have one yet.

I do have the Chelsio hooked up to a Dell (force 10) S4810 though and it's working well. I'm using both SFP+'s and twin-ax.

 

[NorCalTechSupport]

Thanks for your post. I am writing a proposal to my boss to let me evaluate 10Gb and your switch is not one of the 3 called out by Chelsio and your 10Gb switch is working fine. I just looked up your switch and it may be in my budget but I would love to try the Ubiquiti ES-16-XG EdgeSwitch.

Here is what the Chelsio website has to say about supported switches:
3.3.2. Supported Switches
--------------------------
- Cisco Nexus 5010 with 5.1(3)N1(1a) firmware
- Arista DCS-7124S-F
- Mellanox SX_PPC_M460EX
NOTE: Other platforms/switches have not been tested and are not guaranteed to work.

Here is the whole document sent to me by Chelsio
http://service.chelsio.com/store2/T5//Unified%20Wire%20(NIC,TOE,vNIC,iWARP,iSCSI,FCoE,WD-UDP)//Linux//ChelsioUwire-2.12.0.3/README.txt

 

[c32767a]

I just heard about a 16 port 10GbE Ubiquiti Unifi switch for $300 as part of their beta program. Anyone try one?

I don't have any experience with that specific model, but my general experience with Ubiquity is that if their product works for you out of the box, you'll be fine, but if you run into a bug or missing feature, I wouldn't hold my breath waiting for an update.

 

[NorCalTechSupport]

I contacted Ubiquity and asked "Hi my question is about your new 10G ports, the high-performance EdgeSwitch. have you tested it with Chelsio 10Gb NIC cards" and "In particular I am wondering about the Chelsio T520-CR or the T540-CR and how it works with the the Ubiquiti Networks ES-16-XG EdgeSwitch" and the response gives me hope but inconclusive:
The Chelsio / JDSU - PLRXPL-SC-S43-42B (10g sfp+) is on the list for the EdgeRouter Pro, but not for the EdgeSwitch. We haven’t tried it on an EdgeSwitch so, unfortunately we can’t guarantee it will work but it should.

Me being an optimist I am going to take that is it will work and a Ubiquity 10Gb switch and 2 Chelsio 10Gb NICs and a pair of TAPCABLE (10G) for about $1,100 I think it is worth the risk.

 

[NorCalTechSupport]

Actually I am still researching the Chelsio TAPCABLE 10G so it will be a wee bit more than $1,100 as two of these will be needed and the price is not included.

 

[depasseg]

I just got the switch hooked up and running with the T420. Things seem to be running fine. The biggest issues I've seen are optics incompatibilities.

 

[Heaven73]

I just got the switch hooked up and running with the T420. Things seem to be running fine. The biggest issues I've seen are optics incompatibilities.

connected with a TAP/Twinax Cable?

 

[nev_neo]

I have one and i've connected most of my homelab to it via mellanox connectx-2 cards. Some of the DAC's (cisco 3M) work, some dont. Its very finicky with DAC's, but SFP+'s work pretty well.
right now the only problem I have is connecting my main Freenas box to 10G. Its running the Xeon-D 1521 motherboard with onboard 10G ethernet.
I've never had them connect at full 10G as yet.

Does anyone know of a way to force 10G duplex in freenas ?

 

[Borja Marcos]

I have one and i've connected most of my homelab to it via mellanox connectx-2 cards. Some of the DAC's (cisco 3M) work, some dont. Its very finicky with DAC's, but SFP+'s work pretty well.
right now the only problem I have is connecting my main Freenas box to 10G. Its running the Xeon-D 1521 motherboard with onboard 10G ethernet.
I've never had them connect at full 10G as yet.

Does anyone know of a way to force 10G duplex in freenas ?

10GbE half duplex does not exist.

I guess you are running into this bug in the ixgbe driver which was fixed recently. The spaghetti media detection code didn't identify DA cables properly and the "duplexness" became undefined.

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=150249

However, don't worry. The interface is running in full duplex although it's not described as such in the operating system. It will only affect LACP, which will refuse to work on an interface not marked as full duplex.

 

[nev_neo]

10GbE half duplex does not exist.

I guess you are running into this bug in the ixgbe driver which was fixed recently. The spaghetti media detection code didn't identify DA cables properly and the "duplexness" became undefined.

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=150249

However, don't worry. The interface is running in full duplex although it's not described as such in the operating system. It will only affect LACP, which will refuse to work on an interface not marked as full duplex.

Thats not what i'm asking this for.
I'm testing out some beta firmware on the 10G switch, hoping that it would finally connect to 10gbase-T ethernet connections. One of the other users confirmed being able to connect and maintain 10G connection on windows by forcing full-duplex and 10G in the connection. In other words, its not trying to auto-negotiate the connection.

 

[Borja Marcos]

Thats not what i'm asking this for.
I'm testing out some beta firmware on the 10G switch, hoping that it would finally connect to 10gbase-T ethernet connections. One of the other users confirmed being able to connect and maintain 10G connection on windows by forcing full-duplex and 10G in the connection. In other words, its not trying to auto-negotiate the connection.

Oops sorry. I assumed that you were seeing something similar to what I saw on FreeBSD when using DA twinax cables. It showed media as "unknown" on ifconfig, and neither half or full duplex.

It's odd to need forcing full duplex on 10 GbE, unless I am very wrong half duplex 10 GbE simply does not exist.

 

[Ericloewe]

I have one and i've connected most of my homelab to it via mellanox connectx-2 cards. Some of the DAC's (cisco 3M) work, some dont. Its very finicky with DAC's, but SFP+'s work pretty well.
right now the only problem I have is connecting my main Freenas box to 10G. Its running the Xeon-D 1521 motherboard with onboard 10G ethernet.
I've never had them connect at full 10G as yet.

Does anyone know of a way to force 10G duplex in freenas ?

Then something is wrong and forcing things, if it's even possible, is probably a bad idea. GbE and up must autonegotiate anything beyond 100Mb/s.

It's odd to need forcing full duplex on 10 GbE, unless I am very wrong half duplex 10 GbE simply does not exist.

It doesn't, much like was the case for 1GbE. All pairs are transmit and receive simultaneously.

I'm rather surprised the Windows driver even allows for such things to be forced.

I have one and i've connected most of my homelab to it via mellanox connectx-2 cards. Some of the DAC's (cisco 3M) work, some dont. Its very finicky with DAC's, but SFP+'s work pretty well.
right now the only problem I have is connecting my main Freenas box to 10G. Its running the Xeon-D 1521 motherboard with onboard 10G ethernet.
I've never had them connect at full 10G as yet.

Does anyone know of a way to force 10G duplex in freenas ?

Have you tried different cables? Different hardware at either end?
10GBase-T is very sensitive to bad cables and requires at least Cat.6 for short runs, Cat.6a for 100m.