SOLVED Bridging 10G ports for 10G subnet?

[EvanVanVan]

I just built a second TrueNAS server and I'm trying to figure out how to create a 10G subnet between it, my desktop computer and my orignal (let's call it FreeNAS) server (through the TrueNAS server). This will be seperate than my regular 192.178.74.1 1G subnet.

Originally, I added a 10G NIC to my FreeNAS server and gave it a static IP of 10.10.10.1 and added a 10G NIC to my Desktop with a static IP of 10.10.10.2. That worked well and I got 10G speeds over SMB between them.

The new TrueNAS server has two 10G ports. I'm trying to bridge them to get 10G speeds from Desktop (10.10.10.2) > TrueNAS (10.10.10.3) > FreeNAS (10.10.10.1) without having to buy a $300 10G switch. I created a 10G bridge (br10) added two the two 10G NICs to it and gave it a static IP of 10.10.10.3/24. I can connect to TrueNAS (10.10.10.3) from my Desktop (10.10.10.2) but I can't connect to the FreeNAS (10.10.10.1) server from the Desktop (10.10.10.2).

Additionally, I setup linux jails on the TrueNAS server using jailmkr and have the main NIC host in bridge mode so that each jail has it's own IP. This is just for more information because there seemed to be some conflicts between the two bridges when I was trying different configurations to get it to work.

Any help?

Thanks

Edit: Nm, got it figured out. I needed to add multiple IPs to the br10 bridge. Now it's working.

 

[Kailee71]

... or add no ip addresses to the bridge itself or the bridge members at all. This is how mine's set up and makes the "test settings" step much quicker. Also during the "test settings" step you don't have to reconnect to the web gui so it's just overall much easier...

 

[EvanVanVan]

Thank you, yeah something still seems a little finicky with my setup. It works but can take a while to reconnect after restarting (which fortunately now that everything is up and running shouldn't happen too often).

TrueNAS to FreeNAS seems to connect pretty quickly, but Windows to TrueNAS can take a while from what I've seen. I also had to "refresh" the initial connection when it got stuck one time by disconnecting and reconnecting the ethernet cable. It worked but obviously that's not good in the long term.

Anyone know why, as TrueNAS is starting up (with a monitor connected to it), it loads successfully and displays the [1-9] CLI options. Then, 15-20 seconds later the bridge's initialize (and information flashes on the screen momentarily)? Anyway to speed that up to earlier in the boot process?

 

[MrGuvernment]

If you have a place to put a switch and not right beside you..

Brocade ICX Series (cheap & powerful 10gbE/40gbE switching)

NOTE #1: do not PM me with switch questions, they will be ignored - post them in this public thread, where hundreds of other members can also answer, and the answer will be public for future users NOTE #2 06-22-2023: Yes, this post is still up to date and nothing has changed: in fact judging by...

forums.servethehome.com

Brocade Icx6450 for sale | eBay

Get the best deals for Brocade Icx6450 at eBay.com. We have a great online selection at the lowest prices with Fast & Free shipping on many items!

www.ebay.com

Or very loud :D

Brocade Icx6610 for sale | eBay

Get the best deals for Brocade Icx6610 at eBay.com. We have a great online selection at the lowest prices with Fast & Free shipping on many items!

www.ebay.com

 

[danb35]

Those Brocade switches are amazingly capable for the price--but yes, the ICX6610 can be a screamer. The 6450 isn't bad though.

 

[MrGuvernment]

Ya, just got a 6610 myself but havent yet done a fan mod others are doing with the top panel to help keep the temps lower which in turn stop the screaming fans from kicking into high! So still using my 6450.