[Support] - Networking general questions

Zwck · Jun 1, 2017

Hello Everybody,

I am quite new to FreeNAS 11 (9.10.3Rc3) and my profession has nothing to do with networks or infrastructure in general so please bear with me if i don't use the correct terminology.
My system has 2 physical network interfaces, (igb0 and igb1) that after a fresh installation both work somehow on DHCP, and are plugged into the same network switch that does not have the capability of link aggregation. So, I set a static ip and subnet mask to igb1 (192.168.0.3 / 24) and igb0 leave with the DHCP settings.

I can access the interface on the static ip as well as the dynamic ip, which is fine. I am aware that it is not good networking practice!
Q1: Is there a good practice on how to proceed from here?

If i deactivate one of the NICs, by unplugging a cable or deactivating it in the bios, i run into the following problems.
I have 3 jails running that connect to bridge1 together with igb1. Also a byhyve VM is running that automatically creates a bridge0 and tap0 interface, in order to be accessible to me i need to connect an interface to bridge0, but igb1 is already in use. So inorder to get on the line i can either create a vlan01 adapter and connect that to the bridge0 or delete/destroy bridge0 and connect tap0 to bridge1? Anyway after every restart i have to manually connect tap0 again..
Q2: whats the way to do it appropriately?

Eventually, i'd like to get a switch with link aggregation.
Which would leave me in a way
Q3: is that alright?

Code:

																		
igb0 --			   --- vlan0 ----- bridge0 --- tap0 to tapN ....  from bhyve VMs
	   >--- lagg0 ---<
igb1 --			   --- vlan1 ----- bridge1 --- epair0a to epaiNa ..... from  jails

What i am currently running is of course the worst possible solution.

Code:

																		
igb0 (dynamic)* ----- bridge0 --- tap0 to tapN ....  from bhyve VMs
igb1 (static)*----- bridge1 --- epair0a to epaiNa ..... from  jails

* both 192.168.0.X/24

cheers and thanks
-z

CookiesLikeWhoa · Jun 1, 2017

Move one of the links to a different subnet. NIC 1: 192.168.0.X/24 and NIC 2: 192.168.1.X/24. Change the IP address of the jails to reflect the new subnet and have your router route traffic between the two subnets/the intawebz.

Zwck · Jun 1, 2017

CookiesLikeWhoa said:
Move one of the links to a different subnet. NIC 1: 192.168.0.X/24 and NIC 2: 192.168.1.X/24. Change the IP address of the jails to reflect the new subnet and have your router route traffic between the two subnets/the intawebz.

I am not sure if my consumer router can do that.

CookiesLikeWhoa · Jun 1, 2017

What kind of router is that? Even the cheapest of routers should be able to route traffic. Unless you're just using the modem.

SweetAndLow · Jun 1, 2017

Why not just one 1nic? That's what I would do. You say you are not fluent in networking but you have a very complicated setup that no one else bothers with. Plug one nic in, create your jails and vms and be happy.

Sent from my Nexus 5X using Tapatalk

Zwck · Jun 1, 2017

SweetAndLow said:
Why not just one 1nic? That's what I would do. You say you are not fluent in networking but you have a very complicated setup that no one else bothers with. Plug one nic in, create your jails and vms and be happy.

Sent from my Nexus 5X using Tapatalk

OK, but than I would need to create a vlan adapter to connect to one of the bridges right?

SweetAndLow · Jun 1, 2017

Zwck said:
OK, but than I would need to create a vlan adapter to connect to one of the bridges right?

No you don't need anything special. Why would you need a vlan adapter? I don't even know what you mean by vlan adapter.

Zwck · Jun 1, 2017

SweetAndLow said:
No you don't need anything special. Why would you need a vlan adapter? I don't even know what you mean by vlan adapter.

so you would do it this way basically

Code:

					  --- epair0a to epaiNa ..... from jails
igb1  ----- bridge0-<
					 --- tap0 ..... from byhve

SweetAndLow · Jun 1, 2017

Zwck said:
so you would do it this way basically

Code:
--- epair0a to epaiNa ..... from jails igb1 ----- bridge0-< --- tap0 ..... from byhve

Sure but no you would not do anything. Pretend that stuff doesn't exist. You don't have to do anything to make it work. it just works.

Zwck · Jun 1, 2017

SweetAndLow said:
Sure but no you would not do anything. Pretend that stuff doesn't exist. You don't have to do anything to make it work. it just works.

Unfortunately when you setup an behyve vm it creates a new bridge that does not connect.

SweetAndLow · Jun 1, 2017

Zwck said:
Unfortunately when you setup an behyve vm it creates a new bridge that does not connect.

it should and if not you got something messed up. Here I just created a new vm and this is what things look like. I did zero networking nonsense, just new freenas install and created a single bhyve vm. I also added a jail to see what happens and got the second result in the screen shot below. Hope this helps make things more clear for you on what it should look like. Again I did not touch any networking things, i just clicked buttons in the gui.

I still have no clue what you are talking about. Can you describe what you want to do better and why you think you want to do it?

EDIT: i reread your first post and I think you need to remove bridge1 and all the stuff associated with it. This will probably fix your tap0 issue and make it auto connect.

Zwck · Jun 1, 2017

SweetAndLow said:
...
EDIT: i reread your first post and I think you need to remove bridge1 and all the stuff associated with it. This will probably fix your tap0 issue and make it auto connect.

I tried the following: turned off the jails/plugins destroyed the bridge1 (the one the jails are on) then stopped the vm destroyed the bridge0, started the vm and started the jails.

Then i get have two bridges one that can connect to the interwebz and one that cant.

SweetAndLow · Jun 1, 2017

How did you destroy bridge1? I don't think that is possible in the gui.

Zwck · Jun 1, 2017

SweetAndLow said:
How did you destroy bridge1? I don't think that is possible in the gui.

ifconfig bridge1 destroy

Zwck · Jun 1, 2017

Ok you were right, i also had to remove each adapter that were created from the jails. (which i did not stop this time but just rebooted after)

Code:

ifconfig
igb0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
		options=2400b9<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,VLAN_HWTSO,RXCSUM_IPV6>
		ether 0c:c4:7a:c5:f5:ee
		inet 192.168.0.2 netmask 0xffffff00 broadcast 192.168.0.255
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect (1000baseT <full-duplex>)
		status: active
igb1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1504
		options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
		ether 0c:c4:7a:c5:f5:ef
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect (1000baseT <full-duplex>)
		status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
		options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
		inet6 ::1 prefixlen 128
		inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
		inet 127.0.0.1 netmask 0xff000000
		nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
		groups: lo
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
		description: iohyve-bridge
		ether 02:ac:68:db:e5:00
		nd6 options=1<PERFORMNUD>
		groups: bridge
		id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
		maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
		root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
		member: tap0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
				ifmaxaddr 0 port 5 priority 128 path cost 2000000
		member: igb0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
				ifmaxaddr 0 port 1 priority 128 path cost 20000
tap0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
		description: iohyve-ubuntu16
		options=80000<LINKSTATE>
		ether 00:bd:e9:d4:fd:00
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect
		status: active
		groups: tap
		Opened by PID 71155

after restarting the VMs

Code:

bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
		description: iohyve-bridge
		ether 02:ac:68:db:e5:00
		nd6 options=1<PERFORMNUD>
		groups: bridge
		id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
		maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
		root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
		member: epair2a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
				ifmaxaddr 0 port 8 priority 128 path cost 2000
		member: epair1a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
				ifmaxaddr 0 port 7 priority 128 path cost 2000
		member: epair0a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
				ifmaxaddr 0 port 6 priority 128 path cost 2000
		member: tap0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
				ifmaxaddr 0 port 5 priority 128 path cost 2000000
		member: igb0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
				ifmaxaddr 0 port 1 priority 128 path cost 20000
tap0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
		description: iohyve-ubuntu16
		options=80000<LINKSTATE>
		ether 00:bd:e9:d4:fd:00
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect
		status: active
		groups: tap
		Opened by PID 71155
epair0a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
		options=8<VLAN_MTU>
		ether 02:ff:e0:00:06:0a
		nd6 options=1<PERFORMNUD>
		media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
		status: active
		groups: epair
epair1a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
		options=8<VLAN_MTU>
		ether 02:ff:e0:00:07:0a
		nd6 options=1<PERFORMNUD>
		media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
		status: active
		groups: epair
epair2a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
		options=8<VLAN_MTU>
		ether 02:ff:e0:00:08:0a
		nd6 options=1<PERFORMNUD>
		media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
		status: active
		groups: epair

thank you!

Zwck · Jun 1, 2017

will see if that solves the problems i had!
thank you again!

SweetAndLow · Jun 1, 2017

Zwck said:
ifconfig bridge1 destroy

Never use the cli to do anything. With FreeNAS you use the GUI.

Sent from my Nexus 5X using Tapatalk

danb35 · Jun 1, 2017

SweetAndLow said:
Never use the cli to do anything. With freenas you is the GUI.

...and if you can't destroy the interface in the GUI, as you said earlier, what are you then supposed to do?

Important Announcement for the TrueNAS Community.

[Support] - Networking general questions

Zwck

Patron

CookiesLikeWhoa

Patron

Zwck

Patron

CookiesLikeWhoa

Patron

SweetAndLow

Sweet'NASty

Zwck

Patron

SweetAndLow

Sweet'NASty

Zwck

Patron

SweetAndLow

Sweet'NASty

Zwck

Patron

SweetAndLow

Sweet'NASty

Attachments

Zwck

Patron

SweetAndLow

Sweet'NASty

Zwck

Patron

Zwck

Patron

Zwck

Patron

SweetAndLow

Sweet'NASty

danb35

Hall of Famer

Similar threads