Ok, so my setup is like this:
I have 4 dell r710 servers with four 1Gb ports each. One server is running Truenas, the other 3 are running Proxmox. In order to isolate the traffic between each of the four servers from my household network I created a bridge (bridge192) on each server and added the last 3 physical ports as members. Each of the last three physical ports on each of the four servers connect directly to one of the remaining three servers so that each server has a direct 1Gb connection to all of the others.
The proxmox servers can all communicate (ping) each other with this configuration but not the Truenas server, likewise the Truenas server cannot ping any of the other servers over the bridged connection. This leads me to believe I have a configuration problem with my Truenas bridge. I set it up using the GUI interface.
My bridge IP addresses for the servers are (addresses are not assigned to bridge members):
Proxmox1: 192.113.1.1/24
Proxmox2: 192.113.1.2/24
Proxmox3: 192.113.1.3/24
Truenas : 192.113.1.10/24
Version: TrueNAS-12.0-U4.1
Output of ifconfig:
If anyone can shed some light on why Truenas doesnt want to talk I would appreciate it. I suspect I am overlooking a BSD specific config option, or that maybe BSD doesnt like the direct peer-to-peer connection with the other servers, but im not sure and dont know how to check it.
I have 4 dell r710 servers with four 1Gb ports each. One server is running Truenas, the other 3 are running Proxmox. In order to isolate the traffic between each of the four servers from my household network I created a bridge (bridge192) on each server and added the last 3 physical ports as members. Each of the last three physical ports on each of the four servers connect directly to one of the remaining three servers so that each server has a direct 1Gb connection to all of the others.
The proxmox servers can all communicate (ping) each other with this configuration but not the Truenas server, likewise the Truenas server cannot ping any of the other servers over the bridged connection. This leads me to believe I have a configuration problem with my Truenas bridge. I set it up using the GUI interface.
My bridge IP addresses for the servers are (addresses are not assigned to bridge members):
Proxmox1: 192.113.1.1/24
Proxmox2: 192.113.1.2/24
Proxmox3: 192.113.1.3/24
Truenas : 192.113.1.10/24
Version: TrueNAS-12.0-U4.1
Output of ifconfig:
Code:
root@truenas[~]# ifconfig bce0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE> ether 84:2b:2b:76:97:5a inet 10.113.2.10 netmask 0xffffff00 broadcast 10.113.2.255 media: Ethernet autoselect (1000baseT <full-duplex>) status: active nd6 options=9<PERFORMNUD,IFDISABLED> bce1: flags=8902<BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE> ether 84:2b:2b:76:97:5c media: Ethernet autoselect nd6 options=1<PERFORMNUD> bce2: flags=8902<BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE> ether 84:2b:2b:76:97:5e media: Ethernet autoselect nd6 options=1<PERFORMNUD> bce3: flags=8902<BROADCAST,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500 options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE> ether 84:2b:2b:76:97:60 media: Ethernet autoselect nd6 options=1<PERFORMNUD> lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384 options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6> inet6 ::1 prefixlen 128 inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5 inet 127.0.0.1 netmask 0xff000000 groups: lo nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL> pflog0: flags=0<> metric 0 mtu 33160 groups: pflog bridge192: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 ether 02:bf:01:42:0b:c0 inet 192.113.1.10 netmask 0xffffff00 broadcast 192.113.1.255 id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15 maxage 20 holdcnt 6 proto stp-rstp maxaddr 2000 timeout 1200 root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0 member: bce1 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP> ifmaxaddr 0 port 2 priority 128 path cost 55 member: bce3 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP> ifmaxaddr 0 port 4 priority 128 path cost 55 member: bce2 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP> ifmaxaddr 0 port 3 priority 128 path cost 55 groups: bridge nd6 options=9<PERFORMNUD,IFDISABLED>
If anyone can shed some light on why Truenas doesnt want to talk I would appreciate it. I suspect I am overlooking a BSD specific config option, or that maybe BSD doesnt like the direct peer-to-peer connection with the other servers, but im not sure and dont know how to check it.