Hey all ... Got a system with 4 x 1GB connections on it. It used to be setup with igb0/1 bound as LAGG0, and igb2/3 bound as LAGG1
In trying to improve my config, I removed the LAGG1 config, so that igb2/3 were each separate interfaces. I then set IP's for each interface.
igb2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:1b:21:36:65:ca
inet 172.16.2.5 netmask 0xffffff00 broadcast 172.16.2.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
igb3: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:1b:21:36:65:ca
inet 172.16.3.5 netmask 0xffffff00 broadcast 172.16.3.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
The trouble is, since killing the LAGG, igb2/3 still show the same MAC address. I have rebooted and such, so there isn't something left over ... I also added another dual card to the system, giving me igb4/5.
igb4: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:1b:21:37:a6:8c
inet 172.16.4.5 netmask 0xffffff00 broadcast 172.16.4.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
igb5: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:1b:21:37:a6:8d
inet 172.16.5.5 netmask 0xffffff00 broadcast 172.16.5.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
As you can see, igb4/5 each have unique MAC addresses. What I'm seeing is that I'm constantly getting disconnects from my ESX hosts via iSCSI hitting the IP's n the igb2/3 interfaces, which I'm certain is directly a cause of the mirrored MAC, and flapping.
Anyone know where in FreeNAS 9.10 that this config might be stored? Im sure it's something left in a config file from the LAGG1 creation.
In trying to improve my config, I removed the LAGG1 config, so that igb2/3 were each separate interfaces. I then set IP's for each interface.
igb2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:1b:21:36:65:ca
inet 172.16.2.5 netmask 0xffffff00 broadcast 172.16.2.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
igb3: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:1b:21:36:65:ca
inet 172.16.3.5 netmask 0xffffff00 broadcast 172.16.3.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
The trouble is, since killing the LAGG, igb2/3 still show the same MAC address. I have rebooted and such, so there isn't something left over ... I also added another dual card to the system, giving me igb4/5.
igb4: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:1b:21:37:a6:8c
inet 172.16.4.5 netmask 0xffffff00 broadcast 172.16.4.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
igb5: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
ether 00:1b:21:37:a6:8d
inet 172.16.5.5 netmask 0xffffff00 broadcast 172.16.5.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
As you can see, igb4/5 each have unique MAC addresses. What I'm seeing is that I'm constantly getting disconnects from my ESX hosts via iSCSI hitting the IP's n the igb2/3 interfaces, which I'm certain is directly a cause of the mirrored MAC, and flapping.
Anyone know where in FreeNAS 9.10 that this config might be stored? Im sure it's something left in a config file from the LAGG1 creation.
