SOLVED vnet in iocage jail not working - ESXi setting

kpeng

Dabbler
Joined
May 16, 2016
Messages
11
I recently move my freenas 11.2-U8 to an ESXi host. I made a backup of config before the move, the freenas was also 11.2-U8 before the move on a BM. After I recreated the pool, restore all the data, restore the config I saved. Now the vnet on all the iocage jail stop working. I checked the bridge includes my real NIC 'vmx1', from the jail, I can ping 10.0.0.100 which is the vmx1 IP. It can ping IP of other jail as well. But it cannot ping the gateway 10.0.0.1. If I change the jail network to shared IP, it works fine. I don't know what went wrong here, the vnet was working before the move. They are on same freenas version before and after the move. I even created a new jail to do some testing, but vnet just doesn't work.

my ifconfig from host:
Code:
root@freenas:~ # ifconfig -a
vmx0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=60039b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,TSO6,RXCSUM_IPV6,TXCSUM_IPV6>
        ether 00:0c:29:02:68:9f
        hwaddr 00:0c:29:02:68:9f
        inet 10.55.0.1 netmask 0xffffff00 broadcast 10.55.0.255
        nd6 options=9<PERFORMNUD,IFDISABLED>
        media: Ethernet autoselect
        status: active
vmx1: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=200099<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,RXCSUM_IPV6>
        ether 00:0c:29:02:68:a9
        hwaddr 00:0c:29:02:68:a9
        inet 10.0.0.100 netmask 0xffffff00 broadcast 10.0.0.255
        nd6 options=9<PERFORMNUD,IFDISABLED>
        media: Ethernet autoselect
        status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
        inet 127.0.0.1 netmask 0xff000000
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: lo
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        ether 02:9c:ae:67:9b:00
        nd6 options=9<PERFORMNUD,IFDISABLED>
        groups: bridge
        id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
        maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        member: vnet0:8 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 7 priority 128 path cost 2000
        member: vnet0:7 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 6 priority 128 path cost 2000
        member: vmx1 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 2 priority 128 path cost 2000
tap0: flags=8803<UP,BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
        description: Attached to openwrt
        options=80000<LINKSTATE>
        ether 00:bd:97:32:ff:00
        hwaddr 00:bd:97:32:ff:00
        nd6 options=1<PERFORMNUD>
        media: Ethernet autoselect
        status: no carrier
        groups: tap
vnet0:7: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        description: associated with jail: tautulli as nic: epair0b
        options=8<VLAN_MTU>
        ether 64:00:6a:46:b0:16
        hwaddr 02:8b:d0:00:06:0a
        nd6 options=1<PERFORMNUD>
        media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
        status: active
        groups: epair
vnet0:8: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        description: associated with jail: tmp as nic: epair0b
        options=8<VLAN_MTU>
        ether 64:00:6a:35:53:0a
        hwaddr 02:8b:d0:00:07:0a
        nd6 options=1<PERFORMNUD>
        media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
        status: active
        groups: epair
root@freenas:~ #


ifconfig from the jail:
Code:
root@tmp:/ # ifconfig -a
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
        inet 127.0.0.1 netmask 0xff000000
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: lo
epair0b: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=8<VLAN_MTU>
        ether 64:00:6a:35:53:0b
        hwaddr 02:8b:d0:00:08:0b
        inet 10.0.0.50 netmask 0xffffff00 broadcast 10.0.0.255
        nd6 options=1<PERFORMNUD>
        media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
        status: active
        groups: epair
root@tmp:/ #
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,776
Did you explicitly permit "promiscuous mode" for the network interface of your VM in ESXi?

HTH,
Patrick
 

kpeng

Dabbler
Joined
May 16, 2016
Messages
11
You are a godsent, after enable that on my ESXi, everything works perfectly now. I knew that is something simple. Thank you very much
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,776
Please set the SOLVED tag for the thread and change the title to indicate it applies to ESXi - thanks!
 
Top