Jail has no NIC after recent update

[Crispin]

Hi folks,

I suffered from the "DHCP not working in jails" bug on the second to last update.
Doing a simple "dhclient interface_name" worked fine.
I noticed in the last update that this was addressed but it seems to be worse?

Any jail I now add does not get a NIC.

ifconfig of host:

Code:

em0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=40098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,VLAN_HWTSO>
    ether 2c:27:d7:15:81:44
    inet 10.10.50.20 netmask 0xffffff00 broadcast 10.10.50.255 
    inet 10.10.50.149 netmask 0xffffff00 broadcast 10.10.50.255 
    nd6 options=9<PERFORMNUD,IFDISABLED>
    media: Ethernet autoselect (1000baseT <full-duplex>)
    status: active
bge0: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=c019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
    ether 38:ea:a7:a1:0b:60
    nd6 options=9<PERFORMNUD,IFDISABLED>
    media: Ethernet autoselect
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
    options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
    inet6 ::1 prefixlen 128 
    inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 
    inet 127.0.0.1 netmask 0xff000000 
    nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
    ether 02:1c:85:41:43:00
    nd6 options=1<PERFORMNUD>
    id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
    maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
    root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
    member: epair8a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 13 priority 128 path cost 2000
    member: epair7a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 12 priority 128 path cost 2000
    member: epair6a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 11 priority 128 path cost 2000
    member: epair5a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 10 priority 128 path cost 2000
    member: epair4a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 9 priority 128 path cost 2000
    member: epair3a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 8 priority 128 path cost 2000
    member: epair2a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 7 priority 128 path cost 2000
    member: epair1a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 6 priority 128 path cost 2000
    member: epair0a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 5 priority 128 path cost 2000
    member: em0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
           ifmaxaddr 0 port 1 priority 128 path cost 20000
epair0a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:ff:60:00:05:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
epair1a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:ff:60:00:06:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
epair2a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:ff:60:00:07:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
epair3a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:ff:60:00:08:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
epair4a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:ff:60:00:09:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
epair5a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:ff:60:00:0a:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
epair6a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:ff:60:00:0b:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
epair7a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:ff:60:00:0c:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
epair8a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:ff:60:00:0d:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active

ifconfig of new, test jail

Code:

root@xxx:/ # ifconfig
lo0: flags=8008<LOOPBACK,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
root@xxx:/ #

Is this a known issue? I cannot find anything specific to this (loads on the DHCP issue though)
Is there a short-term fix I can do to tide me over?


My system:

System Information
Hostname nas.local Edit
Build FreeNAS-9.10.1 (d989edd)
Platform AMD Turion(tm) II Neo N54L Dual-Core Processor
Memory 16322MB
System Time Sun Aug 21 09:53:22 BST 2016
Uptime 9:53AM up 15 days, 11:28, 1 user
Load Average 0.76, 0.70, 0.62



TIA
Crispin

 

[joeschmuck]

Please read the previous forum postings. Check your MAC address.

 

[Crispin]

I have read (admittedly, not every single one) the previous posts. The difference - as far as I can see - is that they still have the previous bug (interface is there in jail, no DHCP assigned). I don't even get an interface assigned to my new jails.
I've checked the mac addresses (see above) and cannot see a duplicate in them. They're all sequential.

I believe this is a different bug to the previous one which I also "suffered" from. That one was fixable with static IPs.

C

 

[joeschmuck]

Thanks for searching for it. So the MAC addresses are all different in the jails. I'd submit a bug report. I don't use DHCP just because of these types of errors but many people still like DHCP and that is fine of course and it should work.

 

[Crispin]

So the MAC addresses are all different in the jails.

Yes, for the jails which are working and have interfaces assigned to them. For new jails there is simply no interface so not possible to have a duplicate mac address for it.

I'l still trawling through the logs to see if there is any clue like "well, I tried assigning but bla bla". Will post up when I find something.


will submit a bug report too.


C

 

[joeschmuck]

So do this...
1) In the GUI, Jails (give me a screen shot)
2) In the GUI, Jails -> Configuration -> Advanced Mode (give me a screen shot)
3) In the GUI, Jails -> Select one of the troubled jails -> At bottom of GUI select Edit Jail -> Advanced Mode (give me a screen shot, might take two to get all that data)

This will help me help you, or someone else help you, it's time for a shower and bed. Got to be at work by 5AM, just another day in the office.

 

[Crispin]

Well, things just seemed t get worse today :(
I've not touched anything other than creating a few jails and deleting a few jails. Not fiddled with anything. Now it seems none of my jails have an IP address.

I've not rebooted since last night.

As requested:

Something else which is interesting -

Yesterday I checked the logs of my firewall / DHCP server (running pfSense as a real FW) and I could see the renews coming through against the DHCP service. Today, there are no requests for new addresses. Only entries in the logs are for my other devices like phones and laptops etc. Nothing from the jails


Thanks for your help.

 

[Crispin]

ok, so in relation to the no-ip-in-any-jail I mentioned above. It seems this is because the NAS was super busy (or fluke).

I was running a couple of rsyncs (with checksum compare) to backup the data which made the nas very sluggish.
I killed them, jexec into a jail and do a dhclient <name> and it refreshed the IP. Said jail now shows up in the GUI list with a valid IP.

I tried creating a new jail again but it still does not get an interface created within the jail.

 

[joeschmuck]

You didn't click Advanced Mode here. The rest of the data didn't help.
2) In the GUI, Jails -> Configuration -> Advanced Mode (give me a screen shot)

 

[Crispin]

Doh.

Here it is from phone. Hope that's OK.

 

[joeschmuck]

And you are running 9.10.1 and still have the problem.

I would definitely resort to the static IPs

 

[Crispin]

I cannot use static IPs. The (new) jails don't have interfaces. Nothing to assign an IP to...

Sure, I can probably add them but there is something really dodgy going on.

 

[Crispin]

Something new -

I installed a plugin (owncloud) as a test. It gets an IP!

So, it has to be the cached copy of the jail which is bad somehow. Can I delete the local copy used for jails so it forces it to download a new one?

 

[joeschmuck]

So, it has to be the cached copy of the jail which is bad somehow. Can I delete the local copy used for jails so it forces it to download a new one?

You sure can but if you installed a new plugin and now suddenly all the jails start working, is it really the jail image causing it? Well it could be I guess.

The easiest way to do this is to delete your jails/warden-template-standard dataset. The complete clean way is to delete the entire jails dataset.

 

[Crispin]

You sure can but if you installed a new plugin and now suddenly all the jails start working, is it really the jail image causing it? Well it could be I guess.

Sorry, what I meant is that plugins work, jails still don't. That suggests there is nothing wrong with jails per se but rather than the template being used for new jails is dodgy.

The easiest way to do this is to delete your jails/warden-template-standard dataset. The complete clean way is to delete the entire jails dataset.

So if I delete the warden template then the next time I create a jail it will download the new one? That sounds like what I want :)

I would rather not delete the whole jails dataset as it's a pain setting the jails up again.

if deleting it is simply going to cause the template to download again then I will happily do that now.
I'm not going to break anything else am I? i.e. freenas will continue to run quite happily without this?

 

[joeschmuck]

Yes, the template will download again the next time you install a jail.

Also, if your jails are hosed up because of a bad template, well they won't be fixed by deleting the template. You still need to delete the problematic jail and recreate it using the new template. I'd disable all your jails and then after deleting the template, create another jail. See what happens.

 

[SweetAndLow]

you probably can't delete the template while you still have jails cloned off of it.

 

[Crispin]

yurp :(

The GUI would not let me do it bought could not catch the error

doing it cli I get:

Code:

 zfs destroy -r tank/jails/.warden-template-standard-9.3-x64
cannot destroy 'tank/jails/.warden-template-standard-9.3-x64': filesystem has dependent clones
use '-R' to destroy the following datasets:
tank/jails/jail_backups
tank/jails/mySQL
tank/jails/mySQL_KODI
tank/jails/jail_downloader@manual-Pre-Messing-about
tank/jails/jail_downloader-FreshInstall-clone
tank/jails/jail_downloader@FreshInstall
tank/jails/jail_downloader@SickRageWorking
tank/jails/jail_downloader

 

[Crispin]

ok, so I bit the bullet and backed up the jails I really cared about. I deleted them one by one and then deleted the templates.

Now I cannot create new jails! :(
When I try I get this:

then I get this:

Then I tried adding a new template (Although it was never there to start with)

and when I create a new jail I go into advanced mode and select the jail:

And still get the error.


What is interesting, and perhaps suggests this whole thing has been a red herring, is that I cannot check the DHCP checkbox.


So, how do I now fix the template problem? I need to recreate the templates so I can create jails.

 

[SweetAndLow]

Change your jail root directory to a new jail dataset. Basically start over and download the template fresh again. You can keep the old jail dataset for now but you will probably end up deleting it.

Sent from my Nexus 5X using Tapatalk