network problems

[ajschot]

What is wrong with 11.2??

Until 11.2 everything worked like it should be.... now it is all crap... freemnas only works well in DHCP which i hate!
IOCAGE jails just are crap.... not possible to set my own mac adress because if i set everything up for vnet it only works with Transmission, all other won't have a connection .... opne time it worked for NZBget to but after stopping and starting it went broke again.
I am getting so angry here that it is impossible to choose my own ip adress with a fake mac address because whithout own created mac adresses my whole dhcp server gets fucked up.
to bad i updated my zfs pools, because otherwise i went back to Freenas 11.1

Yes i red the manual and no it is not working! Only in the Transmission jail and yes i check many many times!
And yes since 11.2-RELEASE and U1 it is impossible to choose my own ip adress if i do that my Freenas box won't find any update anymore.
In RC versions it worked, that is why it is so weird i did not change a thing.
If i put in a DNS nameserver some bits seem to work but.... i can not get into shell and not always having the possibility to log via ssh

 

[Mlovelace]

What is wrong with 11.2??

Until 11.2 everything worked like it should be.... now it is all crap... freemnas only works well in DHCP which i hate!
IOCAGE jails just are crap.... not possible to set my own mac address because if i set everything up for vnet it only works with Transmission, all other won't have a connection .... opne time it worked for NZBget to but after stopping and starting it went broke again.
I am getting so angry here that it is impossible to choose my own IP address with a fake mac address because whithout own created mac adresses my whole dhcp server gets ****ed up.
to bad i updated my zfs pools, because otherwise i went back to Freenas 11.1

Yes i red the manual and no it is not working! Only in the Transmission jail and yes i check many many times!
And yes since 11.2-RELEASE and U1 it is impossible to choose my own IP address if i do that my Freenas box won't find any update any more.
In RC versions it worked, that is why it is so weird i did not change a thing.
If i put in a DNS nameserver some bits seem to work but.... i can not get into shell and not always having the possibility to log via ssh

My freeNAS server works just fine with a static address so I'm not sure what issues you may be seeing. Since you can no longer set MAC addresses, this is what has worked for me. I limited the DHCP scope on my subnet from 192.168.1.10 to 192.168.1.100. So, any device that I would like to set a static IP for, such as servers, I know there won't be a conflict if it's above 192.168.1.100.

Do you have any specific errors or failures you can point to with a static address?

 

[joeschmuck]

Also, how did you upgrade to 11.2 ? Was it a clean install or was it an upgrade? Did you recreate the jails from warden type and make new iocage jails? Did you delete the old warden jails or just deactivate them?

 

[ajschot]

Also, how did you upgrade to 11.2 ? Was it a clean install or was it an upgrade? Did you recreate the jails from warden type and make new iocage jails? Did you delete the old warden jails or just deactivate them?

Upgrade from 11.1 to 11.2-RCx to 11.2-RELEASE to 11.2-Release-U1

I delted the old warden plugins only use a warden plex jail. i wait with deleting that until the other ones work.
also after 15 minutes after a restart the jails seems to have network connection only it gets lost after 30 minutes or so... looks like the jail is going to sleep and won't connect after a full freenas restart and then waiting for 15 minutes this is not right... glad my plex jail keeps on working because i did not want to delete that unitl the other will work.

I treid 3 jails... one plugin Transmission, then i created a new jail and installed nzbget.
It worked fine until restart.....
And 1 jail with couchpotato (first tried the plugin, but after changing the network connection it won't work anymore, so made a clean new jail and installed couch potato)


Only used new fresh ip adresses that won't be used before in this network, also created new mac addresses.
Freenas runs in ESXi 6.5, which did not give me any problems until 11.2 (RC's worked fine)

 

[joeschmuck]

Can you post how you have assigned the network IPs and any other data you can think of? I know it's asking a lot but I don't know of any other way to troubleshoot it. I'd just stick with a single iocage jail because if you fix that one, odds are the rest have the same issue. Tell you what, I have a thread on how to install MiniDLNA and I've updated it to support the new iocage/GUI stuff. Give it a try and see if you can make it work. If it fails to work then verify you did each step properly and if it's still a problem then tessl me the last step that appeared to work and your problems.

And I just noticed that you started stating "plugins" in your response. So are we talking user generated iocage jails or premade plugins? This makes a big difference. Plugins are likely going to be more difficult and I've seen some folks complain about a few of them. I prefer to create my own jail and then install the application. Call me old school but it provides you more control.

Well I'm headed to the junk yard to enpty the back of the truck out. I was cleaning my garage yesterday while it was a warm 50F.

 

[ajschot]

First problem,
I never had problems with the internet connection from Freenas to the outside world... but since 11.2...



Not only backup when i am in the shell (or ssh connected to freenas) i can not ping to everything besides the router.

It is a ree ip adress for FreeNas like for ever....

Then in teh next post i will get all information for the iocage jails.
(I also changed the marked ip adresses for warden jails)

`i can update if i switch to dhcp, but taht is not what i want...

ESXi network setup (however here is nothing changed) i am trying to get the iocage jails working for quite sometime and it just won't , the same as having my own ip adress and still get network to the internet, only works in DHCP

 

[ajschot]

Can you post how you have assigned the network IPs and any other data you can think of? I know it's asking a lot but I don't know of any other way to troubleshoot it. I'd just stick with a single iocage jail because if you fix that one, odds are the rest have the same issue. Tell you what, I have a thread on how to install MiniDLNA and I've updated it to support the new iocage/GUI stuff. Give it a try and see if you can make it work. If it fails to work then verify you did each step properly and if it's still a problem then tessl me the last step that appeared to work and your problems.

And I just noticed that you started stating "plugins" in your response. So are we talking user generated iocage jails or premade plugins? This makes a big difference. Plugins are likely going to be more difficult and I've seen some folks complain about a few of them. I prefer to create my own jail and then install the application. Call me old school but it provides you more control.

Well I'm headed to the junk yard to enpty the back of the truck out. I was cleaning my garage yesterday while it was a warm 50F.

With your setup it works, but that is not what i need, if i do this my whole domain and network structure gets frustrated because all the jails get the same mac address as the original network adapter, so it gets tough when routing ports to certain jails.
So it works with my own choosen IP adress but in the old warden jail it makes it own mac adresses and as soon as i setup the vnet my network dies. So your manual works, but if i want to change my mac address it gets broken network

Here is my setup:






Thanks

DHCP server is set from 192.168.178.26 until .200
So all under 26 are free

Here is my ifconfig from freenas.

Code:

root@freenas:~ # ifconfig
vmx0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=200099<RXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,RXCSUM_IPV6>
    ether 00:0c:29:bf:a4:4f
    hwaddr 00:0c:29:bf:a4:4f
    inet 192.168.178.25 netmask 0xffffff00 broadcast 192.168.178.255
    nd6 options=9<PERFORMNUD,IFDISABLED>
    media: Ethernet autoselect
    status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
    options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
    inet6 ::1 prefixlen 128
    inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
    inet 127.0.0.1 netmask 0xff000000
    nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
    groups: lo
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
    ether 02:df:c7:34:6e:00
    nd6 options=1<PERFORMNUD>
    groups: bridge
    id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
    maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
    root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
    member: vnet0:8 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
            ifmaxaddr 0 port 7 priority 128 path cost 2000
    member: vnet0:6 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
            ifmaxaddr 0 port 6 priority 128 path cost 2000
    member: vnet0:5 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
            ifmaxaddr 0 port 8 priority 128 path cost 2000
    member: epair1a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
            ifmaxaddr 0 port 5 priority 128 path cost 2000
    member: epair0a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
            ifmaxaddr 0 port 4 priority 128 path cost 2000
    member: vmx0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
            ifmaxaddr 0 port 1 priority 128 path cost 2000
epair0a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:7d:d0:00:04:0a
    hwaddr 02:7d:d0:00:04:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
    groups: epair
epair1a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8<VLAN_MTU>
    ether 02:7d:d0:00:05:0a
    hwaddr 02:7d:d0:00:05:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
    groups: epair
vnet0:5: flags=8942<BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    description: associated with jail: couchpotato
    options=8<VLAN_MTU>
    ether b1:1f:f9:50:cb:5b
    hwaddr 02:7d:d0:00:08:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
    groups: epair
vnet0:6: flags=8942<BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    description: associated with jail: NZBget
    options=8<VLAN_MTU>
    ether f6:19:93:a0:cc:18
    hwaddr 02:7d:d0:00:06:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
    groups: epair
vnet0:8: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
    description: associated with jail: transmission
    options=8<VLAN_MTU>
    ether a2:ec:2a:7d:3b:b2
    hwaddr 02:7d:d0:00:07:0a
    nd6 options=1<PERFORMNUD>
    media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
    status: active
    groups: epair
root@freenas:~ #

 

[Mlovelace]

In the Network / Global Configuration image you uploaded you do not have a nameserver configured. Are you able to resolve addresses from the freeNAS server? Add your preferred DNS server to the nameserver field.

 

[ajschot]

In the Network / Global Configuration image you uploaded you do not have a nameserver configured. Are you able to resolve addresses from the freeNAS server? Add your preferred DNS server to the nameserver field.

Filled in my dns nameserver from my dhcp server and.... not working still the same problems nothing changed, can not even start shell

 

[joeschmuck]

What can I do to replicate this issue? Please be specific. I'm updating my FreeNAS VM now to the latest version so I can test this out.

 

[ajschot]

What can I do to replicate this issue? Please be specific. I'm updating my FreeNAS VM now to the latest version so I can test this out.

I tried now to use another dns server from my isp and this works in the jails, well... i can conect to the angry outside world... i can ping google.... only i can not enter the web interface. so 2 options... i need to use 1 mac address for all my apps and forward ports to my whole freenas system, or can not use the jails at all.
Can you try to make a jail with fake mac address and connect to the internet and also to your internal network?

The part where the problems begin is with the virtual mac addresses (i use https://www.miniwebtool.com/mac-address-generator/ ) to create mac addresses. Because otherwise my router does not see the different devices, my router does that on mac address base

 

[ajschot]

i think i found the problem.... maybe it was a tunable that was needed before 11.2 i switched it off and it seems to work at least for one jail

EDIT: did not do the trick, only worked for 1 jail....

please add more then 2 jails and let them all work, so gui internally and connect to outside

 

[joeschmuck]

So I'm not having any issue here, each jail I create has a unique IP and MAC address. I'm running into conflicting data using your screen shots. One screen shot states you are using in your jail setup "VNET" checked and "vnet0" as the interface however in another screenshot it looks like you are not using VNET (unchecked) due to some of the settings that are available. Use only the VNET checked and vnet0 as the interface, see how that works for you. Maybe you already have done this.

So right now I'm not able to recreate your issue.

 

[ajschot]

So I'm not having any issue here, each jail I create has a unique IP and MAC address. I'm running into conflicting data using your screen shots. One screen shot states you are using in your jail setup "VNET" checked and "vnet0" as the interface however in another screenshot it looks like you are not using VNET (unchecked) due to some of the settings that are available. Use only the VNET checked and vnet0 as the interface, see how that works for you. Maybe you already have done this.

So right now I'm not able to recreate your issue.

I am. now having all VNET on and just one works. If i stop all 4 an start them in a different order then i have an other jail working.
If i don't use vnet they all work but they get the same mac address

 

[ajschot]

for now i have 2 working and all settings are the same (only not IP and mac addresses)

 

[ajschot]

ok i stopped them one by one and switched them on, now have 3 working....
1 OK
2 OK
3 NOT
4 OK

If i switch on 3 and 4 and turn first 3 on and then 4 on :
1 OK
2 OK
3 OK
4 NOT


this is weird and if i switch off 3 and 4 and first 4 on and then 3 i get

1 OK
2 OK
3 NOT
4 OK

??? I don't get it... i think i try to make a dummy 5th jail....

 

[samuel-emrys]

I am. now having all VNET on and just one works. If i stop all 4 an start them in a different order then i have an other jail working.
If i don't use vnet they all work but they get the same mac address

Can you log in to the command line interface and post the output of iocage get all <jailname> where <jailname> is the name of your jail that isn't working as intended?

 

[ajschot]

ok i stopped them one by one and switched them on, now have 3 working....
1 OK
2 OK
3 NOT
4 OK

If i switch on 3 and 4 and turn first 3 on and then 4 on :
1 OK
2 OK
3 OK
4 NOT


this is weird and if i switch off 3 and 4 and first 4 on and then 3 i get

1 OK
2 OK
3 NOT
4 OK

??? I don't get it... i think i try to make a dummy 5th jail....

this does the trick... it is really a hell... but i now have 4 working jails and 1 not working jail.

SO in order to get more working i have to create a new jail. switch off one of the working jails and stop the new jail (restart does not work!)
Then in the new jail i can ping and install the software
After that stop the jail, en start it again to get a it on my internal network.
Then create a new dummy jail. and to all over to let the jail that stopped before get working again

 

[ajschot]

Can you log in to the command line interface and post the output of iocage get all <jailname> where <jailname> is the name of your jail that isn't working as intended?

Here we go

Code:

root@freenas:~ # iocage get all test
CONFIG_VERSION:14
allow_chflags:0
allow_mlock:0
allow_mount:0
allow_mount_devfs:0
allow_mount_nullfs:0
allow_mount_procfs:0
allow_mount_tmpfs:0
allow_mount_zfs:0
allow_quotas:0
allow_raw_sockets:1
allow_set_hostname:1
allow_socket_af:0
allow_sysvipc:0
allow_tun:0
available:readonly
basejail:no
boot:off
bpf:no
children_max:0
cloned_release:11.2-RELEASE
comment:none
compression:lz4
compressratio:readonly
coredumpsize:off
count:1
cpuset:off
cputime:off
datasize:off
dedup:off
defaultrouter:192.168.178.1
defaultrouter6:none
depends:none
devfs_ruleset:4
dhcp:off
enforce_statfs:2
exec_clean:1
exec_fib:0
exec_jail_user:root
exec_poststart:/usr/bin/true
exec_poststop:/usr/bin/true
exec_prestart:/usr/bin/true
exec_prestop:/usr/bin/true
exec_start:/bin/sh /etc/rc
exec_stop:/bin/sh /etc/rc.shutdown
exec_system_jail_user:0
exec_system_user:root
exec_timeout:60
host_domainname:none
host_hostname:test
host_hostuuid:test
host_time:yes
hostid:b1094d56-49e1-8fd8-22bc-b2f240bfa44f
hostid_strict_check:off
interfaces:vnet0:bridge0
ip4:new
ip4_addr:vnet0|192.168.178.88/24
ip4_saddrsel:1
ip6:new
ip6_addr:none
ip6_saddrsel:1
jail_zfs:off
jail_zfs_dataset:iocage/jails/test/data
jail_zfs_mountpoint:none
last_started:2018-12-30 23:36:08
login_flags:-f root
mac_prefix:02ff60
maxproc:off
memorylocked:off
memoryuse:off
mount_devfs:1
mount_fdescfs:1
mount_linprocfs:0
mount_procfs:0
mountpoint:readonly
msgqqueued:off
msgqsize:off
nmsgq:off
notes:none
nsemop:off
nshm:off
nthr:off
openfiles:off
origin:readonly
owner:root
pcpu:off
priority:99
pseudoterminals:off
quota:none
release:11.2-RELEASE-p4
reservation:none
resolver:/etc/resolv.conf
rlimits:off
securelevel:2
shmsize:off
stacksize:off
state:up
stop_timeout:30
swapuse:off
sync_state:none
sync_target:none
sync_tgt_zpool:none
sysvmsg:new
sysvsem:new
sysvshm:new
template:no
type:jail
used:readonly
vmemoryuse:off
vnet:on
vnet0_mac:02ff60ae1b75 02ff60ae1b76
vnet1_mac:none
vnet2_mac:none
vnet3_mac:none
vnet_default_interface:vmx0
vnet_interfaces:none
wallclock:off
root@freenas:~ #

Oh i know how to get this one working too.. i need to make a new jail and stop and start some other jails to get this one working....

 

[ajschot]

next problem.... restart.... all connections gets lost....