Split network jail configuration

[akraut]

Hey folks, I'm trying to accomplish a complicated network setup and I'm not sure how to go about pulling it off.
I have two upstream network providers: Starlink and DSL. DSL is pokey, but consistent. Starlink is fast, but is CGNAT so doesn't allow hosting services.

So, my whole internal network is running off Starlink, and igb0 is attached to that network. (192.168.100.0/24) I have a handful of services in Jails that are serving clients on that internal network.
DSL is a backup, and igb1 is connected to that network. (192.168.1.X/24) I have a single jail that I'd like to keep accessible to the clients on the igb0 internal network, but also make it serve clients outside the network via the dsl igb1 network. I can't assign it an IP on the 192.168.1.0/24 network because the DSL provider is silly and only assigns me a single IP via DHCP (in the 192.168.1.0/24 range) and transparently forwards all ports to it.

Currently I'm assigning a static 192.168.100.4/24 to vnet0 so the local network clients can access the service. However, it seems as though I either need to mix vnet and non-vnet assignments and let the jail pick up the 192.168.1.1 address, or I setup some complicated NAT config.

Any ideas on how to accomplish this?

Code:

Starlink (192.168.100.0/24) ------- igb0 ---------+
                                                  +----- Jail
DSL (192.168.1.X/24) -------------- igb1 ---------+

 

[Patrick M. Hausen]

You can assign multiple vnet interfaces to a jail. Make sure to statically create your bridge interfaces. There are a couple of posts (mostly by myself) here on the forum on how that works.