Division by Zero Errors on new jail/plugin installation TrueNAS Core 12.0-U5.1

[OrigMaelstrom]

Good afternoon --

First time I've ever run into an issue with Freenas/Truenas since I started with it in 2010 and scratching my head on this one. The TrueNas server this is running on has currently existing Jails/plugins that are running correctly without any issues.

The Issue:
Problem came up today when trying to install a iXSystems Nextcloud plugin and was repeated when I attempted to create a new, generic jail.
Upon saving the plugin config and the install starting, after a few minutes, I get this:

In the middlewared.log, I see :

Code:

[2021/08/31 16:18:00] (DEBUG) iocage.retrieve_plugin_json():278 - Plugin json file path: /mnt/POOL_NAME/iocage/.plugins/github_com_freenas_iocage-ix-plugins_git/nextcloud.json
[2021/08/31 16:18:00] (DEBUG) urllib3.connectionpool._new_conn():221 - Starting new HTTP connection (1): download.freebsd.org:80
[2021/08/31 16:18:01] (DEBUG) urllib3.connectionpool._make_request():428 - http://download.freebsd.org:80 "GET /ftp/releases/amd64 HTTP/1.1" 301 162
[2021/08/31 16:18:01] (DEBUG) urllib3.connectionpool._new_conn():955 - Starting new HTTPS connection (1): download.freebsd.org:443
[2021/08/31 16:18:01] (DEBUG) urllib3.connectionpool._make_request():428 - https://download.freebsd.org:443 "GET /ftp/releases/amd64 HTTP/1.1" 301 162
[2021/08/31 16:18:02] (DEBUG) urllib3.connectionpool._make_request():428 - https://download.freebsd.org:443 "GET /ftp/releases/amd64/ HTTP/1.1" 200 None
[2021/08/31 16:18:02] (DEBUG) urllib3.connectionpool._new_conn():221 - Starting new HTTP connection (1): download.freebsd.org:80
[2021/08/31 16:18:02] (DEBUG) urllib3.connectionpool._make_request():428 - http://download.freebsd.org:80 "GET /ftp/releases/amd64/12.2-RELEASE HTTP/1.1" 301 162
[2021/08/31 16:18:02] (DEBUG) urllib3.connectionpool._new_conn():955 - Starting new HTTPS connection (1): download.freebsd.org:443
[2021/08/31 16:18:03] (DEBUG) urllib3.connectionpool._make_request():428 - https://download.freebsd.org:443 "GET /ftp/releases/amd64/12.2-RELEASE HTTP/1.1" 301 162
[2021/08/31 16:18:03] (DEBUG) urllib3.connectionpool._make_request():428 - https://download.freebsd.org:443 "GET /ftp/releases/amd64/12.2-RELEASE/ HTTP/1.1" 200 None
[2021/08/31 16:18:03] (INFO) iocage.callback():71 - Fetching: 12.2-RELEASE

[2021/08/31 16:18:04] (WARNING) iocage.callback():69 - base.txz failed verification, will redownload!
[2021/08/31 16:18:04] (WARNING) iocage.callback():69 - lib32.txz missing, will try to redownload!
[2021/08/31 16:18:04] (WARNING) iocage.callback():69 - src.txz missing, will try to redownload!
[2021/08/31 16:18:04] (DEBUG) urllib3.connectionpool._new_conn():221 - Starting new HTTP connection (1): download.freebsd.org:80
[2021/08/31 16:18:04] (DEBUG) urllib3.connectionpool._make_request():428 - http://download.freebsd.org:80 "GET /ftp/releases/amd64/12.2-RELEASE/base.txz HTTP/1.1" 301 162
[2021/08/31 16:18:04] (DEBUG) urllib3.connectionpool._new_conn():955 - Starting new HTTPS connection (1): download.freebsd.org:443
[2021/08/31 16:18:04] (DEBUG) urllib3.connectionpool._make_request():428 - https://download.freebsd.org:443 "GET /ftp/releases/amd64/12.2-RELEASE/base.txz HTTP/1.1" 200 183296096
[2021/08/31 16:20:21] (ERROR) middlewared.job.run():379 - Job <bound method accepts.<locals>.wrap.<locals>.nf of <middlewared.plugins.jail_freebsd.PluginService object at 0x81c0bea90>> failed
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/middlewared/job.py", line 367, in run
    await self.future
  File "/usr/local/lib/python3.9/site-packages/middlewared/job.py", line 405, in __run_body
    rv = await self.middleware.run_in_thread(self.method, *([self] + args))
  File "/usr/local/lib/python3.9/site-packages/middlewared/utils/run_in_thread.py", line 10, in run_in_thread
    return await self.loop.run_in_executor(self.run_in_thread_executor, functools.partial(method, *args, **kwargs))
  File "/usr/local/lib/python3.9/site-packages/middlewared/utils/io_thread_pool_executor.py", line 25, in run
    result = self.fn(*self.args, **self.kwargs)
  File "/usr/local/lib/python3.9/site-packages/middlewared/schema.py", line 977, in nf
    return f(*args, **kwargs)
  File "/usr/local/lib/python3.9/site-packages/middlewared/plugins/jail_freebsd.py", line 296, in do_create
    ioc.IOCage(callback=progress_callback, silent=False).fetch(**{
  File "/usr/local/lib/python3.9/site-packages/iocage_lib/iocage.py", line 1072, in fetch
    plugin_obj.fetch_plugin(props, 0, accept)
  File "/usr/local/lib/python3.9/site-packages/iocage_lib/ioc_plugin.py", line 313, in fetch_plugin
    props, pkg = self.__fetch_plugin_props__(conf, props, num)
  File "/usr/local/lib/python3.9/site-packages/iocage_lib/ioc_plugin.py", line 491, in __fetch_plugin_props__
    self.__fetch_release__(self.release)
  File "/usr/local/lib/python3.9/site-packages/iocage_lib/ioc_plugin.py", line 1528, in __fetch_release__
    iocage_lib.iocage.IOCage(silent=self.silent).fetch(**fetch_args)
  File "/usr/local/lib/python3.9/site-packages/iocage_lib/iocage.py", line 1105, in fetch
    ioc_fetch.IOCFetch(
  File "/usr/local/lib/python3.9/site-packages/iocage_lib/ioc_fetch.py", line 215, in fetch_release
    rel = self.fetch_http_release(eol, _list=_list)
  File "/usr/local/lib/python3.9/site-packages/iocage_lib/ioc_fetch.py", line 467, in fetch_http_release
    self.fetch_download(missing_files, missing=bool(missing_files))
  File "/usr/local/lib/python3.9/site-packages/iocage_lib/ioc_fetch.py", line 727, in fetch_download
    text = self.update_progress(
  File "/usr/local/lib/python3.9/site-packages/iocage_lib/ioc_fetch.py", line 755, in update_progress
    current_time = chunk_size / elapsed
ZeroDivisionError: float division by zero

Creating a jail creates a similar error:

I've updated to the latest release, which was able to download, install and boot to the new release without a problem, and confirmed in the Network -> Global Configuration section that the DNS and Default gateway are both setup correctly (gateway is 10.0.0.254, DNS is set to my internal DNS server first, then 8.8.8.8 and 8.8.4.4. I've also removed my DNS server and left only googles to be sure) and have verified I can both ping and run a DNS lookup on github.com from the command line. I've also verified on the Jails config that the pool for the jail root is set correctly and that there is space available on that pool (2.5 TB or so).

The only recent change I've made to this server is to add an additional single drive I set up as a stand alone pool for onsite backups.

Any guidance or suggestion will be welcome, thanks!!!

 

[OrigMaelstrom]

Just for the record, the results from the network :

Code:

# nslookup github.com
Server:         8.8.8.8
Address:        8.8.8.8#53

Non-authoritative answer:
Name:   github.com
Address: 140.82.121.3

# ping -c 5 github.com
PING github.com (140.82.121.4): 56 data bytes
64 bytes from 140.82.121.4: icmp_seq=0 ttl=47 time=0.000 ms
64 bytes from 140.82.121.4: icmp_seq=1 ttl=47 time=0.000 ms
64 bytes from 140.82.121.4: icmp_seq=2 ttl=47 time=0.000 ms
64 bytes from 140.82.121.4: icmp_seq=3 ttl=47 time=0.000 ms
64 bytes from 140.82.121.4: icmp_seq=4 ttl=47 time=0.000 ms

--- github.com ping statistics ---
5 packets transmitted, 5 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 0.000/0.000/0.000/0.000 ms