Upgrading FreeNAS 11.0-U2 to any other version fails. *Have not used ISO*

[naturalselector]

All,

Apologies for not being the sys admin and you all being stuck with a network admin. :) I am trying to help our sysadmin upgrade all of our storage and memory and part of that process is to upgrade the IX Systems. It doesn't matter if we stage the upgrade to the next version or attempt to hop to a later rollup, the system fails the update all the same. Here are the system specifics:

Build	FreeNAS-11.0-U2 (e417d8aa5)
Platform	Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
Memory	65385MB
System Time	Wed Jan 17 06:41:44 PST 2024
Uptime	9:41AM up 4 days, 14:37, 0 users
Load Average	1.89, 0.96, 0.71

** When attempting the updates via the "check now" option, I receive the following error:




Update server could not be reached

HTTP Error 308: Permanent Redirect


Traceback
Traceback (most recent call last):
File "./freenasUI/system/views.py", line 1424, in update_check
train=updateobj.get_train(),
File "./freenasUI/system/models.py", line 616, in get_train
trains = conf.AvailableTrains() or []
File "/usr/local/lib/freenasOS/Configuration.py", line 1064, in AvailableTrains
fileref = self.TryGetNetworkFile(file=TRAIN_FILE, reason="FetchTrains")
File "/usr/local/lib/freenasOS/Configuration.py", line 787, in TryGetNetworkFile
raise url_exc
File "/usr/local/lib/freenasOS/Configuration.py", line 761, in TryGetNetworkFile
furl = opener.open(req, timeout=30)
File "/usr/local/lib/python3.6/urllib/request.py", line 532, in open
response = meth(req, response)
File "/usr/local/lib/python3.6/urllib/request.py", line 642, in http_response
'http', request, response, code, msg, hdrs)
File "/usr/local/lib/python3.6/urllib/request.py", line 570, in error
return self._call_chain(*args)
File "/usr/local/lib/python3.6/urllib/request.py", line 504, in _call_chain
result = func(*args)
File "/usr/local/lib/python3.6/urllib/request.py", line 650, in http_error_default
raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 308: Permanent Redirect


** When I verify the current installation, I receive the following error:


The following Inconsistencies were found in your Current Install:

List of Checksum Mismatches:

/usr/local/lib/freenasOS/__init__.py

** When trying a "manual update" we receive the following error:



Environment: Software Version: FreeNAS-11.0-U2 (e417d8aa5) Request Method: POST Request URL: http://10.40.142.159/system/manualupdate/?X-Progress-ID=41692cea-3082-4ddc-85ea-4e523540c53b Traceback: File "/usr/local/lib/python3.6/subprocess.py" in check_output 336. **kwargs).stdout File "/usr/local/lib/python3.6/subprocess.py" in run 418. output=stdout, stderr=stderr) File "/usr/local/lib/python3.6/site-packages/django/core/handlers/exception.py" in inner 39. response = get_response(request) File "/usr/local/lib/python3.6/site-packages/django/core/handlers/base.py" in _legacy_get_response 249. response = self._get_response(request) File "/usr/local/lib/python3.6/site-packages/django/core/handlers/base.py" in _get_response 178. response = middleware_method(request, callback, callback_args, callback_kwargs) File "/usr/local/lib/python3.6/site-packages/django/contrib/auth/decorators.py" in _wrapped_view 23. return view_func(request, *args, **kwargs) File "/usr/local/lib/python3.6/site-packages/django/views/generic/base.py" in view 68. return self.dispatch(request, *args, **kwargs) File "/usr/local/lib/python3.6/site-packages/formtools/wizard/views.py" in dispatch 237. response = super(WizardView, self).dispatch(request, *args, **kwargs) File "/usr/local/lib/python3.6/site-packages/django/views/generic/base.py" in dispatch 88. return handler(request, *args, **kwargs) File "/usr/local/lib/python3.6/site-packages/formtools/wizard/views.py" in post 300. return self.render_done(form, **kwargs) File "/usr/local/lib/python3.6/site-packages/formtools/wizard/views.py" in render_done 357. **kwargs) Exception Type: MiddlewareError at /system/manualupdate/ Exception Value: [MiddlewareError: b"Failed to apply update Command '['/usr/local/bin/freenas-update', '-C', '/var/tmp/firmware', 'update']' returned non-zero exit status 1.: b''"]






** I am not sure what is happening or preventing all attempts to upgrade to any version. I was hoping that someone could provide some insight or suggestions on how to resolve. I did search the forums and I do see other users having issues upgrading to from versions 9 etc... I could not however find anything related to this, so any help is greatly appreciated. Apologies for being a dumb network admin.... :) I did reach out to support and they stated that our system is our of support as of 08/22. I am waiting to hear back from them if there are any paid for hours or support to help resolve, so I am also working in that direction.

 

[HoneyBadger]

Hey @naturalselector

What version of TrueNAS are you attempting to upgrade to with the manual update package that generated that traceback? A direct upgrade from 11.0 is unlikely to work to the latest releases, but an in-branch release shouldn't be doing that. What is the boot device being used?

You may need to use the ISO upgrade path temporarily (perhaps to get to 11.1 or 11.3) but the general path is 9.3 > 9.10 > 11.1 > 11.3 > 12.0 > 13.0 - as you are on 11.0-U2 you'll likely need to do the following:

1. ISO upgrade to 11.1-U7
2. Manual .tar upgrade to 11.3-U5 (if this fails, use the ISO)
3. Manual .tar upgrade to 12.0-U8.1 (should work)
4. Automatic upgrade to 13.0-U6.1

Check our Docs hub for the details and caveats here, especially regarding legacy encryption (if you are using encrypted pools now on FreeNAS 11) as well as note that mounting shares as the root user is not permitted:

Updating CORE

Provides information on how to update TrueNAS CORE.

www.truenas.com

Thanks!

 

[naturalselector]

Honey,

The error was when we were attempting to go from 11.0 to 11.1. I will schedule a maintenance window and see if we can complete the install local via the ISO. We were hesitant in the event that the ISO failed, but looks like we have no choice. :)

The boot media used was a usb drive and we attempted 2 different laptops as well.

 

[Peter Jakab]

Honey,

The error was when we were attempting to go from 11.0 to 11.1. I will schedule a maintenance window and see if we can complete the install local via the ISO. We were hesitant in the event that the ISO failed, but looks like we have no choice. :)

The boot media used was a usb drive and we attempted 2 different laptops as well.

Keep in mind if the USB drive boot media used those could be aging out over long period of time (Read/Write operations limited). Better to upgrade to small (120GB) SSD drives in mirror config.
I replaced lot of USB drives on my FreeNAS 11.1

 

[HoneyBadger]

Honey,

The error was when we were attempting to go from 11.0 to 11.1. I will schedule a maintenance window and see if we can complete the install local via the ISO. We were hesitant in the event that the ISO failed, but looks like we have no choice. :)

The boot media used was a usb drive and we attempted 2 different laptops as well.

A reboot will still be required even for manual or automatic upgrades, so ensure that you have planned for a temporary disruption in data availability - unless you have a dual-controller HA unit.

As @Peter Jakab suggested (while I was typing) if your FreeNAS system is booting from a USB device, it may have run out of program/erase cycles on its NAND. SSDs are definitely a more robust boot option, but depending on your chassis you might have limited space to install one. Can you give us a little more detail about the hardware that's in use for this system?

Ensure you take a configuration backup as well before attempting any upgrades.