Update from 9.10.2u6 to 11.1 fails with 'Unable to activate clone environment 11.1-RELEASE'

[Chris McLeod]

I have tried a couple of times to upgrade my system from 9.10.2u6 to 11.1 and each time it fails with the GUI showing 'unable to activate clone environment 11.1-Release'. The full set of errors from the console are included below for completeness but the error starts with:

Code:

Jan  1 12:25:53 freenas updated.py: [freenasOS.Update:105] mktemp: mkdtemp failed on /mnt/main/jails/sonarr_1/var/tmp/BE-11.1-RELEASE.chIcs1e4: No such file or directory

and I think this is what is causing the issue. I don't have any jails setup and when I look in /mnt/main/jails the only thing there is a warden.log file and its contents are:

Code:

[cmcleod@freenas /mnt/main/jails]$ cat warden.log
Building new Jail... Please wait...
zfs clone main/jails/.warden-template-pluginjail@clean main/jails/sonarr_1
Success!
Jail created at /mnt/main/jails/sonarr_1

I was playing around with jails and did install and then remove a sonarr jail so I am guessing something is still in the DB that makes the updater try to update it but it can't find it so it fails. Any help on how to resolve this so I can upgrade would be appreciated.

Thanks in advance,

Chris

Again, complete error listed below starting with a couple of earlier lines for context.

Code:

Jan  1 12:16:03 freenas smbd[2577]: [2018/01/01 12:16:03.348950,  2] ../source3/smbd/server.c:794(remove_child_pid)
Jan  1 12:16:03 freenas smbd[2577]:   Could not find child 59459 -- ignoring
Jan  1 12:25:53 freenas updated.py: [freenasOS.Update:105] mktemp: mkdtemp failed on /mnt/main/jails/sonarr_1/var/tmp/BE-11.1-RELEASE.chIcs1e4: No such file or directory
Jan  1 12:25:53 freenas updated.py: [freenasOS.Update:1457] Unable to activate clone environment 11.1-RELEASE
Jan  1 12:25:53 freenas updated.py: [freenasOS.Update:1475] Update got exception during update: Unable to activate clone environment 11.1-RELEASE
Traceback (most recent call last):
  File "/usr/local/lib/freenasOS/Update.py", line 1458, in ApplyUpdate
	raise UpdateBootEnvironmentException(s)
UpdateBootEnvironmentException: Unable to activate clone environment 11.1-RELEASE
Jan  1 12:26:25 freenas manage.py: [middleware.exceptions:37] [MiddlewareError: Unable to activate clone environment 11.1-RELEASE]
Jan  1 12:26:25 freenas manage.py: [rollbar:1265] Got unexpected status code from Rollbar api: 403
Response:
{
  "err": 1,
  "message": "project is not enabled"
}
Jan  1 12:26:25 freenas manage.py: [rollbar:1097] Exception while posting item ApiError(u'project is not enabled',)
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/rollbar/__init__.py", line 1095, in _send_payload
	_post_api('item/', payload, access_token=access_token)
  File "/usr/local/lib/python2.7/site-packages/rollbar/__init__.py", line 1138, in _post_api
	return _parse_response(path, SETTINGS['access_token'], payload, resp)
  File "/usr/local/lib/python2.7/site-packages/rollbar/__init__.py", line 1274, in _parse_response
	raise ApiError(json_data.get('message') or 'Unknown error')
ApiError: project is not enabled
Jan  1 12:26:26 freenas manage.py: [middleware.exceptions:37] [MiddlewareError: Unable to activate clone environment 11.1-RELEASE]
Jan  1 12:26:26 freenas manage.py: [rollbar:1265] Got unexpected status code from Rollbar api: 403
Response:
{
  "err": 1,
  "message": "project is not enabled"
}
Jan  1 12:26:26 freenas manage.py: [rollbar:1097] Exception while posting item ApiError(u'project is not enabled',)
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/site-packages/rollbar/__init__.py", line 1095, in _send_payload
	_post_api('item/', payload, access_token=access_token)
  File "/usr/local/lib/python2.7/site-packages/rollbar/__init__.py", line 1138, in _post_api
	return _parse_response(path, SETTINGS['access_token'], payload, resp)
  File "/usr/local/lib/python2.7/site-packages/rollbar/__init__.py", line 1274, in _parse_response
	raise ApiError(json_data.get('message') or 'Unknown error')
ApiError: project is not enabled
Stop refresh

For completeness system info follows:

Mobo: Supermicro X10SL7-F
CPU - Intel(R) Core(TM) i3-4330 CPU @ 3.50GHz
RAM - Crucial 16GB Kit (8GBx2) DDR3L 1600 MT/s (PC3-12800) DR x8 EUDIMM 240-Pin Memory - CT2KIT102472BD160B
Drives - 6
Model - TOSHIBA DT01ACA200 (2TB)
Raid - raidz2
Controller - LSI 2308 - Firmware: 20.00.02.00, Driver: 21.01.00.00-fbsd
Nics -
igb0@pci0:5:0:0: class=0x020000 card=0x153315d9 chip=0x15338086 rev=0x03 hdr=0x00
vendor = 'Intel Corporation'
device = 'I210 Gigabit Network Connection'
class = network
subclass = ethernet
igb1@pci0:6:0:0: class=0x020000 card=0x153315d9 chip=0x15338086 rev=0x03 hdr=0x00
vendor = 'Intel Corporation'
device = 'I210 Gigabit Network Connection'
class = network
subclass = ethernet
em0@pci0:7:0:0: class=0x020000 card=0x135e8086 chip=0x105e8086 rev=0x06 hdr=0x00
vendor = 'Intel Corporation'
device = '82571EB Gigabit Ethernet Controller'
class = network
subclass = ethernet
em1@pci0:7:0:1: class=0x020000 card=0x135e8086 chip=0x105e8086 rev=0x06 hdr=0x00
vendor = 'Intel Corporation'
device = '82571EB Gigabit Ethernet Controller'
class = network
subclass = ethernet

 

[dlavigne]

Please create a report at bugs.freenas.org and post the issue number here.

 

[Chris McLeod]

Per dlavigne opened bug #27593.

 

[wblock]

What capacity is the boot device?

 

[Chris McLeod]

Dual 16GB Sandisk USB drives in a mirrored configuration. 19% usage.

I have a note back on the bug for me to try the update from the shell using freenas-update -v check && freenas-update -v update. I will run that when I am off on Monday and see how it goes and update this thread with the outcome.

 

[Chris McLeod]

Command line upgrade worked but had some issues after the upgrade getting it up and running. See https://redmine.ixsystems.com/issues/27593 for details. For completeness had to set the update train on the command line for it to work.

Code:

freenas-update -T FreeNAS-11-STABLE -v check && freenas-update -v update