Error on 11.3 stable upgrade

[lunchbox06452]

Currently getting a

Error: Cannot remove file /usr/local/lib/python3.7/site-packages/django/contrib/auth/__pycache__/views.cpython-37.pyc

When trying to run the webui update package. I'm not really finding any solutions on my own and was wondering if anyone has some help for me.

Current survey specs are

Performance Specs:
Processor: 2x AMD Opteron AMD 6378 Hexadeca (16) Core 2.4Ghz (Total 32 Cores)
Memory: 64GB DDR3 (4x 8GB - DDR3 - REG PC3-10600R (1333MHZ)
Hard Drives: None
Controller: 1x LSI 9211-8i HBA JBOD FREENAS UNRAID
Integrated Onboard Dual 1GB Ethernet ports (2)
Secondary Chassis/ Motherboard specs:
Supermicro 4U 36x 3.5" Drive Bays
Server Chassis/ Case: CSE-847E16-R1400UB
Motherboard: H8DGU-F
*BPN-SAS2-846EL1 24-port 4U SAS2 6Gbps single-expander backplane
*BPN-SAS2-826EL1 12-port 2U SAS2 6Gbps single-expander backplane"
PCI-Expansions slots: Full Height 3x (x8 PCI-E 2.0+) RSC-R2UU-3E8G
Power: 2x 1400Watt Power Supply Gold

If I'm missing anything please let me know. I'm still ok for data and running but I do like to make sure I'm stable with operation.

Thank you so much.

 

[Samuel Tai]

Check /usr/local/lib/python3.7/site-packages/django/contrib/auth/__pycache__/. That file triggering the complaint may not be there anymore, and this may have been an attempted deletion of an already-deleted file.

 

[lunchbox06452]

root@Virgil[~]# cd /usr/local/libpython3.7/site-packages/django/
cd: no such file or directory: /usr/local/libpython3.7/site-packages/django/
root@Virgil[~]# cd /user
cd: no such file or directory: /user
root@Virgil[~]# cd user
cd: no such file or directory: user

Currently it looks like I'm in trouble if I'm understanding this properly.

 

[lunchbox06452]

I'm really new at Unix commands so please be a bit patient with me if I've made a mistake.

I'm really sorry.

 

[Samuel Tai]

Wrong directory. You forgot the / between lib and python. It's /usr/local/lib/python3.7/site-packages/django/contrib/auth/__pycache__/, and the directory is usr, not user.

Code:

cd /usr/local/lib/python3.7/site-packages/django/contrib/auth/__pycache__/
ls

 

[lunchbox06452]

So this is what I currently have in that directory and it seems like it is there.

root@Virgil[...kages/django/contrib/auth/__pycache__]# ls
__init__.cpython-37.opt-1.pyc
__init__.cpython-37.pyc
admin.cpython-37.opt-1.pyc
admin.cpython-37.pyc
apps.cpython-37.opt-1.pyc
apps.cpython-37.pyc
backends.cpython-37.opt-1.pyc
backends.cpython-37.pyc
base_user.cpython-37.opt-1.pyc
base_user.cpython-37.pyc
checks.cpython-37.opt-1.pyc
checks.cpython-37.pyc
context_processors.cpython-37.opt-1.pyc
context_processors.cpython-37.pyc
decorators.cpython-37.opt-1.pyc
decorators.cpython-37.pyc
forms.cpython-37.opt-1.pyc
forms.cpython-37.pyc
hashers.cpython-37.opt-1.pyc
hashers.cpython-37.pyc
middleware.cpython-37.opt-1.pyc
middleware.cpython-37.pyc
mixins.cpython-37.opt-1.pyc
mixins.cpython-37.pyc
models.cpython-37.opt-1.pyc
models.cpython-37.pyc
password_validation.cpython-37.opt-1.pyc
password_validation.cpython-37.pyc
signals.cpython-37.opt-1.pyc
signals.cpython-37.pyc
tokens.cpython-37.opt-1.pyc
tokens.cpython-37.pyc
urls.cpython-37.opt-1.pyc
urls.cpython-37.pyc
validators.cpython-37.opt-1.pyc
validators.cpython-37.pyc
views.cpython-37.opt-1.pyc
views.cpython-37.pyc

 

[Samuel Tai]

Can you run ls -l to see when these files were created?

 

[lunchbox06452]

interesting unknown error only on that file when running ls -l


root@Virgil[...kages/django/contrib/auth/__pycache__]# ls -l
ls: views.cpython-37.pyc: Unknown error: 122
total 171
-rw-r--r-- 1 root wheel 6066 May 29 20:36 __init__.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 6066 May 29 20:38 __init__.cpython-37.pyc
-rw-r--r-- 1 root wheel 6479 May 29 20:36 admin.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 6479 May 29 16:44 admin.cpython-37.pyc
-rw-r--r-- 1 root wheel 1035 May 29 20:36 apps.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 1035 May 29 20:38 apps.cpython-37.pyc
-rw-r--r-- 1 root wheel 6907 May 29 20:36 backends.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 6907 May 29 16:44 backends.cpython-37.pyc
-rw-r--r-- 1 root wheel 6190 May 29 20:36 base_user.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 6190 May 29 20:38 base_user.cpython-37.pyc
-rw-r--r-- 1 root wheel 3799 May 29 20:36 checks.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 3799 May 29 20:38 checks.cpython-37.pyc
-rw-r--r-- 1 root wheel 2578 May 29 20:36 context_processors.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 2578 May 29 20:36 context_processors.cpython-37.pyc
-rw-r--r-- 1 root wheel 2884 May 29 20:36 decorators.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 2884 May 29 16:44 decorators.cpython-37.pyc
-rw-r--r-- 1 root wheel 14276 May 29 20:36 forms.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 14276 May 29 16:44 forms.cpython-37.pyc
-rw-r--r-- 1 root wheel 22614 May 29 20:36 hashers.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 22614 May 29 20:38 hashers.cpython-37.pyc
-rw-r--r-- 1 root wheel 5166 May 29 20:36 middleware.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 5166 May 29 16:44 middleware.cpython-37.pyc
-rw-r--r-- 1 root wheel 4827 May 29 20:36 mixins.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 4827 May 29 20:36 mixins.cpython-37.pyc
-rw-r--r-- 1 root wheel 16687 May 29 20:36 models.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 16687 May 29 20:38 models.cpython-37.pyc
-rw-r--r-- 1 root wheel 8358 May 29 20:36 password_validation.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 8358 May 29 20:38 password_validation.cpython-37.pyc
-rw-r--r-- 1 root wheel 346 May 29 20:36 signals.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 346 May 29 20:38 signals.cpython-37.pyc
-rw-r--r-- 1 root wheel 2532 May 29 20:36 tokens.cpython-37.opt-1.pyc
-rw-r--r-- 1 root wheel 2532 May 29 16:44 tokens.cpython-37.pyc

 

[Samuel Tai]

Can you run zpool status -v freenas-boot? Also, what are you using as a boot drive?

 

[Samuel Tai]

Also please run zpool scrub freenas-boot. The error 122 indicates a checksum failure, which means the boot drive may be failing. You may need to replace the boot drive, reinstall FreeNAS, and reimport your pool and config.

 

[lunchbox06452]

My boot drive is a brand new "SanDisk SSD PLUS 240GB Internal SSD - SATA III 6 Gb/s, 2.5"/7mm, Up to 530 MB/s - SDSSDA-240G-G26"

Current run with "zpool status -v freenas-boot"


root@Virgil[~]# zpool status -v freenas-boot
pool: freenas-boot
state: DEGRADED
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://illumos.org/msg/ZFS-8000-8A
scan: scrub repaired 0 in 0 days 00:00:06 with 60 errors on Fri Jun 12 03:45:06 2020
config:

NAME STATE READ WRITE CKSUM
freenas-boot DEGRADED 0 0 116
ada0p2 DEGRADED 0 0 464 too many errors

errors: Permanent errors have been detected in the following files:

<metadata>:<0x2a>
<metadata>:<0x2e>
<metadata>:<0x3e>
<metadata>:<0x44>
<metadata>:<0x45>
<metadata>:<0x56>
<metadata>:<0x57>
<metadata>:<0x5a>
<metadata>:<0x61>
<metadata>:<0x64>
<metadata>:<0x68>
<metadata>:<0x69>
<metadata>:<0x6f>
<metadata>:<0x73>
<metadata>:<0x76>
<metadata>:<0x8d>
freenas-boot/ROOT/default:<0x0>
freenas-boot/ROOT/default:<0xfffffffffffffffe>
freenas-boot/ROOT/default@2020-05-29-20:43:45:<0x0>
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/www/dojo/dojox/grid/enhanced/nls/sv
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/www/dojo/dojox/mobile/themes/windows/images
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/python3.7/site-packages/django/contrib/gis/utils
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/perl5/5.30/unicore/lib/In
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/gcc9/include/c++/ext/pb_ds/detail/rb_tree_map_
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/perl5/5.30/unicore/lib/InPC
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/perl5/5.30/unicore/lib/InSC
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/www/dojo/dojox/grid/enhanced/nls/pt
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/python3.7/__pycache__/stat.cpython-37.opt-1.pyc
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/python3.7/site-packages/zope/component/testfiles
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/migrate93/django/contrib/messages/storage/session.py
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/migrate93/django/contrib/messages/tests/__pycache__/__init__.cpython-37.pyc
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/python3.7/site-packages/django/contrib/admin/migrations
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/python3.7/site-packages/south/tests/deps_a/migrations
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/www/dojo/dojox/grid/enhanced/nls/sk
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/python3.7/site-packages/zope/interface/tests/__pycache__
freenas-boot/ROOT/default@2020-05-29-20:43:45:/usr/local/lib/gcc9/include/c++/ext/pb_ds/detail/list_upda

 

[Samuel Tai]

OK, your boot drive is going bad. You'll need to replace it. That's the cause of the error during the upgrade.

 

[lunchbox06452]

Bummer with it only being a week old.

So best thing to do is use my config file I saved, Export the pools and stop the jails I have going then replace and reinstall correct?

I really appreciate all your help Samuel

 

[Samuel Tai]

No need to export the pools or stop the jails. Just reinstall to new media, and after boot, upload your config. Since the config has all the details of the pool and the jails, they'll be available after the config takes effect. You may have to reboot again, but things should be back to normal afterwards.