Unreleased 9.10-Stable Release causing new errors: '/usr/local/lib/libstatgrab.so'

[OctaneZ]

It looks like I got bitten by the non-release-Release, it was up for a few days, as I tried to do it last night, August 2nd, and I always do the check again and verify before proceeding.

Also, this seems to be related to commit: *-os--b43d150ccdcfc05a5811403b58d870cc for whomever is debugging. It looks like the code/commit/release flag was yanked by the 4AM Eastern US check.

Related threads:
I have the boot-device error:
https://forums.freenas.org/index.php?threads/update-error-unable-to-mount-boot-environment.45088/
https://forums.freenas.org/index.php?threads/unable-to-apply-pending-updates-for-9-10-stable.45084/

However I have a new humdinger:

Code:

Aug  3 11:07:16 freenas manage.py: [middleware.exceptions:37] [MiddlewareError: [Errno 22] Invalid argument: '/usr/local/lib/libstatgrab.so']
Aug  3 11:07:27 freenas manage.py: [middleware.exceptions:37] [MiddlewareError: [Errno 22] Invalid argument: '/usr/local/lib/libstatgrab.so']

Code:

[benc@freenas] /usr/local/lib# ls -ltr | grep libstatgrab
-rw-r--r--   1 root  wheel    125102 Jul 27 10:01 libstatgrab.a
-rwxr-xr-x   1 root  wheel     87347 Jul 27 10:01 libstatgrab.so*
-rwxr-xr-x   1 root  wheel     87347 Jul 27 10:01 libstatgrab.so.10*
-rwxr-xr-x   1 root  wheel     87347 Jul 27 10:01 libstatgrab.so.10.0.0*

Those are the only files with the timestamp.

Code:

Aug  3 00:56:01 freenas updated.py: [freenasOS.Update:1163] Upgrade package base-os-9.10-STABLE-201606270534-8bc815b059fa92f1c8ba7c7685deacbb to base-os--b43d150ccdcfc05a5811403b58d870cc
Aug  3 00:56:01 freenas updated.py: [freenasOS.Update:1163] Upgrade package docs-9.10-STABLE-201606270534-8bc815b059fa92f1c8ba7c7685deacbb to docs--b43d150ccdcfc05a5811403b58d870cc
Aug  3 00:56:01 freenas updated.py: [freenasOS.Update:1163] Upgrade package freebsd-pkgdb-9.10-STABLE-201606270534-8bc815b059fa92f1c8ba7c7685deacbb to freebsd-pkgdb--b43d150ccdcfc05a5811403b58d870cc
Aug  3 00:56:01 freenas updated.py: [freenasOS.Update:1163] Upgrade package freenas-pkg-tools-9.10-STABLE-201606072003-56206375162121f339ddd0deef235daa to freenas-pkg-tools--b43d150ccdcfc05a5811403b58d870cc
Aug  3 00:56:01 freenas updated.py: [freenasOS.Update:1163] Upgrade package FreeNASUI-9.10-STABLE-201606270534-8bc815b059fa92f1c8ba7c7685deacbb to FreeNASUI--b43d150ccdcfc05a5811403b58d870cc
Aug  3 00:56:01 freenas updated.py: [freenasOS.Update:1173] new_boot_name = , reboot = True
Aug  3 00:56:01 freenas updated.py: [freenasOS.Update:218] RunCommand(/usr/local/sbin/beadm, ['create', u''])
Aug  3 00:56:01 freenas updated.py: [freenasOS.Update:1180] Failed to create BE
Aug  3 00:56:01 freenas updated.py: [freenasOS.Update:218] RunCommand(/usr/local/sbin/beadm, ['destroy', '-F', u''])

 

[OctaneZ]

Oh, Verify install generates this error:

Aug 3 11:58:15 freenas manage.py: [middleware.exceptions:37] [MiddlewareError: [Errno 22] Invalid argument: '/usr/local/lib/libstatgrab.so']

[benc@freenas] /usr/local/lib# uname -a

FreeBSD freenas.local 10.3-STABLE FreeBSD 10.3-STABLE #0 455d13d(9.10-STABLE): Sun Jun 26 22:47:03 PDT 2016 root@build.ixsystems.com:/tank/home/nightlies/build-freenas9/_BE/objs/tank/home/nightlies/build-freenas9/_BE/trueos/sys/FreeNAS.amd64 amd64

 

[dlavigne]

Thanks for the details. The devs will look to make sure it's not an issue for the real SU.

 

[OctaneZ]

Any idea if a reboot would fix this error? AFP doesn't seem to be working, which means no time machine for the family. It seems like AFPd can't get the stats (what the lib provides) and immediateluy boot conections:

Code:

Aug  3 19:41:48 freenas afpd[68851]: AFP statistics: 0.51 KB read, 0.38 KB written
Aug  3 19:41:50 freenas afpd[68876]: Login by benc (AFP3.4)

There is no disconnect in messages, and nothing useful in debug.log. Thought I do get a Time Machine Error on the mac [PNG attached]

I do have 31 freenas-boot errors in debug (already uploaded) though:

Code:

[benc@freenas] /var/log# grep -i freenas-boot debug.log
Aug  3 00:27:26 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:28:44 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:30:26 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:31:07 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:31:46 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:32:15 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:32:39 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:33:32 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:35:33 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:49:39 freenas sync_disks.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:49:39 freenas sync_disks.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:53:23 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:53:28 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool scrub freenas-boot
Aug  3 00:53:29 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: zfs list -H -o name freenas-boot/.system/rrd freenas-boot/.system/syslog freenas-boot/.system/rrd-f6da24756e2f4dee86c3a9c9fb75829f freenas-boot/.system/syslog-f6da24756e2f4dee86c3a9c9fb75829f
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/cores"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/samba4"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/syslog-f6da24756e2f4dee86c3a9c9fb75829f"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/rrd-f6da24756e2f4dee86c3a9c9fb75829f"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/configs-f6da24756e2f4dee86c3a9c9fb75829f"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value aclmode "freenas-boot/.system"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: zfs list -H -o name freenas-boot/.system/rrd freenas-boot/.system/syslog freenas-boot/.system/rrd-f6da24756e2f4dee86c3a9c9fb75829f freenas-boot/.system/syslog-f6da24756e2f4dee86c3a9c9fb75829f
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/cores"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/samba4"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/syslog-f6da24756e2f4dee86c3a9c9fb75829f"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/rrd-f6da24756e2f4dee86c3a9c9fb75829f"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value mountpoint "freenas-boot/.system/configs-f6da24756e2f4dee86c3a9c9fb75829f"
Aug  3 00:53:45 freenas manage.py: [middleware.notifier:215] Popen()ing: /sbin/zfs get -H -o value aclmode "freenas-boot/.system"
Aug  3 19:45:07 freenas manage.py: [middleware.notifier:215] Popen()ing: zpool status freenas-boot

 

[OctaneZ]

I do have:

9.10-STABLE0201606270534 | On Reboot, Now | 2016-07-23

Scrub boot works successfully with no errors, I didn't snapshot before the upgrade, I generally don't on stable, think a reboot is safe?

 

[dlavigne]

Reboot and pick the boot environment from before you tried the upgrade.