Hi,
I have the following appear on my console and I wish to understand if there is an issue based on the output below:
Mar 12 04:30:11 UCTNAS01A lock order reversal:
Mar 12 04:30:11 UCTNAS01A 1st 0xfffffe0041519450 dn->dn_struct_rwlock (dn->dn_struct_rwlock, sx) @ /wrkdirs/usr/ports/sysutils/openzfs-kmod/work/zfs-2a0dae1b7/module/zfs/dmu.c:521
Mar 12 04:30:11 UCTNAS01A 2nd 0xfffff805701d6000 ms->ms_lock (ms->ms_lock, sx) @ /wrkdirs/usr/ports/sysutils/openzfs-kmod/work/zfs-2a0dae1b7/module/zfs/metaslab.c:6020
Mar 12 04:30:11 UCTNAS01A lock order ms->ms_lock -> dn->dn_struct_rwlock established at:
Mar 12 04:30:11 UCTNAS01A #0 0xffffffff80bb94ee at witness_checkorder+0x31e
Mar 12 04:30:11 UCTNAS01A #1 0xffffffff80b55727 at _sx_slock_int+0x67
Mar 12 04:30:11 UCTNAS01A #2 0xffffffff8291b9c5 at dnode_verify+0x95
Mar 12 04:30:11 UCTNAS01A #3 0xffffffff8291e8c3 at dnode_hold_impl+0x173
Mar 12 04:30:11 UCTNAS01A #4 0xffffffff828f96b8 at dmu_buf_hold_noread+0x28
Mar 12 04:30:11 UCTNAS01A #5 0xffffffff828f98bc at dmu_buf_hold+0x1c
Mar 12 04:30:11 UCTNAS01A #6 0xffffffff82a43ae1 at zap_lockdir+0x31
Mar 12 04:30:11 UCTNAS01A #7 0xffffffff82a452f9 at zap_lookup_norm+0x39
Mar 12 04:30:11 UCTNAS01A #8 0xffffffff82a452b1 at zap_lookup+0x11
Mar 12 04:30:11 UCTNAS01A #9 0xffffffff8299a4a2 at spa_cleanup_old_sm_logs+0x42
Mar 12 04:30:11 UCTNAS01A #10 0xffffffff82966f10 at metaslab_flush+0x3e0
Mar 12 04:30:11 UCTNAS01A #11 0xffffffff829999ac at spa_flush_metaslabs+0x1ec
Mar 12 04:30:11 UCTNAS01A #12 0xffffffff8298f6ed at spa_sync+0x123d
Mar 12 04:30:11 UCTNAS01A #13 0xffffffff829a609b at txg_sync_thread+0x35b
Mar 12 04:30:11 UCTNAS01A #14 0xffffffff80b02320 at fork_exit+0x80
Mar 12 04:30:11 UCTNAS01A #15 0xffffffff81067ade at fork_trampoline+0xe
Mar 12 04:30:11 UCTNAS01A lock order dn->dn_struct_rwlock -> ms->ms_lock attempted at:
Mar 12 04:30:11 UCTNAS01A #0 0xffffffff80bb9dad at witness_checkorder+0xbdd
Mar 12 04:30:11 UCTNAS01A #1 0xffffffff80b546b3 at _sx_xlock+0x63
Mar 12 04:30:11 UCTNAS01A #2 0xffffffff8296b8e7 at metaslab_check_free_impl+0xc7
Mar 12 04:30:11 UCTNAS01A #3 0xffffffff8296dc37 at metaslab_check_free+0x167
Mar 12 04:30:11 UCTNAS01A #4 0xffffffff82a74edb at zio_free+0x4b
Mar 12 04:30:11 UCTNAS01A #5 0xffffffff829262d6 at dsl_dataset_block_kill+0x2b6
Mar 12 04:30:11 UCTNAS01A #6 0xffffffff828f289d at dbuf_write_done+0xad
Mar 12 04:30:11 UCTNAS01A #7 0xffffffff828cdf20 at arc_write_done+0x440
Mar 12 04:30:11 UCTNAS01A #8 0xffffffff82a8005d at zio_done+0xeed
Mar 12 04:30:11 UCTNAS01A #9 0xffffffff82a76e1f at zio_execute+0xdf
Mar 12 04:30:11 UCTNAS01A #10 0xffffffff829c891c at vdev_queue_io_to_issue+0xa7c
Mar 12 04:30:11 UCTNAS01A #11 0xffffffff829c7cbe at vdev_queue_io+0x18e
Mar 12 04:30:11 UCTNAS01A #12 0xffffffff82a7e763 at zio_vdev_io_start+0x293
Mar 12 04:30:11 UCTNAS01A #13 0xffffffff82a755af at zio_nowait+0x15f
Mar 12 04:30:11 UCTNAS01A #14 0xffffffff829cdf47 at vdev_raidz_io_start+0x3b7
Mar 12 04:30:11 UCTNAS01A #15 0xffffffff82a7e7a4 at zio_vdev_io_start+0x2d4
Mar 12 04:30:11 UCTNAS01A #16 0xffffffff82a755af at zio_nowait+0x15f
Mar 12 04:30:11 UCTNAS01A #17 0xffffffff829c654d at vdev_mirror_io_start+0xfd
Thank you,
Pat
I have the following appear on my console and I wish to understand if there is an issue based on the output below:
Mar 12 04:30:11 UCTNAS01A lock order reversal:
Mar 12 04:30:11 UCTNAS01A 1st 0xfffffe0041519450 dn->dn_struct_rwlock (dn->dn_struct_rwlock, sx) @ /wrkdirs/usr/ports/sysutils/openzfs-kmod/work/zfs-2a0dae1b7/module/zfs/dmu.c:521
Mar 12 04:30:11 UCTNAS01A 2nd 0xfffff805701d6000 ms->ms_lock (ms->ms_lock, sx) @ /wrkdirs/usr/ports/sysutils/openzfs-kmod/work/zfs-2a0dae1b7/module/zfs/metaslab.c:6020
Mar 12 04:30:11 UCTNAS01A lock order ms->ms_lock -> dn->dn_struct_rwlock established at:
Mar 12 04:30:11 UCTNAS01A #0 0xffffffff80bb94ee at witness_checkorder+0x31e
Mar 12 04:30:11 UCTNAS01A #1 0xffffffff80b55727 at _sx_slock_int+0x67
Mar 12 04:30:11 UCTNAS01A #2 0xffffffff8291b9c5 at dnode_verify+0x95
Mar 12 04:30:11 UCTNAS01A #3 0xffffffff8291e8c3 at dnode_hold_impl+0x173
Mar 12 04:30:11 UCTNAS01A #4 0xffffffff828f96b8 at dmu_buf_hold_noread+0x28
Mar 12 04:30:11 UCTNAS01A #5 0xffffffff828f98bc at dmu_buf_hold+0x1c
Mar 12 04:30:11 UCTNAS01A #6 0xffffffff82a43ae1 at zap_lockdir+0x31
Mar 12 04:30:11 UCTNAS01A #7 0xffffffff82a452f9 at zap_lookup_norm+0x39
Mar 12 04:30:11 UCTNAS01A #8 0xffffffff82a452b1 at zap_lookup+0x11
Mar 12 04:30:11 UCTNAS01A #9 0xffffffff8299a4a2 at spa_cleanup_old_sm_logs+0x42
Mar 12 04:30:11 UCTNAS01A #10 0xffffffff82966f10 at metaslab_flush+0x3e0
Mar 12 04:30:11 UCTNAS01A #11 0xffffffff829999ac at spa_flush_metaslabs+0x1ec
Mar 12 04:30:11 UCTNAS01A #12 0xffffffff8298f6ed at spa_sync+0x123d
Mar 12 04:30:11 UCTNAS01A #13 0xffffffff829a609b at txg_sync_thread+0x35b
Mar 12 04:30:11 UCTNAS01A #14 0xffffffff80b02320 at fork_exit+0x80
Mar 12 04:30:11 UCTNAS01A #15 0xffffffff81067ade at fork_trampoline+0xe
Mar 12 04:30:11 UCTNAS01A lock order dn->dn_struct_rwlock -> ms->ms_lock attempted at:
Mar 12 04:30:11 UCTNAS01A #0 0xffffffff80bb9dad at witness_checkorder+0xbdd
Mar 12 04:30:11 UCTNAS01A #1 0xffffffff80b546b3 at _sx_xlock+0x63
Mar 12 04:30:11 UCTNAS01A #2 0xffffffff8296b8e7 at metaslab_check_free_impl+0xc7
Mar 12 04:30:11 UCTNAS01A #3 0xffffffff8296dc37 at metaslab_check_free+0x167
Mar 12 04:30:11 UCTNAS01A #4 0xffffffff82a74edb at zio_free+0x4b
Mar 12 04:30:11 UCTNAS01A #5 0xffffffff829262d6 at dsl_dataset_block_kill+0x2b6
Mar 12 04:30:11 UCTNAS01A #6 0xffffffff828f289d at dbuf_write_done+0xad
Mar 12 04:30:11 UCTNAS01A #7 0xffffffff828cdf20 at arc_write_done+0x440
Mar 12 04:30:11 UCTNAS01A #8 0xffffffff82a8005d at zio_done+0xeed
Mar 12 04:30:11 UCTNAS01A #9 0xffffffff82a76e1f at zio_execute+0xdf
Mar 12 04:30:11 UCTNAS01A #10 0xffffffff829c891c at vdev_queue_io_to_issue+0xa7c
Mar 12 04:30:11 UCTNAS01A #11 0xffffffff829c7cbe at vdev_queue_io+0x18e
Mar 12 04:30:11 UCTNAS01A #12 0xffffffff82a7e763 at zio_vdev_io_start+0x293
Mar 12 04:30:11 UCTNAS01A #13 0xffffffff82a755af at zio_nowait+0x15f
Mar 12 04:30:11 UCTNAS01A #14 0xffffffff829cdf47 at vdev_raidz_io_start+0x3b7
Mar 12 04:30:11 UCTNAS01A #15 0xffffffff82a7e7a4 at zio_vdev_io_start+0x2d4
Mar 12 04:30:11 UCTNAS01A #16 0xffffffff82a755af at zio_nowait+0x15f
Mar 12 04:30:11 UCTNAS01A #17 0xffffffff829c654d at vdev_mirror_io_start+0xfd
Thank you,
Pat