Freenas crashign whenever trying to install Radarr plugin

[Commissar]

so, my freenas box will crash every time I try to install the Radarr plugin. i've run a memtest just last night, all 4 passes were good. also sometimes will crash overnight as of late.

NAS

pcpartpicker.com

 

[Commissar]

now crashing randomly.

 

[SweetAndLow]

Forum Rules

Welcome to the TrueNAS Community! Updated 11/28/2023 First and foremost I want to thank you for joining the TrueNAS community! My name is JoshDW19 and I'm the Community Manager here at TrueNAS. The TrueNAS Community is a friendly place to discuss open source software, technology, and products...

www.ixsystems.com

 

[Commissar]

Forum Rules

Welcome to the TrueNAS Community! Updated 11/28/2023 First and foremost I want to thank you for joining the TrueNAS community! My name is JoshDW19 and I'm the Community Manager here at TrueNAS. The TrueNAS Community is a friendly place to discuss open source software, technology, and products...

www.ixsystems.com

?

 

[Commissar]

I guess i should put in build number... 11.3 release.

 

[Commissar]

here's what i found to be the interesting parts of the dump log from yesterday

Code:

<118>Sun Feb 23 10:05:38 CST 2020
lock order reversal:
1st 0xfffff806b5f54240 zfs (zfs) @ /freenas-releng/freenas/_BE/os/sys/kern/vfs_mount.c:908
2nd 0xfffff8013f2e5068 devfs (devfs) @ /freenas-releng/freenas/_BE/os/sys/kern/vfs_mount.c:919
stack backtrace:
#0 0xffffffff80b6f860 at witness_debugger+0x70
#1 0xffffffff80b6f6f6 at witness_checkorder+0xe76
#2 0xffffffff80adff51 at lockmgr_lock_fast_path+0x1b1
#3 0xffffffff811eb8e1 at VOP_LOCK1_APV+0xe1
#4 0xffffffff80be9947 at _vn_lock+0x67
#5 0xffffffff80bd08cd at vfs_domount+0xd1d
#6 0xffffffff80bcf602 at vfs_donmount+0x7b2
#7 0xffffffff80bcee21 at sys_nmount+0x71
#8 0xffffffff8101a712 at amd64_syscall+0x792
#9 0xffffffff80ff4a7d at fast_syscall_common+0x101
bridge0: Ethernet address: 02:df:0a:b7:00:00
<5>bridge0: link state changed to UP
<6>em0: promiscuous mode enabled
epair0a: Ethernet address: 02:ff:d0:00:05:0a
epair0b: Ethernet address: 02:ff:d0:00:06:0b
<5>epair0a: link state changed to UP
<5>epair0b: link state changed to UP
<6>epair0a: changing name to 'vnet0.1'
<5>em0: link state changed to DOWN
<6>vnet0.1: promiscuous mode enabled
<5>lo0: link state changed to UP
<5>em0: link state changed to UP
epair1a: Ethernet address: 02:ff:d0:00:06:0a
epair1b: Ethernet address: 02:ff:d0:00:07:0b
<5>epair1a: link state changed to UP
<5>epair1b: link state changed to UP
<6>epair1a: changing name to 'vnet0.2'
<6>epair1b: changing name to 'epair0b'
<6>vnet0.2: promiscuous mode enabled
<5>lo0: link state changed to UP
epair2a: Ethernet address: 02:ff:d0:00:07:0a
epair2b: Ethernet address: 02:ff:d0:00:08:0b
<5>epair2a: link state changed to UP
<5>epair2b: link state changed to UP
<6>epair2a: changing name to 'vnet0.3'
<6>epair2b: changing name to 'epair0b'
<6>vnet0.3: promiscuous mode enabled
<5>lo0: link state changed to UP
<5>tun0: link state changed to UP
lock order reversal: (sleepable after non-sleepable)
1st 0xffffffff8242a7a8 in_multi_mtx (in_multi_mtx) @ /freenas-releng/freenas/_BE/os/sys/netinet/in_mcast.c:1141
2nd 0xffffffff82304480 tun_ioctl (tun_ioctl) @ /freenas-releng/freenas/_BE/os/sys/net/if_tun.c:605
stack backtrace:
#0 0xffffffff80b6f860 at witness_debugger+0x70
#1 0xffffffff80b6f6f6 at witness_checkorder+0xe76
#2 0xffffffff80b12db8 at _sx_xlock+0x68
#3 0xffffffff80c31b84 at tunifioctl+0x34
#4 0xffffffff80c195b9 at if_addmulti+0x229
#5 0xffffffff80c631b6 at in_joingroup_locked+0x116
#6 0xffffffff80c63072 at in_joingroup+0x42
#7 0xffffffff80c5a808 at in_control+0x988
#8 0xffffffff80c1a23f at ifioctl+0x61f
#9 0xffffffff80b753af at kern_ioctl+0x29f
#10 0xffffffff80b7509b at sys_ioctl+0x15b
#11 0xffffffff8101a712 at amd64_syscall+0x792
#12 0xffffffff80ff4a7d at fast_syscall_common+0x101
<5>tun0: link state changed to DOWN
<5>Limiting closed port RST response from 294 to 200 packets/sec
<5>tun0: link state changed to UP
lock order reversal:
1st 0xfffff806058f1b78 zfs (zfs) @ /freenas-releng/freenas/_BE/os/sys/kern/vfs_extattr.c:643
2nd 0xfffff800977368e0 filedesc structure (filedesc structure) @ /freenas-releng/freenas/_BE/os/sys/kern/vfs_lookup.c:378
stack backtrace:
#0 0xffffffff80b6f860 at witness_debugger+0x70
#1 0xffffffff80b6f6f6 at witness_checkorder+0xe76
#2 0xffffffff80b13d78 at _sx_slock_int+0x68
#3 0xffffffff80bcc5a7 at namei+0x217
#4 0xffffffff804b79a0 at zfs_listextattr+0x280
#5 0xffffffff811ed96d at VOP_LISTEXTATTR_APV+0xfd
#6 0xffffffff80bcb1b9 at extattr_list_vp+0x129
#7 0xffffffff80bcb041 at sys_extattr_list_fd+0x91
#8 0xffffffff8101a712 at amd64_syscall+0x792
#9 0xffffffff80ff4a7d at fast_syscall_common+0x101
lock order reversal:
1st 0xfffffe002b90e2c8 PFil shared rmlock (PFil shared rmlock) @ /freenas-releng/freenas/_BE/os/sys/net/pfil.c:104
2nd 0xfffffe002b925510 pcbinfohash (pcbinfohash) @ /freenas-releng/freenas/_BE/os/sys/netinet/in_pcb.c:1975
stack backtrace:
#0 0xffffffff80b6f860 at witness_debugger+0x70
#1 0xffffffff80b6f6f6 at witness_checkorder+0xe76
#2 0xffffffff80b065fb at __rw_rlock_int+0x8b
#3 0xffffffff80c6a359 at in_pcblookup_hash+0x39
#4 0xffffffff80cf510e at check_uidgid+0x1ee
#5 0xffffffff80cf275d at ipfw_chk+0x11dd
#6 0xffffffff80cfdfa5 at ipfw_check_packet+0xd5
#7 0xffffffff80c46b02 at pfil_run_hooks+0xc2
#8 0xffffffff80c70743 at ip_input+0x4a3
#9 0xffffffff80c45941 at netisr_dispatch_src+0xa1
#10 0xffffffff80c26a3f at ether_demux+0x15f
#11 0xffffffff80c27fcd at ether_nh_input+0x3ad
#12 0xffffffff80c45941 at netisr_dispatch_src+0xa1
#13 0xffffffff80c26eff at ether_input+0x8f
#14 0xffffffff80c24997 at epair_nh_sintr+0x17
#15 0xffffffff80c46219 at swi_net+0x1b9
#16 0xffffffff80ace57a at intr_event_execute_handlers+0x9a
#17 0xffffffff80acec67 at ithread_loop+0xb7
lock order reversal:
1st 0xfffffe002b90e2c8 PFil shared rmlock (PFil shared rmlock) @ /freenas-releng/freenas/_BE/os/sys/net/pfil.c:104
2nd 0xfffff8016e81f508 tcpinp (tcpinp) @ /freenas-releng/freenas/_BE/os/sys/netinet/in_pcb.c:1994
stack backtrace:
#0 0xffffffff80b6f860 at witness_debugger+0x70
#1 0xffffffff80b6f6f6 at witness_checkorder+0xe76
#2 0xffffffff80b065fb at __rw_rlock_int+0x8b
#3 0xffffffff80c6a4a2 at in_pcblookup_hash+0x182
#4 0xffffffff80cf510e at check_uidgid+0x1ee
#5 0xffffffff80cf275d at ipfw_chk+0x11dd
#6 0xffffffff80cfdfa5 at ipfw_check_packet+0xd5
#7 0xffffffff80c46b02 at pfil_run_hooks+0xc2
#8 0xffffffff80c70743 at ip_input+0x4a3
#9 0xffffffff80c45941 at netisr_dispatch_src+0xa1
#10 0xffffffff80c26a3f at ether_demux+0x15f
#11 0xffffffff80c27fcd at ether_nh_input+0x3ad
#12 0xffffffff80c45941 at netisr_dispatch_src+0xa1
#13 0xffffffff80c26eff at ether_input+0x8f
#14 0xffffffff80c24997 at epair_nh_sintr+0x17
#15 0xffffffff80c46219 at swi_net+0x1b9
#16 0xffffffff80ace57a at intr_event_execute_handlers+0x9a
#17 0xffffffff80acec67 at ithread_loop+0xb7
<5>tun0: link state changed to DOWN
<5>tun0: link state changed to UP
ahcich8: Timeout on slot 21 port 0
ahcich8: is 00000000 cs 08000000 ss 0e3fffe0 rs 0e3fffe0 tfd 40 serr 00000000 cmd 0004db17
(ada4:ahcich8:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 28 20 df 0f 40 8b 00 00 00 00 00
(ada4:ahcich8:0:0:0): CAM status: Command timeout
(ada4:ahcich8:0:0:0): Retrying command
ahcich8: Timeout on slot 23 port 0
ahcich8: is 00000000 cs 01c00000 ss e1e3ffff rs e1e3ffff tfd 40 serr 00000000 cmd 0004d417
(ada4:ahcich8:0:0:0): READ_FPDMA_QUEUED. ACB: 60 80 c0 82 f5 40 62 00 00 00 00 00
(ada4:ahcich8:0:0:0): CAM status: Command timeout
(ada4:ahcich8:0:0:0): Retrying command
ahcich8: Timeout on slot 4 port 0
ahcich8: is 00000000 cs 00200000 ss 183fd0b0 rs 183fd0b0 tfd 00 serr 00000000 cmd 0004d317
(ada4:ahcich8:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 08 50 ca c0 40 28 01 00 00 00 00
(ada4:ahcich8:0:0:0): CAM status: Command timeout
(ada4:ahcich8:0:0:0): Retrying command
panic: solaris assert: abd_cmp_buf(abd, buf, n) == 0 (0xffffffffffffffb3 == 0x0), file: /freenas-releng/freenas/_BE/os/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/abd.c, line: 598
cpuid = 3
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe085ed5d810
vpanic() at vpanic+0x17e/frame 0xfffffe085ed5d870
panic() at panic+0x43/frame 0xfffffe085ed5d8d0
assfail3() at assfail3+0x2c/frame 0xfffffe085ed5d8f0
abd_return_buf() at abd_return_buf+0x8d/frame 0xfffffe085ed5d920
abd_return_buf_copy() at abd_return_buf_copy+0x42/frame 0xfffffe085ed5d950
vdev_geom_io_done() at vdev_geom_io_done+0x3d/frame 0xfffffe085ed5d970
zio_vdev_io_done() at zio_vdev_io_done+0x23b/frame 0xfffffe085ed5d9a0
zio_execute() at zio_execute+0x17c/frame 0xfffffe085ed5d9e0
taskqueue_run_locked() at taskqueue_run_locked+0x16c/frame 0xfffffe085ed5da40
taskqueue_thread_loop() at taskqueue_thread_loop+0xa8/frame 0xfffffe085ed5da70
fork_exit() at fork_exit+0x84/frame 0xfffffe085ed5dab0
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe085ed5dab0
--- trap 0, rip = 0, rsp = 0, rbp = 0 ---
KDB: enter: panic