TLDR - I'm getting multiple crashes and reboots on my TrueNAS system with error code
System Info
OS: ESXi-8.0a-20842819-standard running TrueNAS-13.0-U3.1 in a VM (with PCIE passthrough)
Motherboard: MSI PRO Z790-A WIFI (latest BIOS: 7E07vA3)
CPU: Intel i7-13700K (E-Cores disabled in BIOS)
RAM: 2 x Crucial 32GB DDR5 5200
Hard Drives: 6 x Seagate EXOS X18 18TB (ST18000NM000J) all running SN04 firmware
HBA: LSI 9300-16i using PCIE passthrough directly to the VM. running firmware 16.00.12.00
VM Boot drives: 2 x vmware disks on separate datastores.
Network card: Intel 2.5G LAN
I have tried two different LSI controller cards passed-through and with different firmwares but have the same issue.
I have also run memtest86 on the machine for 24hours with no errors.
I've created a VM and installed TrueNAS-13.0-U3.1 using PCIE passthrough of the LSI controller and reserved 32GB RAM for the VM, it's got 4 vCPU cores.
After running for various amounts of time - can be 5minutes of 12hours the VM will crash and I get the "Unscheduled reboot" in the webui log and an output in /var/log/message like this:
mpr0: IOC Fault 0x40005854, ResettingSystem Info
OS: ESXi-8.0a-20842819-standard running TrueNAS-13.0-U3.1 in a VM (with PCIE passthrough)
Motherboard: MSI PRO Z790-A WIFI (latest BIOS: 7E07vA3)
CPU: Intel i7-13700K (E-Cores disabled in BIOS)
RAM: 2 x Crucial 32GB DDR5 5200
Hard Drives: 6 x Seagate EXOS X18 18TB (ST18000NM000J) all running SN04 firmware
HBA: LSI 9300-16i using PCIE passthrough directly to the VM. running firmware 16.00.12.00
VM Boot drives: 2 x vmware disks on separate datastores.
Network card: Intel 2.5G LAN
I have tried two different LSI controller cards passed-through and with different firmwares but have the same issue.
I have also run memtest86 on the machine for 24hours with no errors.
I've created a VM and installed TrueNAS-13.0-U3.1 using PCIE passthrough of the LSI controller and reserved 32GB RAM for the VM, it's got 4 vCPU cores.
After running for various amounts of time - can be 5minutes of 12hours the VM will crash and I get the "Unscheduled reboot" in the webui log and an output in /var/log/message like this:
Code:
Feb 14 12:35:41 nas mpr0: IOC Fault 0x40005854, Resetting Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas mpr0: Calling Reinit from mpr_wait_command, timeout=60, elapsed=61 Feb 14 12:35:41 nas mpr0: Reinitializing controller Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas Fatal trap 12: page fault while in kernel mode Feb 14 12:35:41 nas cpuid = 0; apic id = 00 Feb 14 12:35:41 nas fault virtual address = 0x440 Feb 14 12:35:41 nas fault code = supervisor read data, page not present Feb 14 12:35:41 nas instruction pointer = 0x20:0xffffffff80b22aae Feb 14 12:35:41 nas stack pointer = 0x28:0xfffffe013d48c8f0 Feb 14 12:35:41 nas frame pointer = 0x28:0xfffffe013d48c990 Feb 14 12:35:41 nas code segment = base 0x0, limit 0xfffff, type 0x1b Feb 14 12:35:41 nas = DPL 0, pres 1, long 1, def32 0, gran 1 Feb 14 12:35:41 nas processor eflags = interrupt enabled, resume, IOPL = 0 Feb 14 12:35:41 nas current process = 472 (python3.9) Feb 14 12:35:41 nas trap number = 12 Feb 14 12:35:41 nas panic: page fault Feb 14 12:35:41 nas cpuid = 0 Feb 14 12:35:41 nas time = 1676399691 Feb 14 12:35:41 nas KDB: stack backtrace: Feb 14 12:35:41 nas db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe013d48c6b0 Feb 14 12:35:41 nas vpanic() at vpanic+0x17f/frame 0xfffffe013d48c700 Feb 14 12:35:41 nas panic() at panic+0x43/frame 0xfffffe013d48c760 Feb 14 12:35:41 nas trap_fatal() at trap_fatal+0x385/frame 0xfffffe013d48c7c0 Feb 14 12:35:41 nas trap_pfault() at trap_pfault+0x4f/frame 0xfffffe013d48c820 Feb 14 12:35:41 nas calltrap() at calltrap+0x8/frame 0xfffffe013d48c820 Feb 14 12:35:41 nas --- trap 0xc, rip = 0xffffffff80b22aae, rsp = 0xfffffe013d48c8f0, rbp = 0xfffffe013d48c990 --- Feb 14 12:35:41 nas _sx_xlock_hard() at _sx_xlock_hard+0x17e/frame 0xfffffe013d48c990 Feb 14 12:35:41 nas dmu_objset_from_ds() at dmu_objset_from_ds+0x34/frame 0xfffffe013d48c9d0 Feb 14 12:35:41 nas dmu_objset_hold_flags() at dmu_objset_hold_flags+0x5c/frame 0xfffffe013d48ca20 Feb 14 12:35:41 nas zfs_ioc_objset_zplprops() at zfs_ioc_objset_zplprops+0x20/frame 0xfffffe013d48ca60 Feb 14 12:35:41 nas zfsdev_ioctl_common() at zfsdev_ioctl_common+0x548/frame 0xfffffe013d48cb20 Feb 14 12:35:41 nas zfsdev_ioctl() at zfsdev_ioctl+0x143/frame 0xfffffe013d48cb50 Feb 14 12:35:41 nas devfs_ioctl() at devfs_ioctl+0xc6/frame 0xfffffe013d48cba0 Feb 14 12:35:41 nas vn_ioctl() at vn_ioctl+0x1a4/frame 0xfffffe013d48ccb0 Feb 14 12:35:41 nas devfs_ioctl_f() at devfs_ioctl_f+0x1e/frame 0xfffffe013d48ccd0 Feb 14 12:35:41 nas kern_ioctl() at kern_ioctl+0x25b/frame 0xfffffe013d48cd40 Feb 14 12:35:41 nas sys_ioctl() at sys_ioctl+0xf1/frame 0xfffffe013d48ce00 Feb 14 12:35:41 nas amd64_syscall() at amd64_syscall+0x10c/frame 0xfffffe013d48cf30 Feb 14 12:35:41 nas fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe013d48cf30 Feb 14 12:35:41 nas --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x8007a8e7a, rsp = 0x7fffffffadc8, rbp = 0x7fffffffae30 --- Feb 14 12:35:41 nas KDB: enter: panic Feb 14 12:35:41 nas ---<<BOOT>>--- Feb 14 12:35:41 nas Copyright (c) 1992-2021 The FreeBSD Project. Feb 14 12:35:41 nas Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 Feb 14 12:35:41 nas The Regents of the University of California. All rights reserved. Feb 14 12:35:41 nas FreeBSD is a registered trademark of The FreeBSD Foundation. Feb 14 12:35:41 nas FreeBSD 13.1-RELEASE-p2 n245412-484f039b1d0 TRUENAS amd64 Feb 14 12:35:41 nas FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303) Feb 14 12:35:41 nas VT(vga): text 80x25 Feb 14 12:35:41 nas CPU: 13th Gen Intel(R) Core(TM) i7-13700K (3417.60-MHz K8-class CPU) Feb 14 12:35:41 nas Origin="GenuineIntel" Id=0xb0671 Family=0x6 Model=0xb7 Stepping=1 Feb 14 12:35:41 nas Features=0x1f83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,SS,HTT> Feb 14 12:35:41 nas Features2=0xfffa3203<SSE3,PCLMULQDQ,SSSE3,FMA,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV> Feb 14 12:35:41 nas AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM> Feb 14 12:35:41 nas AMD Features2=0x121<LAHF,ABM,Prefetch> Feb 14 12:35:41 nas Structured Extended Features=0x219c27eb<FSGSBASE,TSCADJ,BMI1,AVX2,FDPEXC,SMEP,BMI2,ERMS,INVPCID,NFPUSG,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,SHA> Feb 14 12:35:41 nas Structured Extended Features2=0x9840078c<UMIP,PKU,GFNI,VAES,VPCLMULQDQ,RDPID,MOVDIRI,MOVDIR64B> Feb 14 12:35:41 nas Structured Extended Features3=0xbc004410<FSRM,MD_CLEAR,IBPB,STIBP,L1DFL,ARCH_CAP,SSBD> Feb 14 12:35:41 nas XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES> Feb 14 12:35:41 nas IA32_ARCH_CAPS=0x2b<RDCL_NO,IBRS_ALL,SKIP_L1DFL_VME,MDS_NO> Feb 14 12:35:41 nas TSC: P-state invariant Feb 14 12:35:41 nas Hypervisor: Origin = "VMwareVMware" Feb 14 12:35:41 nas real memory = 34359738368 (32768 MB) Feb 14 12:35:41 nas avail memory = 33345449984 (31800 MB) Feb 14 12:35:41 nas Event timer "LAPIC" quality 600 Feb 14 12:35:41 nas ACPI APIC Table: <PTLTD APIC > Feb 14 12:35:41 nas FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs Feb 14 12:35:41 nas FreeBSD/SMP: 1 package(s) x 4 core(s) Feb 14 12:35:41 nas random: registering fast source Intel Secure Key RNG Feb 14 12:35:41 nas random: fast provider: "Intel Secure Key RNG" Feb 14 12:35:41 nas random: unblocking device. Feb 14 12:35:41 nas MADT: Forcing active-low polarity and level trigger for SCI Feb 14 12:35:41 nas ioapic0 <Version 2.0> irqs 0-23 Feb 14 12:35:41 nas Launching APs: 3 1 2 Feb 14 12:35:41 nas random: entropy device external interface Feb 14 12:35:41 nas kbd1 at kbdmux0 Feb 14 12:35:41 nas vtvga0: <VT VGA driver> Feb 14 12:35:41 nas aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256> Feb 14 12:35:41 nas padlock0: No ACE support. Feb 14 12:35:41 nas acpi0: <INTEL 440BX> Feb 14 12:35:41 nas acpi0: Power Button (fixed) Feb 14 12:35:41 nas hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Feb 14 12:35:41 nas Timecounter "HPET" frequency 14318180 Hz quality 950 Feb 14 12:35:41 nas cpu0: <ACPI CPU> numa-domain 0 on acpi0 Feb 14 12:35:41 nas attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0 Feb 14 12:35:41 nas Timecounter "i8254" frequency 1193182 Hz quality 0 Feb 14 12:35:41 nas Event timer "i8254" frequency 1193182 Hz quality 100 Feb 14 12:35:41 nas atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0 Feb 14 12:35:41 nas atrtc0: registered as a time-of-day clock, resolution 1.000000s Feb 14 12:35:41 nas Event timer "RTC" frequency 32768 Hz quality 0 Feb 14 12:35:41 nas Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 Feb 14 12:35:41 nas acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 Feb 14 12:35:41 nas pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 Feb 14 12:35:41 nas pci0: <ACPI PCI bus> on pcib0 Feb 14 12:35:41 nas pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0 Feb 14 12:35:41 nas pci1: <ACPI PCI bus> on pcib1 Feb 14 12:35:41 nas isab0: <PCI-ISA bridge> at device 7.0 on pci0 Feb 14 12:35:41 nas isa0: <ISA bus> on isab0 Feb 14 12:35:41 nas atapci0: <Intel PIIX4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1060-0x106f at device 7.1 on pci0 Feb 14 12:35:41 nas ata0: <ATA channel> at channel 0 on atapci0 Feb 14 12:35:41 nas ata1: <ATA channel> at channel 1 on atapci0 Feb 14 12:35:41 nas pci0: <bridge> at device 7.3 (no driver attached) Feb 14 12:35:41 nas vgapci0: <VGA-compatible display> port 0x1070-0x107f mem 0xe8000000-0xefffffff,0xfe000000-0xfe7fffff irq 16 at device 15.0 on pci0 Feb 14 12:35:41 nas vgapci0: Boot video device Feb 14 12:35:41 nas pcib2: <ACPI PCI-PCI bridge> at device 17.0 on pci0 Feb 14 12:35:41 nas pci2: <ACPI PCI bus> on pcib2 Feb 14 12:35:41 nas pcib3: <ACPI PCI-PCI bridge> at device 21.0 on pci0 Feb 14 12:35:41 nas pci3: <ACPI PCI bus> on pcib3 Feb 14 12:35:41 nas pvscsi0: <VMware Paravirtual SCSI Controller> port 0x4000-0x4007 mem 0xfd5f8000-0xfd5fffff irq 18 at device 0.0 on pci3 Feb 14 12:35:41 nas pvscsi0: Interrupt: MSI-X Feb 14 12:35:41 nas pvscsi0: Use Msg: 1 Feb 14 12:35:41 nas pvscsi0: REQ num pages: 32 Feb 14 12:35:41 nas pvscsi0: CMP num pages: 32 Feb 14 12:35:41 nas pvscsi0: MSG num pages: 1 Feb 14 12:35:41 nas pvscsi0: Queue size: 1024 Feb 14 12:35:41 nas pvscsi0: Adapter Reset Feb 14 12:35:41 nas pcib4: <ACPI PCI-PCI bridge> at device 21.1 on pci0 Feb 14 12:35:41 nas pcib5: <ACPI PCI-PCI bridge> at device 21.2 on pci0 Feb 14 12:35:41 nas pcib6: <ACPI PCI-PCI bridge> at device 21.3 on pci0 Feb 14 12:35:41 nas pcib7: <ACPI PCI-PCI bridge> at device 21.4 on pci0 Feb 14 12:35:41 nas pcib8: <ACPI PCI-PCI bridge> at device 21.5 on pci0 Feb 14 12:35:41 nas pcib9: <ACPI PCI-PCI bridge> at device 21.6 on pci0 Feb 14 12:35:41 nas pcib10: <ACPI PCI-PCI bridge> at device 21.7 on pci0 Feb 14 12:35:41 nas pcib11: <ACPI PCI-PCI bridge> at device 22.0 on pci0 Feb 14 12:35:41 nas pci4: <ACPI PCI bus> on pcib11 Feb 14 12:35:41 nas vmx0: <VMware VMXNET3 Ethernet Adapter> port 0x5000-0x500f mem 0xfd4fc000-0xfd4fcfff,0xfd4fd000-0xfd4fdfff,0xfd4fe000-0xfd4fffff irq 19 at device 0.0 on pci4 Feb 14 12:35:41 nas vmx0: Using 512 TX descriptors and 512 RX descriptors Feb 14 12:35:41 nas vmx0: Using 4 RX queues 4 TX queues Feb 14 12:35:41 nas vmx0: Using MSI-X interrupts with 5 vectors Feb 14 12:35:41 nas kernel: vmx0: Ethernet address: 00:0c:29:8c:f6:df Feb 14 12:35:41 nas pcib12: <ACPI PCI-PCI bridge> at device 22.1 on pci0 Feb 14 12:35:41 nas pcib13: <ACPI PCI-PCI bridge> at device 22.2 on pci0 Feb 14 12:35:41 nas pcib14: <ACPI PCI-PCI bridge> at device 22.3 on pci0 Feb 14 12:35:41 nas pcib15: <ACPI PCI-PCI bridge> at device 22.4 on pci0 Feb 14 12:35:41 nas pcib16: <ACPI PCI-PCI bridge> at device 22.5 on pci0 Feb 14 12:35:41 nas pcib17: <ACPI PCI-PCI bridge> at device 22.6 on pci0 Feb 14 12:35:41 nas pcib18: <ACPI PCI-PCI bridge> at device 22.7 on pci0 Feb 14 12:35:41 nas pcib19: <ACPI PCI-PCI bridge> at device 23.0 on pci0 Feb 14 12:35:41 nas pci5: <ACPI PCI bus> on pcib19 Feb 14 12:35:41 nas mpr0: <Avago Technologies (LSI) SAS3008> port 0x6000-0x60ff mem 0xfd3f0000-0xfd3fffff,0xfd380000-0xfd3bffff irq 16 at device 0.0 on pci5 Feb 14 12:35:41 nas mpr0: IOC in fault state 0x0, resetting Feb 14 12:35:41 nas mpr0: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas pcib20: <ACPI PCI-PCI bridge> at device 23.1 on pci0 Feb 14 12:35:41 nas pcib21: <ACPI PCI-PCI bridge> at device 23.2 on pci0 Feb 14 12:35:41 nas pcib22: <ACPI PCI-PCI bridge> at device 23.3 on pci0 Feb 14 12:35:41 nas pcib23: <ACPI PCI-PCI bridge> at device 23.4 on pci0 Feb 14 12:35:41 nas pcib24: <ACPI PCI-PCI bridge> at device 23.5 on pci0 Feb 14 12:35:41 nas pcib25: <ACPI PCI-PCI bridge> at device 23.6 on pci0 Feb 14 12:35:41 nas pcib26: <ACPI PCI-PCI bridge> at device 23.7 on pci0 Feb 14 12:35:41 nas pcib27: <ACPI PCI-PCI bridge> at device 24.0 on pci0 Feb 14 12:35:41 nas pci6: <ACPI PCI bus> on pcib27 Feb 14 12:35:41 nas mpr1: <Avago Technologies (LSI) SAS3008> port 0x7000-0x70ff mem 0xfd2f0000-0xfd2fffff,0xfd280000-0xfd2bffff irq 17 at device 0.0 on pci6 Feb 14 12:35:41 nas mpr1: Firmware: 16.00.12.00, Driver: 23.00.00.00-fbsd Feb 14 12:35:41 nas mpr1: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> Feb 14 12:35:41 nas pcib28: <ACPI PCI-PCI bridge> at device 24.1 on pci0 Feb 14 12:35:41 nas pcib29: <ACPI PCI-PCI bridge> at device 24.2 on pci0 Feb 14 12:35:41 nas pcib30: <ACPI PCI-PCI bridge> at device 24.3 on pci0 Feb 14 12:35:41 nas pcib31: <ACPI PCI-PCI bridge> at device 24.4 on pci0 Feb 14 12:35:41 nas pcib32: <ACPI PCI-PCI bridge> at device 24.5 on pci0 Feb 14 12:35:41 nas pcib33: <ACPI PCI-PCI bridge> at device 24.6 on pci0 Feb 14 12:35:41 nas pcib34: <ACPI PCI-PCI bridge> at device 24.7 on pci0 Feb 14 12:35:41 nas acpi_acad0: <AC Adapter> on acpi0 Feb 14 12:35:41 nas atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 Feb 14 12:35:41 nas atkbd0: <AT Keyboard> irq 1 on atkbdc0 Feb 14 12:35:41 nas kbd0 at atkbd0 Feb 14 12:35:41 nas atkbd0: [GIANT-LOCKED] Feb 14 12:35:41 nas psm0: <PS/2 Mouse> irq 12 on atkbdc0 Feb 14 12:35:41 nas psm0: [GIANT-LOCKED] Feb 14 12:35:41 nas WARNING: Device "psm" is Giant locked and may be deleted before FreeBSD 14.0. Feb 14 12:35:41 nas psm0: model IntelliMouse, device ID 3 Feb 14 12:35:41 nas acpi_syscontainer0: <System Container> on acpi0 Feb 14 12:35:41 nas orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc9fff,0xca000-0xcafff,0xdc000-0xdffff,0xe0000-0xe7fff pnpid ORM0000 on isa0 Feb 14 12:35:41 nas Timecounter "TSC-low" frequency 1708800000 Hz quality 1000 Feb 14 12:35:41 nas Timecounters tick every 10.000 msec Feb 14 12:35:41 nas ZFS filesystem version: 5 Feb 14 12:35:41 nas ZFS storage pool version: features support (5000) Feb 14 12:35:41 nas ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled Feb 14 12:35:41 nas usb_needs_explore_all: no devclass Feb 14 12:35:41 nas mpr1: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0009> enclosureHandle<0x0001> slot 5 Feb 14 12:35:41 nas mpr1: At enclosure level 0 and connector name ( ) Feb 14 12:35:41 nas Trying to mount root from zfs:boot-pool/ROOT/default []... Feb 14 12:35:41 nas Root mount waiting for: CAM Feb 14 12:35:41 nas mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0009> enclosureHandle<0x0001> slot 0 Feb 14 12:35:41 nas mpr0: At enclosure level 0 and connector name ( ) Feb 14 12:35:41 nas mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000a> enclosureHandle<0x0001> slot 1 Feb 14 12:35:41 nas mpr0: At enclosure level 0 and connector name ( ) Feb 14 12:35:41 nas mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000b> enclosureHandle<0x0001> slot 7 Feb 14 12:35:41 nas mpr0: At enclosure level 0 and connector name ( ) Feb 14 12:35:41 nas mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000c> enclosureHandle<0x0001> slot 6 Feb 14 12:35:41 nas mpr0: At enclosure level 0 and connector name ( ) Feb 14 12:35:41 nas mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000d> enclosureHandle<0x0001> slot 4 Feb 14 12:35:41 nas mpr0: At enclosure level 0 and connector name ( ) Feb 14 12:35:41 nas mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000e> enclosureHandle<0x0001> slot 5 Feb 14 12:35:41 nas mpr0: At enclosure level 0 and connector name ( ) Feb 14 12:35:41 nas Root mount waiting for: CAM Feb 14 12:35:41 nas Root[1145]: Last message 'mount waiting for: C' repeated 5 times, suppressed by syslog-ng on nas.f.skeldi.com Feb 14 12:35:41 nas da0 at pvscsi0 bus 0 scbus2 target 0 lun 0 Feb 14 12:35:41 nas da0: <VMware Virtual disk 2.0> Fixed Direct Access SPC-4 SCSI device Feb 14 12:35:41 nas da0: Serial Number 6000c299032e925baf10d3c3a422833b Feb 14 12:35:41 nas da0: 750.000MB/s transfers Feb 14 12:35:41 nas da0: Command Queueing enabled Feb 14 12:35:41 nas da0: 32768MB (67108864 512 byte sectors) Feb 14 12:35:41 nas da0: quirks=0x140<RETRY_BUSY,STRICT_UNMAP> Feb 14 12:35:41 nas da1 at pvscsi0 bus 0 scbus2 target 1 lun 0 Feb 14 12:35:41 nas da1: <VMware Virtual disk 2.0> Fixed Direct Access SPC-4 SCSI device Feb 14 12:35:41 nas da1: Serial Number 6000c2965ecbef21bfdc51997ddab900 Feb 14 12:35:41 nas da1: 750.000MB/s transfers Feb 14 12:35:41 nas da1: Command Queueing enabled Feb 14 12:35:41 nas da1: 32768MB (67108864 512 byte sectors) Feb 14 12:35:41 nas da1: quirks=0x140<RETRY_BUSY,STRICT_UNMAP> Feb 14 12:35:41 nas da8 at mpr1 bus 0 scbus4 target 5 lun 0 Feb 14 12:35:41 nas da8: <ATA Samsung SSD 860 2B6Q> Fixed Direct Access SPC-4 SCSI device Feb 14 12:35:41 nas da8: Serial Number XXXXXXXXXX Feb 14 12:35:41 nas da8: 600.000MB/s transfers Feb 14 12:35:41 nas da8: Command Queueing enabled Feb 14 12:35:41 nas da8: 488386MB (1000215216 512 byte sectors) Feb 14 12:35:41 nas da2 at mpr0 bus 0 scbus3 target 0 lun 0 Feb 14 12:35:41 nas da2: <ATA ST18000NM000J-2T SN04> Fixed Direct Access SPC-4 SCSI device Feb 14 12:35:41 nas da2: Serial Number XXXXXXXXXX Feb 14 12:35:41 nas da2: 600.000MB/s transfers Feb 14 12:35:41 nas da2: Command Queueing enabled Feb 14 12:35:41 nas da2: 17166336MB (4394582016 4096 byte sectors) Feb 14 12:35:41 nas da3 at mpr0 bus 0 scbus3 target 1 lun 0 Feb 14 12:35:41 nas da3: <ATA ST18000NM000J-2T SN04> Fixed Direct Access SPC-4 SCSI device Feb 14 12:35:41 nas da3: Serial Number XXXXXXXXXX Feb 14 12:35:41 nas da3: 600.000MB/s transfers Feb 14 12:35:41 nas da3: Command Queueing enabled Feb 14 12:35:41 nas da3: 17166336MB (4394582016 4096 byte sectors) Feb 14 12:35:41 nas da4 at mpr0 bus 0 scbus3 target 4 lun 0 Feb 14 12:35:41 nas da4: <ATA ST18000NM000J-2T SN04> Fixed Direct Access SPC-4 SCSI device Feb 14 12:35:41 nas da4: Serial Number XXXXXXXXXX Feb 14 12:35:41 nas da4: 600.000MB/s transfers Feb 14 12:35:41 nas da4: Command Queueing enabled Feb 14 12:35:41 nas da4: 17166336MB (4394582016 4096 byte sectors) Feb 14 12:35:41 nas da5 at mpr0 bus 0 scbus3 target 5 lun 0 Feb 14 12:35:41 nas da5: <ATA ST18000NM000J-2T SN04> Fixed Direct Access SPC-4 SCSI device Feb 14 12:35:41 nas da5: Serial Number XXXXXXXXXX Feb 14 12:35:41 nas da5: 600.000MB/s transfers Feb 14 12:35:41 nas da5: Command Queueing enabled Feb 14 12:35:41 nas da5: 17166336MB (4394582016 4096 byte sectors) Feb 14 12:35:41 nas da7 at mpr0 bus 0 scbus3 target 7 lun 0 Feb 14 12:35:41 nas da7: <ATA ST18000NM000J-2T SN04> Fixed Direct Access SPC-4 SCSI device Feb 14 12:35:41 nas da7: Serial Number XXXXXXXXXX Feb 14 12:35:41 nas da7: 600.000MB/s transfers Feb 14 12:35:41 nas da7: Command Queueing enabled Feb 14 12:35:41 nas da7: 17166336MB (4394582016 4096 byte sectors) Feb 14 12:35:41 nas da6 at mpr0 bus 0 scbus3 target 6 lun 0 Feb 14 12:35:41 nas da6: <ATA ST18000NM000J-2T SN04> Fixed Direct Access SPC-4 SCSI device Feb 14 12:35:41 nas da6: Serial Number XXXXXXXXXX Feb 14 12:35:41 nas da6: 600.000MB/s transfers Feb 14 12:35:41 nas da6: Command Queueing enabled Feb 14 12:35:41 nas da6: 17166336MB (4394582016 4096 byte sectors) Feb 14 12:35:41 nas intsmb0: <Intel PIIX4 SMBUS Interface> port 0x1040-0x104f at device 7.3 on pci0 Feb 14 12:35:41 nas intsmb0: intr SMI disabled revision 0 Feb 14 12:35:41 nas smbus0: <System Management Bus> on intsmb0 Feb 14 12:35:41 nas kernel: lo0: link state changed to UP Feb 14 12:35:41 nas vmx_modinit: processor does not support VMX operation Feb 14 12:35:41 nas module_register_init: MOD_LOAD (vmm, 0xffffffff83604200, 0) error 6 Feb 14 12:35:41 nas GEOM_MIRROR: Device mirror/swap0 launched (3/3). Feb 14 12:35:41 nas GEOM_MIRROR: Device mirror/swap1 launched (3/3). Feb 14 12:35:41 nas GEOM_ELI: Device mirror/swap0.eli created. Feb 14 12:35:41 nas GEOM_ELI: Encryption: AES-XTS 128 Feb 14 12:35:41 nas GEOM_ELI: Crypto: accelerated software Feb 14 12:35:41 nas GEOM_ELI: Device mirror/swap1.eli created. Feb 14 12:35:41 nas GEOM_ELI: Encryption: AES-XTS 128 Feb 14 12:35:41 nas GEOM_ELI: Crypto: accelerated software Feb 14 12:35:41 nas CPU: 13th Gen Intel(R) Core(TM) i7-13700K (3417.60-MHz K8-class CPU) Feb 14 12:35:41 nas Origin="GenuineIntel" Id=0xb0671 Family=0x6 Model=0xb7 Stepping=1 Feb 14 12:35:41 nas Features=0x1f8bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,SS,HTT> Feb 14 12:35:41 nas Features2=0xfffa3203<SSE3,PCLMULQDQ,SSSE3,FMA,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV> Feb 14 12:35:41 nas AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM> Feb 14 12:35:41 nas AMD Features2=0x121<LAHF,ABM,Prefetch> Feb 14 12:35:41 nas Structured Extended Features=0x219c27eb<FSGSBASE,TSCADJ,BMI1,AVX2,FDPEXC,SMEP,BMI2,ERMS,INVPCID,NFPUSG,RDSEED,ADX,SMAP,CLFLUSHOPT,CLWB,SHA> Feb 14 12:35:41 nas Structured Extended Features2=0x9840079c<UMIP,PKU,OSPKE,GFNI,VAES,VPCLMULQDQ,RDPID,MOVDIRI,MOVDIR64B> Feb 14 12:35:41 nas Structured Extended Features3=0xbc004410<FSRM,MD_CLEAR,IBPB,STIBP,L1DFL,ARCH_CAP,SSBD> Feb 14 12:35:41 nas XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES> Feb 14 12:35:41 nas IA32_ARCH_CAPS=0x2b<RDCL_NO,IBRS_ALL,SKIP_L1DFL_VME,MDS_NO> Feb 14 12:35:41 nas TSC: P-state invariant Feb 14 12:35:41 nas Hypervisor: Origin = "VMwareVMware" Feb 14 12:35:41 nas VMware memory control driver initialized Feb 14 12:35:41 nas kernel: vmx0: link state changed to UP Feb 14 12:35:41 nas pmc: Unknown Intel CPU. Feb 14 12:35:41 nas hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> Feb 14 12:35:41 nas nfsd: can't register svc name Feb 14 12:35:41 nas Security policy loaded: MAC/ntpd (mac_ntpd) Feb 14 12:35:41 nas 1 2023-02-14T12:35:41.782190-06:00 nas.f.skeldi.com ntpd 1229 - - ntpd 4.2.8p15-a (1): Starting Feb 14 12:35:41 nas 1 2023-02-14T12:35:41.782258-06:00 nas.f.skeldi.com ntpd 1229 - - Command line: /usr/sbin/ntpd -p /var/db/ntp/ntpd.pid -c /etc/ntp.conf -f /var/db/ntp/ntpd.drift -g Feb 14 12:35:41 nas 1 2023-02-14T12:35:41.782260-06:00 nas.f.skeldi.com ntpd 1229 - - ---------------------------------------------------- Feb 14 12:35:41 nas 1 2023-02-14T12:35:41.782261-06:00 nas.f.skeldi.com ntpd 1229 - - ntp-4 is maintained by Network Time Foundation, Feb 14 12:35:41 nas 1 2023-02-14T12:35:41.782263-06:00 nas.f.skeldi.com ntpd 1229 - - Inc. (NTF), a non-profit 501(c)(3) public-benefit Feb 14 12:35:41 nas 1 2023-02-14T12:35:41.782264-06:00 nas.f.skeldi.com ntpd 1229 - - corporation. Support and training for ntp-4 are Feb 14 12:35:41 nas 1 2023-02-14T12:35:41.782265-06:00 nas.f.skeldi.com ntpd 1229 - - available at https://www.nwtime.org/support Feb 14 12:35:41 nas 1 2023-02-14T12:35:41.782266-06:00 nas.f.skeldi.com ntpd 1229 - - ----------------------------------------------------
