Using TrueNAS-SCALE-22.12.3.2 build, the Jobs->History->Tasks page now shows jobs "ipmi.sel.info" and "ipmi.sel.elist" every 5 minutes, but no IPMI hardware is present. These IPMI jobs did not populate the Tasks page in the previous build. I'm guessing it some middleware that is doing this. It crowds out the history for actually important jobs like rsync and replication. If there is a setting to make these (phantom?) jobs go away, I'd like to know what it is. Or if it could get fixed in the next build. I saw a reddit post about this same issue, but no replies with any useful remedy. Thank you for your attention.
IPMI SEL is the "System Event Log" - normally the cause of logspew from this event source is the SEL being full. Even if you don't have a dedicated IPMI interface, your hardware might have a system event log, or something that TrueNAS thinks is one, and is trying to query from or write to it.
Can you post some details about your hardware configuration, specifically the motherboard?
Thank you for your reply. I'm running 2 instances of TrueNAS-SCALE-22.12.3.2 as VM's on the same machine with Proxmox 7.4-3. One instance has the motherboard's PCIe HBA passed through, to 2 physical SATA hard disks in a mirror pool. The other instance has 2 VirtIO SCSI drives on the local-lvm storage, as 2 disks in a mirror pool. Yes, I know that using VirtIO drives for SCALE pools is not the way, but this is just a learning and test setup. Once I learn and get confident with SCALE, the second instance will be removed and installed on a remote machine with its own physical drives for the pool.
Both instances have been and still are working fine for 2 weeks, but after I updated each instance through the System Settings->Update page, they both started showing this IPMI "logspew". Each ipmi.sel.* job shows "Arguments: No arguments are passed", "Log Path: N/A", "Log Excerpt: No logs are available", and "Error: No errors".
Using TrueNAS-SCALE-22.12.3.2 build, the Jobs->History->Tasks page now shows jobs "ipmi.sel.info" and "ipmi.sel.elist" every 5 minutes, but no IPMI hardware is present
Similar situation. But ipmi hardware is present.
Every 5 minutes two entries in Jobs->History->Tasks
OS Version: TrueNAS-SCALE-22.12.3.2
Product: X10SLM-F
Model: Intel(R) Xeon(R) CPU E3-1230 v3 @ 3.30GHz
Memory: 31 GiB
SEL Information
Version : 1.5 (v1.5, v2 compliant)
Entries : 4
Free Space : 10160 bytes
Percent Used : 0%
Last Add Time : 01/02/2023 21:24:05
Last Del Time : Not Available
Overflow : false
Supported Cmds : 'Reserve' 'Get Alloc Info'
# of Alloc Units : 512
Alloc Unit Size : 20
# Free Units : 508
Largest Free Blk : 508
Max Record Size : 20
I have the same issue on an HP Microserver N54L. Only that it doesn't have any IPMI sensors at all.
The hardware is old, based on an AMD Turion N54L processer, but the motherboard should be well-known. In any case, here's a list of HW.
It's running TrueNAS-SCALE-22.12.3.2. Not that I think it is related, but it boots off from a small SSD, has a single storage pool with a 2-wide mirror of 8TB spindles and has 16GB of RAM.
-Yes I know it is low end hardware, but it is only for off-site backup to be used for disaster recovery if my house burns or my primary instance is otherwise suddenly destroyed.
Code:
H/W path Device Class Description
==========================================================
system ProLiant MicroServer (744900-421)
/0 bus Motherboard
/0/0 memory 64KiB BIOS
/0/3 processor AMD Turion(tm) II Neo N54L Dual-Core Processor
/0/3/4 memory 256KiB L1 cache
/0/3/5 memory 2MiB L2 cache
/0/14 memory 16GiB System Memory
/0/14/0 memory 8GiB DIMM Synchronous 1333 MHz (0.8 ns)
/0/14/1 memory 8GiB DIMM Synchronous 1333 MHz (0.8 ns)
/0/100 bridge RS880 Host Bridge
/0/100/1 bridge AMD RS780/RS880 PCI to PCI bridge (int gfx)
/0/100/1/5 display RS880M [Mobility Radeon HD 4225/4250]
/0/100/6 bridge RS780 PCI to PCI bridge (PCIE port 2)
/0/100/6/0 enp2s0 network NetXtreme BCM5723 Gigabit Ethernet PCIe
/0/100/11 scsi2 storage SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode]
/0/100/11/0 /dev/sdb disk 8001GB ST8000DM004-2CX1
/0/100/11/0/1 /dev/sdb1 volume 2047MiB swap partition
/0/100/11/0/2 /dev/sdb2 volume 7450GiB OS X ZFS partition or Solaris /usr partition
/0/100/11/1 /dev/sdc disk 8001GB ST8000DM004-2U91
/0/100/11/1/1 /dev/sdc1 volume 2047MiB swap partition
/0/100/11/1/2 /dev/sdc2 volume 7450GiB OS X ZFS partition or Solaris /usr partition
/0/100/12 bus SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
/0/100/12/1 usb4 bus OHCI PCI host controller
/0/100/12.2 bus SB7x0/SB8x0/SB9x0 USB EHCI Controller
/0/100/12.2/1 usb1 bus EHCI Host Controller
/0/100/13 bus SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
/0/100/13/1 usb5 bus OHCI PCI host controller
/0/100/13.2 bus SB7x0/SB8x0/SB9x0 USB EHCI Controller
/0/100/13.2/1 usb2 bus EHCI Host Controller
/0/100/14 bus SBx00 SMBus Controller
/0/100/14.1 scsi0 storage SB7x0/SB8x0/SB9x0 IDE Controller
/0/100/14.1/0.1.0 /dev/sda disk 32GB SSDSA2SH032G1GN
/0/100/14.1/0.1.0/1 /dev/sda1 volume 1023KiB BIOS Boot partition
/0/100/14.1/0.1.0/2 /dev/sda2 volume 511MiB Windows FAT volume
/0/100/14.1/0.1.0/3 /dev/sda3 volume 29GiB OS X ZFS partition or Solaris /usr partition
/0/100/14.3 bridge SB7x0/SB8x0/SB9x0 LPC host controller
/0/100/14.4 bridge SBx00 PCI to PCI Bridge
/0/100/16 bus SB7x0/SB8x0/SB9x0 USB OHCI0 Controller
/0/100/16/1 usb6 bus OHCI PCI host controller
/0/100/16.2 bus SB7x0/SB8x0/SB9x0 USB EHCI Controller
/0/100/16.2/1 usb3 bus EHCI Host Controller
/0/101 bridge Family 10h Processor HyperTransport Configuration
/0/102 bridge Family 10h Processor Address Map
/0/103 bridge Family 10h Processor DRAM Controller
/0/104 bridge Family 10h Processor Miscellaneous Control
/0/105 bridge Family 10h Processor Link Control
/0/1 system PnP device PNP0c02
/0/2 system PnP device PNP0b00
/0/4 system PnP device PNP0c02
/0/5 system PnP device PNP0c02
/0/6 system PnP device PNP0c02
/0/7 system PnP device PNP0c01
/1 kube-bridge network Ethernet interface
/2 veth17551355 network Ethernet interface
/3 vethf9e47a3b network Ethernet interface
/4 veth1af1f01b network Ethernet interface
/5 kube-dummy-if network Ethernet interface
Code:
admin@fjalar[~]$ ls /dev | grep "^i"
initctl
input
admin@fjalar[~]$ sudo ipmitool
Could not open device at /dev/ipmi0 or /dev/ipmi/0 or /dev/ipmidev/0: No such file or directory
admin@fjalar[~]$
I noticed the same behavior today on both my TrueNAS SCALE boxes (recently updated to 22.12.3.3, if that matters). Both have ASRock Rack mobos with IPMI (one is E3C246D4M-4L and the other E3C246D2I). Full specs are in my sig.
Both have over 98% free space in the "IPMI Event Log" according to the IPMI Web interfaces, so I don't think the SEL is filling up.
Note that it's not the spammy tasks themselves that really bother me, but rather the fact they pushed tasks I actually care about out of the buffer (e.g., I can't even see this morning's replication and sync tasks).
Let me know if there's any other info I can supply to help debug this.
Not 100% sure I'm doing this right (I'm still learning about IPMI), but it doesn't look like the SEL is full:
Code:
$ sudo ipmitool sel
[sudo] password for bcat:
SEL Information
Version : 1.5 (v1.5, v2 compliant)
Entries : 24
Free Space : 65070 bytes
Percent Used : 0%
Last Add Time : 04/01/2023 02:19:42
Last Del Time : 03/06/2023 02:04:31
Overflow : false
Supported Cmds : 'Delete' 'Partial Add' 'Reserve' 'Get Alloc Info'
# of Alloc Units : 3639
Alloc Unit Size : 18
# Free Units : 3615
Largest Free Blk : 3615
Max Record Size : 1
This site uses cookies to help personalise content, tailor your experience and to keep you logged in if you register.
By continuing to use this site, you are consenting to our use of cookies.