TrueNAS 13. on ESXi 7u3 reports "Invalid Opcode"

[pawelfi]

Hello,

I have a Dell t30 server, few days ago i updated my ESXi with fresh install to v 7u3, and also my TrueNAS installation on it as a fresh one with recovering configuration (users, pools, SMB...)
My server has PERC 310 HBA card in IT mode with successful pass-trough. I can not tell if this problem was before, as i did not looked in logs of my server before, but it was running ESXi 6.7u3 and Freenas 11.2 for few years without problem.
I did bios update also few days ago.

So now all is working as should, server is booting correctly, disk on HBA card are visible, Pools are running fine, Im using SFP+ NIC on it and read speed is about 300MB/s over samba and write around 200MB/s
But inside logs i see a lot of this messages:

2024-01-04T16:03:59.399Z cpu2:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:03:59.399Z cpu2:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:03:59.416Z cpu2:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:03:59.416Z cpu2:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:03:59.416Z cpu2:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0xb7) from (vmm0:TrueNAS)
2024-01-04T16:03:59.416Z cpu2:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x37) from (vmm0:TrueNAS)

2024-01-04T16:13:59.392Z cpu1:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:13:59.393Z cpu3:528314)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:13:59.410Z cpu3:528314)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:13:59.410Z cpu3:528314)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:13:59.410Z cpu3:528314)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0xb7) from (vmm0:TrueNAS)
2024-01-04T16:13:59.410Z cpu3:528314)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x37) from (vmm0:TrueNAS)

2024-01-04T16:18:59.399Z cpu1:528314)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:18:59.400Z cpu1:528314)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:18:59.417Z cpu3:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:18:59.417Z cpu3:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x4d) from (vmm0:TrueNAS)
2024-01-04T16:18:59.417Z cpu3:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0xb7) from (vmm0:TrueNAS)
2024-01-04T16:18:59.417Z cpu3:528317)VSCSIFs: 4367: handle 2269091352027138(GID:8194)(vscsi0:0):Invalid Opcode (0x37) from (vmm0:TrueNAS)

Every 5 minutes

I search trough all internet and found only old problem here on forum, but never resolved. Now its 6 years after this happen to someone before, but i see i have this same problem now, Even if ESXi and Truenas is now in newer version then in described case:

https://forums.freenas.org/index.php?threads/what-does-freenas-do-to-a-pool-every-5-minutes.70574/#post-500044

Is there anyone who can tell me if i should be worried about this reported problem in logs?
Is there anyone who knows what else can be checked, any parameter change on ESXi host?
Is there anyone who have that same configuration like me PERC 310 + ESXi 7u3 + TrueNAS and can check on ESXi side dmesg command?

 

[KevinDood]

to avoid another https://xkcd.com/979/ situation... let me help, I see the same message on my server, ESXI 7 w/ LSI HBA passthrough to Freenas 11.3

two more resources:

Virtualized FreeNAS 11.2 ESXi 6.0 - vmkernel.log full of vscsi Invalid Opcode messages

Hi Team, I have been running FreeNAS as a VM in ESXi 6.0 for years and it has been flawless. Recently, I upgraded to 11.2 and just discovered new messages showing up in the vmkernel.log of the host every 5 minutes that were not present in 11.1. The SCSI devices it is referring to are .VMDK...

www.truenas.com

https://kb.vmware.com/s/article/1003278

• Hexadecimal value 0x4d translates as LOG SENSE. This command is used to obtain current data from the log pages of a SCSI target, for diagnostic purposes. When additional feedback (supported log pages) is provided in response to processing this command (at the SAN target), error counters can be retrieved by the initiator. This ultimately provides diagnostic metrics for monitoring software.

Indicate this is a long time "error" for over a decade .. basically it seems like any VM that does some sort of diag query fails with this message, so it seems benign... baffles me why they don't clean up their logs to have meaningful messages only or flag it is "benign".