Mellanox Connectx-4 Lx 25Gb NIC Not Loading

akc1

Dabbler
Joined
Nov 6, 2012
Messages
10
Hello,

Hoping somebody more knowledgeable than myself can help me with this issue please.

I have a virtualised TrueNAS-12.0-U2.1 on ESXi 7 and am passing through a Mellanox Connectx-4 Lx 25Gb NIC. I can see that TrueNAS is trying to load the NIC but failing. below is the output of dmesg | grep mlx

mlx5en: Mellanox Ethernet driver 3.5.2 (September 2019) mlx5_core0: <mlx5_core> mem 0xe7a00000-0xe7afffff at device 0.0 on pci4 mlx5_core0: ERR: mlx5_init_once:939:(pid 0): Unable to find vendor specific capabilities mlx5_core0: ERR: mlx5_load_one:1121:(pid 0): enable msix failed mlx5_core0: ERR: init_one:1605:(pid 0): mlx5_load_one failed -6 device_attach: mlx5_core0 attach returned 6 mlx5_core0: <mlx5_core> mem 0xe7a00000-0xe7afffff at device 0.0 on pci4 mlx5_core0: ERR: mlx5_init_once:939:(pid 85): Unable to find vendor specific capabilities mlx5_core0: ERR: mlx5_load_one:1121:(pid 85): enable msix failed mlx5_core0: ERR: init_one:1605:(pid 85): mlx5_load_one failed -6 device_attach: mlx5_core0 attach returned 6 mlx5_core0: <mlx5_core> mem 0xe7a00000-0xe7afffff at device 0.0 on pci4 mlx5_core0: ERR: mlx5_init_once:939:(pid 711): Unable to find vendor specific capabilities mlx5_core0: ERR: mlx5_load_one:1121:(pid 711): enable msix failed mlx5_core0: ERR: init_one:1605:(pid 711): mlx5_load_one failed -6 device_attach: mlx5_core0 attach returned 6

If anyone has any ideas they would be gratefully received!

Thank you

Alex
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
Are there APIC specific parameters in your VM configuration that you could tweak?
Could you boot TrueNAS on the bare metal?
 

akc1

Dabbler
Joined
Nov 6, 2012
Messages
10
Hello Patrick

Thanks for your help, not sure about APIC parameters(do you know a good resource to learn?). I experience the same issue with bare metal
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
I just googled your type of card and "FreeBSD". Some people seem to get similar errors based on whether "x2apic" is enabled or not. I'd just look at the VM parameters for something by the name of "APIC mode" or similar and try if that changes anything.

Apart from that, no clue. Sorry.
 

akc1

Dabbler
Joined
Nov 6, 2012
Messages
10
I just googled your type of card and "FreeBSD". Some people seem to get similar errors based on whether "x2apic" is enabled or not. I'd just look at the VM parameters for something by the name of "APIC mode" or similar and try if that changes anything.

Apart from that, no clue. Sorry.

Thank you Patrick I will investigate.
 
Top