SOLVED FreeNAS 11.3 U1 and Mellanox ConnectX-3 issue

[chrisk2305]

Hi guys,

I would need your help. I have a FreeNAS 11.3 machine with a Mellanox ConnectX-3 40Gbe / IB Single Port installed.

The interface does not show up in the list of network interfaces but the driver seems to be loaded:

Code:

 pciconf -lv | grep Mellanox -C 3
    class      = bridge
    subclass   = PCI-PCI
mlx4_core0@pci0:129:0:0:        class=0x028000 card=0x005115b3 chip=0x100315b3 rev=0x00 hdr=0x00
    vendor     = 'Mellanox Technologies'
    device     = 'MT27500 Family [ConnectX-3]'
    class      = network
none6@pci0:132:0:0:     class=0x130000 card=0x148a1022 chip=0x148a1022 rev=0x00 hdr=0x00

Code:

dmesg | grep Mellanox
mlx5en: Mellanox Ethernet driver 3.5.1 (April 2019)
mlx4_core: Mellanox ConnectX core driver v3.5.1 (April 2019)

This card was set to ETH mode in Windows previously. Maybe I need to set the card to ETH mode in FreeNAS again? I read something about a system tunable to accomplish that (sys.device.mlx4_core0.mlx4_port0 = eth) but I am not sure how to do that and find the right "device path".

Can somebody please assist?

Thanks in advance!
Chris

 

[chrisk2305]

if anybody is interested in the solution, this did the trick:

 

[kumarmvnk]

i installled a dual port Mellanox MCX354A-QCBT ConnectX-3 QDR Infiniband however for both the ports what is the tunable i need to use ?

 

[Samuel Tai]

Try looking at sysctl -a | grep mlx to get an idea of the available sysctls for your card.