Mellanox Infiniband Guidelines

Miguel Nunes

Explorer
Joined
May 6, 2016
Messages
52
Hi everyone,

Thanks to help from the forum I have been able to setup infiniband using Melanox ConnectX/ConnectX-2 cards with FreeNAS 11 series

The default driver fails to load complaining that it can't detect the minimum PCI-E bandwidth.

I have proceeded as follows:

1- Tunnables and added:

mlx4ib_load YES

2 - Tasks / Init/Shutdown Scripts

add the following command as a postinit command

kldload ipoib

If you load this driver on a tunable, the system hangs when rebooting.


Reboot

Configure your interfaces accordingly.

I have managed to have 2 x 10Gbit/s ethernet on a dual port 20Gbit/s infiniband card, and it operates really well.

Feedback on results is appreciated .

Happy infinibanding.
 
Last edited:
Top