Chelso T580-LP-CR converted to 10gigabit ethernet not working

[thelawnmowerwhisperer]

I am building a custom server to run TrueNAS and bought a Chelso T580-LP-CR on recommendations on this forum. Our network currently only supports 10Gbe networking. So before I bought the card I reached out to FS.com to see if they had the right stuff to convert down to 10Gbe RJ45 to easily tie into our network. They recommended FS 72582 to get it to SFP+ then FS 66613 to get to ethernet. I ordered everything and when I installed it the WebUI sees the Chelso card and says the media subtype is "40Gbase-SR4". I attempted to tie it into our network, on the switch side of the ethernet cable the light comes on and flashes like it is connected to a device. But in the web interface it still shows "40Gbase-SR4" and says link state down. I have attempted the obvious steps like restarting, swapping the modules, using a different cable, and using a different port on the switch. I have also reached out to FS, so far we have yet to figure anything out. So, I decided to see if anybody here could help me out.

 

[HoneyBadger]

You'll likely have to configure the Chelsio card to treat the adapter as a 4x10GbE QSFP breakout cable - a quick search seems to indicate that a Python script is provided with the Chelsio drivers called "Chelsio_adapter_config.py" - but I'm not sure if it's present in TrueNAS by default.

 

[thelawnmowerwhisperer]

Thanks, that was helpful, I located the .tar file that I think I need. As someone who has almost zero experience with FreeBSD, I'm not sure where to go from here. I don't understand how I can drop that file onto the server in a spot where I can access it to install it. It is currently sitting on my computer, like I said my experience here is super limited, I attempted to put it on a flash drive and plug that into the server to pull it from there, but from there I don't really understand what to do. Thanks for your patience with me.

 

[HoneyBadger]

Do you have any other interface available for the server, like a 1Gbps NIC? If so, you can use an SCP client like WinSCP to copy the file over, and then get a shell via SSH.

If not, format a flash drive with FAT32, and copy the .tar there. From there, use the local console to get to a shell, then insert your USB stick and look for a line at the bottom of dmesg that looks like:

Code:

daX: <USB STICK> on xhci0
daX: 31GB <Your USB Stick Brand>

That daX will be the device name of your USB stick, enter the actual number instead of "daX" below:

Code:

mkdir /mnt/usbstick
mount -t msdos -o ro /dev/daX /mnt/usbstick
cp /mnt/usbstick/ChelsioAdapterConfig-x.x.x.x-FBSD-x86_64.tar.gz /root
umount /mnt/usbstick

At this point you've got the file in your root directory, and you should see it in the ls output.

You can then follow the instructions in the README ( https://service.chelsio.com/beta/drivers/freebsd_tool/README.txt ) to install it:

Code:

tar -xzf ChelsioAdapterConfig-x.x.x.x-FBSD-x86_64.tar.gz
cd ChelsioAdapterConfig-x.x.x.x-FBSD-x86_64.tar.gz
./install.sh

And then run the config script

Code:

chelsio_adapter_config.py

You can then select the T580 and change port personality to either type2 (4x10Gb) or type3 (QSA) - I'm not sure which one is required for the FS adapter. If it presents itself as a 4x10 with only one channel connected, it will need type2 - if that doesn't work, try type3.

The "QSFP to SFP to 10GbaseT" may also introduce some complexity.

 

[thelawnmowerwhisperer]

I now got to the point(on the readme instructions) where I run the chelsio_adapter_config.py script and it gives me an error saying

Code:

File "/usr/local/bin/chelsio_adapter_config.py", line 154
     stddata = stddata.strip()
TabError: inconsistent use of tabs and spaces in indentation

Does it sound like I'm doing something wrong or does there seem to be an error in the code? I have attempted redownloading and reloading it to make certain that nothing happened to it. Is this something I need to take up with Chelsio?

 

[HoneyBadger]

That seems like there's a syntax error in the code (or perhaps it was written for a less-strict Python interpreter) - you could try editing the Python code yourself to make it use either tabs or spaces, rather than the mix of both - failing that, you'll need to contact support@chelsio

If the script will run without a Chelsio card in the system, I'll see if I can test it out on a machine here (I think I have a T320 but it's in a more "production" machine) - the config tool is also allegedly only compatible with FreeBSD up to 11.x though according to their download page.