HP NC550SFP card throws Fatal trap 12 on boot

[thorion]

I'm running a fresh install of FreeNAS 11.2-RELEASE-U1 which worked fine until I added HP NC550SFP 581199-01 10Gbe NIC. With the NIC installed freenas won't boot and throws Fatal trap 12 error, but when I removed the card it works fine. I even tried to do a fresh install but even booting of the live usb throws the same error. I have attached a screenshot of the error.
Any help would be greatly appreciated.

My System Info:
Motherboard: Supermicro X8DTL
Processor: Intel Xeon E5630
RAM: 16GB DDR3 ECC Memory

 

[Chris Moore]

Is this card in the recommended hardware list?


FreeNAS® Quick Hardware Guide

https://forums.freenas.org/index.php?resources/freenas®-quick-hardware-guide.7/


Hardware Recommendations Guide Rev 1e) 2017-05-06

https://forums.freenas.org/index.php?resources/hardware-recommendations-guide.12/

 

[thorion]

Is this card in the recommended hardware list?


FreeNAS® Quick Hardware Guide

https://forums.freenas.org/index.php?resources/freenas®-quick-hardware-guide.7/


Hardware Recommendations Guide Rev 1e) 2017-05-06

https://forums.freenas.org/index.php?resources/hardware-recommendations-guide.12/

It's not included in the list, but I found other forum posts for this card, where they got it to work with a driver update. But my system won't even boot FreeNAS.

 

[Chris Moore]

I would like to see those forum posts because FreeNAS, being an appliance, doesn't have a means of loading a driver.

 

[Mlovelace]

I don't see the if_oce.ko in the /boot/kernel list, so it doesn't look like the driver is included in the latest freeNAS build. You can submit a feature request to include the driver or you can build freenas from source and include the driver in your build.

Code:

-r-xr-xr-x  1 root  wheel     39952 Jan  8 04:41 if_aue.ko
-r-xr-xr-x  1 root  wheel     46992 Jan  8 04:41 if_axe.ko
-r-xr-xr-x  1 root  wheel     38608 Jan  8 04:41 if_axge.ko
-r-xr-xr-x  1 root  wheel    223336 Jan  8 04:41 if_bnxt.ko
-r-xr-xr-x  1 root  wheel      4584 Jan  8 04:41 if_cc.ko
-r-xr-xr-x  1 root  wheel      4600 Jan  8 04:41 if_ccv.ko
-r-xr-xr-x  1 root  wheel     48336 Jan  8 04:41 if_cdce.ko
-r-xr-xr-x  1 root  wheel     29120 Jan  8 04:41 if_cue.ko
-r-xr-xr-x  1 root  wheel    282640 Jan  8 04:41 if_cxgb.ko
-r-xr-xr-x  1 root  wheel    634744 Jan  8 04:41 if_cxgbe.ko
-r-xr-xr-x  1 root  wheel     56104 Jan  8 04:41 if_cxgbev.ko
-r-xr-xr-x  1 root  wheel      4608 Jan  8 04:41 if_cxl.ko
-r-xr-xr-x  1 root  wheel      4624 Jan  8 04:41 if_cxlv.ko
-r-xr-xr-x  1 root  wheel     30152 Jan  8 04:41 if_fwe.ko
-r-xr-xr-x  1 root  wheel     44872 Jan  8 04:41 if_fwip.ko
-r-xr-xr-x  1 root  wheel     17960 Jan  8 04:41 if_ic.ko
-r-xr-xr-x  1 root  wheel     29248 Jan  8 04:41 if_ipheth.ko
-r-xr-xr-x  1 root  wheel     36064 Jan  8 04:41 if_kue.ko
-r-xr-xr-x  1 root  wheel     44592 Jan  8 04:41 if_mos.ko
-r-xr-xr-x  1 root  wheel     29480 Jan  8 04:41 if_ntb.ko
-r-xr-xr-x  1 root  wheel     79000 Jan  8 04:41 if_rsu.ko
-r-xr-xr-x  1 root  wheel     40520 Jan  8 04:41 if_rue.ko
-r-xr-xr-x  1 root  wheel    162408 Jan  8 04:41 if_rum.ko
-r-xr-xr-x  1 root  wheel    150048 Jan  8 04:41 if_run.ko
-r-xr-xr-x  1 root  wheel     50680 Jan  8 04:41 if_smsc.ko
-r-xr-xr-x  1 root  wheel     70560 Jan  8 04:41 if_uath.ko
-r-xr-xr-x  1 root  wheel     35736 Jan  8 04:41 if_udav.ko
-r-xr-xr-x  1 root  wheel     58216 Jan  8 04:41 if_upgt.ko
-r-xr-xr-x  1 root  wheel    104808 Jan  8 04:41 if_ural.ko
-r-xr-xr-x  1 root  wheel     40448 Jan  8 04:41 if_ure.ko
-r-xr-xr-x  1 root  wheel     40776 Jan  8 04:41 if_urndis.ko
-r-xr-xr-x  1 root  wheel    141656 Jan  8 04:41 if_urtw.ko
-r-xr-xr-x  1 root  wheel    111264 Jan  8 04:41 if_zyd.ko

https://www.freebsd.org/cgi/man.cgi?query=oce&sektion=4

 

[thorion]

I don't see the if_oce.ko in the /boot/kernel list, so it doesn't look like the driver is included in the latest freeNAS build. You can submit a feature request to include the driver or you can build freenas from source and include the driver in your build.

Code:

-r-xr-xr-x  1 root  wheel     39952 Jan  8 04:41 if_aue.ko
-r-xr-xr-x  1 root  wheel     46992 Jan  8 04:41 if_axe.ko
-r-xr-xr-x  1 root  wheel     38608 Jan  8 04:41 if_axge.ko
-r-xr-xr-x  1 root  wheel    223336 Jan  8 04:41 if_bnxt.ko
-r-xr-xr-x  1 root  wheel      4584 Jan  8 04:41 if_cc.ko
-r-xr-xr-x  1 root  wheel      4600 Jan  8 04:41 if_ccv.ko
-r-xr-xr-x  1 root  wheel     48336 Jan  8 04:41 if_cdce.ko
-r-xr-xr-x  1 root  wheel     29120 Jan  8 04:41 if_cue.ko
-r-xr-xr-x  1 root  wheel    282640 Jan  8 04:41 if_cxgb.ko
-r-xr-xr-x  1 root  wheel    634744 Jan  8 04:41 if_cxgbe.ko
-r-xr-xr-x  1 root  wheel     56104 Jan  8 04:41 if_cxgbev.ko
-r-xr-xr-x  1 root  wheel      4608 Jan  8 04:41 if_cxl.ko
-r-xr-xr-x  1 root  wheel      4624 Jan  8 04:41 if_cxlv.ko
-r-xr-xr-x  1 root  wheel     30152 Jan  8 04:41 if_fwe.ko
-r-xr-xr-x  1 root  wheel     44872 Jan  8 04:41 if_fwip.ko
-r-xr-xr-x  1 root  wheel     17960 Jan  8 04:41 if_ic.ko
-r-xr-xr-x  1 root  wheel     29248 Jan  8 04:41 if_ipheth.ko
-r-xr-xr-x  1 root  wheel     36064 Jan  8 04:41 if_kue.ko
-r-xr-xr-x  1 root  wheel     44592 Jan  8 04:41 if_mos.ko
-r-xr-xr-x  1 root  wheel     29480 Jan  8 04:41 if_ntb.ko
-r-xr-xr-x  1 root  wheel     79000 Jan  8 04:41 if_rsu.ko
-r-xr-xr-x  1 root  wheel     40520 Jan  8 04:41 if_rue.ko
-r-xr-xr-x  1 root  wheel    162408 Jan  8 04:41 if_rum.ko
-r-xr-xr-x  1 root  wheel    150048 Jan  8 04:41 if_run.ko
-r-xr-xr-x  1 root  wheel     50680 Jan  8 04:41 if_smsc.ko
-r-xr-xr-x  1 root  wheel     70560 Jan  8 04:41 if_uath.ko
-r-xr-xr-x  1 root  wheel     35736 Jan  8 04:41 if_udav.ko
-r-xr-xr-x  1 root  wheel     58216 Jan  8 04:41 if_upgt.ko
-r-xr-xr-x  1 root  wheel    104808 Jan  8 04:41 if_ural.ko
-r-xr-xr-x  1 root  wheel     40448 Jan  8 04:41 if_ure.ko
-r-xr-xr-x  1 root  wheel     40776 Jan  8 04:41 if_urndis.ko
-r-xr-xr-x  1 root  wheel    141656 Jan  8 04:41 if_urtw.ko
-r-xr-xr-x  1 root  wheel    111264 Jan  8 04:41 if_zyd.ko

https://www.freebsd.org/cgi/man.cgi?query=oce&sektion=4

The thread for feature request seems to be archived, so where should I make this request? Also could you share some links on how to add this driver to my custom build?

 

[Mlovelace]

The thread for feature request seems to be archived, so where should I make this request? Also could you share some links on how to add this driver to my custom build?

You can open a feature request here: https://jira.ixsystems.com/projects/NAS

As far as building a custom freeNAS from source, you'd have to research it. There have been previous forum posts about it when the vmxnet3 driver wasn't included originally.

 

[imseanross]

Any luck with this? I have a Dell PowerEdge R510 with HP NC550SFP and having the same exact issue.

It would be really nice to be able to use the new version of FreeNAS.

I am trying to build two FreeNAS servers that are synced in case of failure for a three host VM cluster running XenServer...

This project is taking longer than desired and I did not expect this hiccup.

I saw in the feature request they kind of dropped the ball and said to contact Broadcom, seems like we should be able to have the old driver for this particular hardware ID... maybe I'm wrong, I'm new to FreeBSD.

I hope to find a real solution to this aside from using the older version of FreeNAS.

I wish they didn't close that ticket so I could have been a part of the conversation.

 

[thorion]

Any luck with this? I have a Dell PowerEdge R510 with HP NC550SFP and having the same exact issue.

It would be really nice to be able to use the new version of FreeNAS.

I am trying to build two FreeNAS servers that are synced in case of failure for a three host VM cluster running XenServer...

This project is taking longer than desired and I did not expect this hiccup.

I saw in the feature request they kind of dropped the ball and said to contact Broadcom, seems like we should be able to have the old driver for this particular hardware ID... maybe I'm wrong, I'm new to FreeBSD.

I hope to find a real solution to this aside from using the older version of FreeNAS.

I wish they didn't close that ticket so I could have been a part of the conversation.

I have opened a new ticket in FreeBSD asking to revert back to the old version here: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=235700
I wanted to do the same with Broadcom but couldn't get the driver author's contact info, if you could please drop him an email.
Also i'm planning to build freenas 11.3 with the working oce driver this weekend, let me know if you want me to upload the image somewhere.

 

[imseanross]

I have opened a new ticket in FreeBSD asking to revert back to the old version here: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=235700
I wanted to do the same with Broadcom but couldn't get the driver author's contact info, if you could please drop him an email.
Also i'm planning to build freenas 11.3 with the working oce driver this weekend, let me know if you want me to upload the image somewhere.

Thanks for the reply. That's great to hear, maybe you can upload that 11.3 image to Google drive and share the link?

 

[arasjac]

Same issue for me on two servers, it works on old version of FreeNAS, but stack in new one. Will be good if you will add drivers of that popular 10Gb budget card. Can you share link to of 11.3 with me to? Thank you in advance.

 

[Chris Moore]

Same issue for me on two servers, it works on old version of FreeNAS, but stack in new one. Will be good if you will add drivers of that popular 10Gb budget card. Can you share link to of 11.3 with me to? Thank you in advance.

Please open a ticket in the bug tracker:
https://jira.ixsystems.com/projects/NAS
Instead of making custom builds, how about trying to fix the bug for everyone.

 

[arasjac]

Thank you Chris. Ticket open: https://jira.ixsystems.com/browse/NAS-101834

 

[jgreco]

This card is known to be a train wreck and isn't likely to be well supported. People warn against it in the 10 Gig Networking Primer IIRC.

 

[arasjac]

For now my ticket close as duplicate without any information about original case.

 

[jgreco]

For now my ticket close as duplicate without any information about original case.

I suspect you're expected to follow the link to the previous ticket.

 

[Mlovelace]

As I recall with that card, the FreeBSD driver was broken with freeBSD 11 (could have been 10). So it's up to emulex to provide a patch to repair the driver. On the plus side that card can also be used as a space heater, it get absurdly warm.

 

[jgreco]

Well, anyways, because it's known to be a problematic card, the better solution is to acquire a well-supported card. Continuing to rely on something with dodgy driver support is a good path to the occasional kernel crash and random misbehaviour. You can't fix a Ford Pinto into being a Toyota Camry.

 

[mav@]

For now my ticket close as duplicate without any information about original case.

I've linked the ticket to the previous one (NAS-101745) there.

I've just patched the driver for tomorrow FreeNAS 11.3-nightly. It works for me on very quick tests now. I can't say anything about the card, other then I got two on eBay for less then $20 each and they are kind of working now.