FreeNAS on HPE ProLiant DL 385 Gen 10 - KDB: enter: panic

[amarp]

Hello,

I am trying to install FreeNAS 11.2 on HP Server and I am not moving past the very first boot.
Here is some info:

Server: HP ProLiant DL 385 Gen 10
Boot: UEFI, latest update
RAM: 128G ECC, not upgraded or changed
FreeNAS Version: 11.2
Boot Device: USB

This is what I did so far.

I downloaded the image and checked the checksum before making a bootable USB.
When I boot, I am greeted with the first loading screen, I press Enter and the system starts to boot.
After very short time I got the following error:

panic: nexus_add_irq: failed
cpuid = 2
KDB: stack backtrace:
....
....
KDB: enter: panic

I attached the screenshot with the error message and the full backtrace.

I did some research and tried several things.

- First I tried to switch to legacy boot instead of UEFI, got the same error.
- Next I tried to pass this argument before booting:

set hw.pci.realloc_bars=1
boot

which didn't make any difference.

- I also tried adding this line directly in /boot/defaults/loader.conf without any effect.
- Then I disconnected the keyboard, rebooted the system and tried to do an install via iLO remote console, same error.
- The next step was not to use USB whatsoever, I attached the ISO image from my laptop as a virtual DVD drive, rebooted, got the same error.
- Finally I tried to disable ACPI in BIOS, rebooted and got the same error.

It seems whatever I do, I got the KDB: enter: panic and cannot even start the installation process.

Does anyone have any idea what I could do? Anyone successfully installed FreeNAS on HPE ProLiant?

Any help would be much appreciated.

 

[Chris Moore]

Have you installed any other (older) version of FreeNAS on this system?
I see that it is an HP ProLiant DL 385 Gen 10, but that does not give details of any hardware that might be changeable in the system, such as drive controllers. Can you please follow this guide and give us a rundown on the hardware:

Updated Forum Rules 12/5/18
https://forums.freenas.org/index.php?threads/updated-forum-rules-12-5-18.45124/

 

[Chris Moore]

PS. It might also be a good idea to open a ticket on this with the software development team, just in case:
https://redmine.ixsystems.com/projects/freenas

 

[Tom J]

i'm no expert but i've just spent days pulling my hair out getting my gen 8 HP going on freenas. in the end I used ILO integrated remote console, with the boot iso saved on my laptop on c: using the " image file (virtual drive)cdrom/dvd " option on the ILO console (downloaded version rather than web version).

USB powering caused major issues - still don't know why. i was getting errors with usb not getting enough power
.
Also have you signed up for the trial license of ilo advanced as it caused me problems POST without it as it would drop off giving me errors

- which usb port are you using
-what speed usb memory stick
-have you checked your memory - bad memory can cause errors like yours
-have you tried without any usb devices plugged into it. i.e keyboards

As i say, i'm no expert but some of the things i discovered that were causing me issues

 

[amarp]

Thank you all for the suggestions.

These are the specs:

CPU:
2x AMD EPYC 7301 2,2 GHz 16-Core

RAM:
8x 16GB ECC RDIMM 2666 MHz
Sockets in use:
PROC 1: DIMM1, DIMM5, DIMM12, DIMM16
PROC 2: DIMM1, DIMM5, DIMM12, DIMM16

NIC:
Adapter 1 - HPE Eth 10Gb 2p 535FLR-T Adptr
Adapter 2 - HPE Ethernet 1Gb 4-port 331i Adapter - NIC

Storage:
2x HP 300GB SAS 2,5" EG000300JWEBF
2x HPE MIXED USE - SSD - 240 GB - SATA 6GB/S MK000240GWEZF
10x HP 4Tb SATA 6G 7.2K LFF MDL HDD MB4000GVYZK

300GB SAS drives are in RAID1, this is where I want to install the OS.
SSDs and 4TB HDDs will be used for storage.

Controllers:
HPE Smart Array P816i-a SR Gen10 PEYHD0CRHB213V
12G SAS Exp Card PWJKN0FRCAO1AY

I didn't try to install any older version of FreeNAS, will try to do it today.

I tried using both USB ports to install FreeNAS. The USB Stick is SanDisk Cruzer Blade 8GB. We already used this stick to install other OS, it was working. I also tried a network install via iLO Remote Console, bypassing USB completely. I didn't try to deactivate USB in BIOS, maybe an option to look at.
I didn't do a memory check, however iLO says that the memory is ok. I will let memtest running over the weekend.

I will try today to boot the system with FreeBSD, just to see if it throws any errors.

 

[amarp]

FreeBSD 11.2 has the same issue panic: nexus_add_irq: failed, as expected...

 

[Tom J]

Thank you all for the suggestions.

These are the specs:

CPU:
2x AMD EPYC 7301 2,2 GHz 16-Core

RAM:
8x 16GB ECC RDIMM 2666 MHz
Sockets in use:
PROC 1: DIMM1, DIMM5, DIMM12, DIMM16
PROC 2: DIMM1, DIMM5, DIMM12, DIMM16

NIC:
Adapter 1 - HPE Eth 10Gb 2p 535FLR-T Adptr
Adapter 2 - HPE Ethernet 1Gb 4-port 331i Adapter - NIC

Storage:
2x HP 300GB SAS 2,5" EG000300JWEBF
2x HPE MIXED USE - SSD - 240 GB - SATA 6GB/S MK000240GWEZF
10x HP 4Tb SATA 6G 7.2K LFF MDL HDD MB4000GVYZK

300GB SAS drives are in RAID1, this is where I want to install the OS.
SSDs and 4TB HDDs will be used for storage.

Controllers:
HPE Smart Array P816i-a SR Gen10 PEYHD0CRHB213V
12G SAS Exp Card PWJKN0FRCAO1AY

I didn't try to install any older version of FreeNAS, will try to do it today.

I tried using both USB ports to install FreeNAS. The USB Stick is SanDisk Cruzer Blade 8GB. We already used this stick to install other OS, it was working. I also tried a network install via iLO Remote Console, bypassing USB completely. I didn't try to deactivate USB in BIOS, maybe an option to look at.
I didn't do a memory check, however iLO says that the memory is ok. I will let memtest running over the weekend.

I will try today to boot the system with FreeBSD, just to see if it throws any errors.

when you say "I tried using both USB ports to install FreeNAS. The USB Stick is SanDisk Cruzer Blade 8GB. We already used this stick to install other OS, it was working"
are you saying you are using this as your install media or are you trying to install the OS onto it?
is it usb3?

 

[amarp]

are you saying you are using this as your install media or are you trying to install the OS onto it?
is it usb3?

No, we are not trying to install OS on it, we are using it as install media. It's usb2.

But as I said earlier, I don't believe the USB is the problem. I got the same error when I try to install via remote console.

I have the same issue with FreeNAS 11.1 as well as with FreeBSD.

 

[amarp]

UPDATE

So turning SMT off in BIOS and passing this argument before boot:

set hw.pci.enable_msi=0

finally gets me to the install screen.

However, I am unable to see my logical drive...

It is RAID1 made with two HP 300GB SAS 2,5" EG000300JWEBF using HPE Smart Array P816i-a SR Gen10.

Not sure if this is a consequence of turning off msi before booting or the kernel simply doesn't recognise the controller.

Frustrating.

 

[Tom J]

i'm guessing you have already been through the settings on the HP array configuration utility?

 

[amarp]

i'm guessing you have already been through the settings on the HP array configuration utility?

Yes, RAID is configured properly and also visible to other OS. Tested with Centos.