Stuck on "welcome to GRUB!"

[PePeComputing]

After having some problems with my old HBA controllers, I found a new HBA which seems to work.

After creating an installation USB, I installed TrueNas scale on an 256gb NVME. Everything goes smooth, until the reboot.

I reboot the system and after it rebooted I get a screen with: "Welcome to GRUB!" and nothing happens after that, even if I let it sit for 30 minutes.

I googled my ass off and can't find a solution, maybe someone here can help me?

I tried to install it on a USB too, but same story.

System:
MSI Z590 Plus mobo
64GB Corsair 2666 RAM DDR4
Kingston 256gb NVME
SuperMicro AOC-S2308L-L8E - LSI 2308L HBA

Many thanks in advance!

 

[Ericloewe]

Are you booting in UEFI mode?

 

[PePeComputing]

Are you booting in UEFI mode?

Yes, haven't tried is in CSM, would that make a difference?

 

[Ericloewe]

Maybe, for now I wanted to narrow down options. By the way, is the image on the screen rotated or is that just the picture?

You can try disabling everything that's legacy/BIOS/CSM, and changing the extension ROMs on everything, in particular video, to UEFI-only.
If that doesn't work, you can always try the reverse - go with CSM, disable as much UEFI stuff as possible.

 

[joeschmuck]

What version of TrueNAS Scale are you using?

 

[PePeComputing]

What version of TrueNAS Scale are you using?

22.02.4 I've downloaded the stable version.

The drives that are in my server where also used in a Core set up, but that should not make a difference right with a fresh install of Scale and then using the saved config to restore the drives?

 

[PePeComputing]

Maybe, for now I wanted to narrow down options. By the way, is the image on the screen rotated or is that just the picture?

You can try disabling everything that's legacy/BIOS/CSM, and changing the extension ROMs on everything, in particular video, to UEFI-only.
If that doesn't work, you can always try the reverse - go with CSM, disable as much UEFI stuff as possible.

Yes the picture is rotated, it is normal on the screen that is connected to my server.

I will try these steps tonight, I will try booting in CSM first. Thanks for your thoughs!

 

[joeschmuck]

22.02.4 I've downloaded the stable version.

You made me laugh. While it may be called stable, it's still an early version so odds are it's still full of bugs. We hope it isn't but reality is that more bugs will crop up as more people start to use Scale.

The drives that are in my server where also used in a Core set up, but that should not make a difference right with a fresh install of Scale and then using the saved config to restore the drives?

The data drives for your Vdev/Pool should have no effect on the GRUB bootloader hanging up. It is likely a hardware compatibility issue.

Is there any other data on your monitor or is it only the screen shot you posted? It may sound like a stupid question but if I don't ask it and there is other data, well I'm stupid for not asking.

I think (hope) that CSM (Legacy Boot) fixes the problem. I have not had much good luck with UEFI.

So if the BIOS changes does not help, here are some things you could do to isolate a hardware conflict. Remove the HBA card and try to bootstrap the system. Maybe the HBA is causing it. Any other add-on cards, remove those and give it a try again. The system should bootstrap from the NVMe card, or the USB Flash Drive even without any add-on cards. Of course if you have a video card, you kind of need that one. The last thing I would try is to remove the M.2 NVMe card and then try to bootstrap off of the USB Flash Drive.

Good Luck!

 

[PePeComputing]

You made me laugh. While it may be called stable, it's still an early version so odds are it's still full of bugs. We hope it isn't but reality is that more bugs will crop up as more people start to use Scale.


The data drives for your Vdev/Pool should have no effect on the GRUB bootloader hanging up. It is likely a hardware compatibility issue.

Is there any other data on your monitor or is it only the screen shot you posted? It may sound like a stupid question but if I don't ask it and there is other data, well I'm stupid for not asking.

I think (hope) that CSM (Legacy Boot) fixes the problem. I have not had much good luck with UEFI.

So if the BIOS changes does not help, here are some things you could do to isolate a hardware conflict. Remove the HBA card and try to bootstrap the system. Maybe the HBA is causing it. Any other add-on cards, remove those and give it a try again. The system should bootstrap from the NVMe card, or the USB Flash Drive even without any add-on cards. Of course if you have a video card, you kind of need that one. The last thing I would try is to remove the M.2 NVMe card and then try to bootstrap off of the USB Flash Drive.

Good Luck!

There is no other information on the screen then just the "welcome to GRUB!" ;)

I will try the CSM boot this evening, hopefully that works, I hope I don't have to go back to core and a VM host server. Since I bought the 10900k so I can have it all on one server instead of running to rack size servers.

I will let you know if it worked! Thanks for your input!

 

[PePeComputing]

You made me laugh. While it may be called stable, it's still an early version so odds are it's still full of bugs. We hope it isn't but reality is that more bugs will crop up as more people start to use Scale.


The data drives for your Vdev/Pool should have no effect on the GRUB bootloader hanging up. It is likely a hardware compatibility issue.

Is there any other data on your monitor or is it only the screen shot you posted? It may sound like a stupid question but if I don't ask it and there is other data, well I'm stupid for not asking.

I think (hope) that CSM (Legacy Boot) fixes the problem. I have not had much good luck with UEFI.

So if the BIOS changes does not help, here are some things you could do to isolate a hardware conflict. Remove the HBA card and try to bootstrap the system. Maybe the HBA is causing it. Any other add-on cards, remove those and give it a try again. The system should bootstrap from the NVMe card, or the USB Flash Drive even without any add-on cards. Of course if you have a video card, you kind of need that one. The last thing I would try is to remove the M.2 NVMe card and then try to bootstrap off of the USB Flash Drive.

Good Luck!

I've trie everything that you said, but I keep getting back to the "welcome to GRUB!" screen... Even if I try to install it on a USB.

If I try to install Core it all goes smooth.....

 

[Patrick M. Hausen]

Another thing you might want to try: place rEFInd on your EFI partition and try if it boots that. Possibly loading GRUB via rEFINd behaves better.

 

[PePeComputing]

this is where I ended up

 

[PePeComputing]

Another thing you might want to try: place rEFInd on your EFI partition and try if it boots that. Possibly loading GRUB via rEFINd behaves better.

How do I add that ? I have no screen to edit, or is it something that I have to do while flashing it to the install usb?

 

[Patrick M. Hausen]

You boot any Linux or FreeBSD that provides you a live system from USB, access the FAT32 partition that contains the EFI boot loaders, and put this software in a separate directory in there: https://rodsbooks.com/refind/

 

[mistermanko]

You made me laugh. While it may be called stable, it's still an early version so odds are it's still full of bugs.

Learned that the hard way, I still haven't fully recovered from my CORE to SCALE migration adventure...

 

[PePeComputing]

You boot any Linux or FreeBSD that provides you a live system from USB, access the FAT32 partition that contains the EFI boot loaders, and put this software in a separate directory in there: https://rodsbooks.com/refind/

I will give this a try, thank you! If this does not work I'm probably switching over to proxmox and virtualize CORE and run VM's inside of proxmox :(

 

[Patrick M. Hausen]

Why not run VMs in CORE?

 

[mistermanko]

Why not run VMs in CORE?

Because byhve...!? I could never get my VMs restart on their own in byhve. KVM on SCALE on the other hands works pretty good.

 

[PePeComputing]

Because byhve...!? I could never get my VMs restart on their own in byhve. KVM on SCALE on the other hands works pretty good.

This exactly, they VM's in core are slow as poopoo, even if you install them on a NVME raid :(

 

[Patrick M. Hausen]

This exactly, they VM's in core are slow as poopoo, even if you install them on a NVME raid :(

Runs just fine here. Possibly your bridged networking is messed up?

VMware vs bhyve Performance Comparison

Playing with bhyve Here’s a look at Gea’s popular All-in-one design which allows VMware to run on top of ZFS on a single box using a virtual 10Gbe storage network. The design requires an HBA and a CPU that supports VT-d so that the storage can be passed directly to a guest VM running a ZFS ...

b3n.org