Black screen after Grub init message on booting

[ravenblight]

Hello I experienced strange behavior on booting my scale server, after initial splash screen from bios, my TrueNas installation displays information about Grub loading, and than immediately shows black screen. For first time I was thinking that boot ssd failed or stopped working with mother board, but no, after 35-40 minutes of black screening it starts to boot normally. During black screen system only responds to ctr+alt+delete on keyboard. No grub menu is showing. Did somebody had this behavior? It started after some of updates but I've ignored this but now it started to be difficult to restart in fast manner and Im to dependant on truenas installed apps.

 

[ravenblight]

Hello I'm bumping this up I've tried to tweak some bios settings but nothing helps. The output of systemd-analyze is terryfying:
systemd-analyze
Startup finished in 18.068s (firmware) + 38min 45.360s (loader) + 15.920s (kernel) + 5min 27.689s (userspace) = 44min 47.039s
44 minutes of boot time. Can somebody have some experience with that. It worked fine at installation, but after one of updates when I restarted server it started to happen. I don't know which because I didn't processed any restarts between.

 

[WN1X]

Full system spec is required before anyone can comment on your issue.

 

[ravenblight]

It's old MSI mobo B85-43G, with Intel5, with bios modded to boot from nvme ssd (using PCI E adapter), if I remember correctly boot pool is on samsung 860 evo m2 ssd. This was working fine installed and was booting in fast manner, that after grub prompt the menu was showing instantly but now it takes 38 minutes. Scale is on last stable release.

 

[ravenblight]

Could be that old boot environments are reason, of long loading time? The contents of /boot/grub/grub.cfg are very long and have multiple lines of lots of menuentries. I've tried delete old unused boot environments but the process is failing.
22.02-RC.2 | 22.02-RC.2 | - | 2022-01-04T21:58:00+00:00 |
| 22.02.2 | 22.02.2 | - | 2022-06-28T21:01:00+00:00 |
| 22.02-RC.1-1 | 22.02-RC.1-1 | - | 2021-11-08T21:53:00+00:00 |
| 22.02.1 | 22.02.1 | - | 2022-05-06T17:28:00+00:00 |
| 22.02.4 | 22.02.4 | legacy | 2022-09-29T09:29:00+00:00 |
| 22.02.RELEASE | 22.02.RELEASE | - | 2022-02-25T12:21:00+00:00 |
| 22.02.0.1 | 22.02.0.1 | - | 2022-04-26T11:12:00+00:00

I've tried to regenerate grub.cfg using grub-mkconfig but it started to loop trough:

Found linux image: /boot/vmlinuz-5.10.93+truenas
Found initrd image: /boot/initrd.img-5.10.93+truenas

and it is doing this for lot of time, and I have suspition that it takes this 40 minutes of loader from my systemd-analyze .
Please somebody who has, a little idea about this for help.