TrueNAS Scale 22.02.2 Update; Server Does Not Boot

[ASiC]

Hi All,

After updating my 22.02.1 installation last night, the server is now failing to boot:

Mobo: Gigabyte D460M DS3H
CPU: Intel Core i5-10400
Mem: 64GB Non-ECC DDR4
For storage I'm using the on-board 6 S-ATA ports plus a PCIe to dual m-SATA for the OS

Code:

root@server[~]# lspci
00:00.0 Host bridge: Intel Corporation Comet Lake-S 6c Host Bridge/DRAM Controller (rev 03)
00:02.0 VGA compatible controller: Intel Corporation CometLake-S GT2 [UHD Graphics 630] (rev 03)
00:14.0 USB controller: Intel Corporation Comet Lake PCH-V USB Controller
00:14.2 Signal processing controller: Intel Corporation Comet Lake PCH-V Thermal Subsystem
00:16.0 Communication controller: Intel Corporation Device a3ba
00:17.0 SATA controller: Intel Corporation 400 Series Chipset Family SATA AHCI Controller
00:1b.0 PCI bridge: Intel Corporation Device a3e9 (rev f0)
00:1b.4 PCI bridge: Intel Corporation Device a3eb (rev f0)
00:1c.0 PCI bridge: Intel Corporation Device a394 (rev f0)
00:1c.6 PCI bridge: Intel Corporation Device a396 (rev f0)
00:1c.7 PCI bridge: Intel Corporation Device a397 (rev f0)
00:1d.0 PCI bridge: Intel Corporation Device a398 (rev f0)
00:1f.0 ISA bridge: Intel Corporation Device a3c8
00:1f.2 Memory controller: Intel Corporation Memory controller
00:1f.4 SMBus: Intel Corporation Comet Lake PCH-V SMBus Host Controller
04:00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial ATA Controller (                       rev 02)
05:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection                        (rev 01)
05:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection                        (rev 01)

I never had similar issues with 22.02.1 or Core before.
Any ideas please?

Thanks.

 

[larod241]

Same here.
I have an external HDD that I use for a backup pool.
If I unplug it before booting TrueNas, it's ok...

 

[ASiC]

Same here.
I have an external HDD that I use for a backup pool.
If I unplug it before booting TrueNas, it's ok...

Hmm...
Hear you saying that your USB drive is the issue, I wonder if it's the virtual CD-ROM that PiKVM connects to my server over USB.

Need to climb to the loft with a monitor and a keyboard, disconnect the PiKVM and test

 

[ASiC]

Hmm...
Hear you saying that your USB drive is the issue, I wonder if it's the virtual CD-ROM that PiKVM connects to my server over USB.

Need to climb to the loft with a monitor and a keyboard, disconnect the PiKVM and test

Yup, that was it...
I've disabled the mass media storage emulation on PiKVM (https://docs.pikvm.org/msd/#basics ) and 22.02.2 booted up.

Right, I believe it's safe to assume that 20.02.2 will not boot with USB storage devices connected.
Or at least on PiKVM and larod241 external drive.

 

[larod241]

I've juste try to start with a new installation with a usb key ( 20.02.2 flahs with balenaetcher) -> Hangs at "attached scsi removable disk" on boot.

 

[JenJen]

My Truenas OS is in USB key (it's a ssd, scandisk pro).
I hope it will boot in USB...

 

[larod241]

running that in terminal seem to resolv my problem :
cli -c 'system advanced update kernel_extra_options="ahci.ahciem_enable=0"'

not the same case than here but it seem's to work for me : https://jira.ixsystems.com/browse/NAS-116821?filter=-6

 

[ASiC]

Yeah, I've reverted back to 20.22.1 for now.
.2 is way too buggy for me to use.

Appart from the USB boot issue, I've found a bunch more:

* K3s takes forever to launch;
* CPU is on a constant ~2.4 for no apparent reason;
* Server will hang at reboot (stuck on killing the last daemons);
* NUT is even more broken : Now the service won't even launch.

Anyway, my only complain with .1 was NUT and it seems like it's still an issue with .2

I'll wait until the next version is out.

 

[larod241]

* K3s takes forever to launch;
* Server will hang at reboot (stuck on killing the last daemons);

I had this problem when I plugged in my external hard drive.
Since I placed the tweak commande line, everything has been back to normal.
Boot Ok with external HDD. K3S fast. The stop/reboot is done as quickly as before.

 

[Guille]

Hi All, After updating my 22.02.1 installation last night, the server is now failing to boot: View attachment 56273 Mobo: Gigabyte D460M DS3H CPU: Intel Core i5-10400 Mem: 64GB Non-ECC DDR4 For storage I'm using the on-board 6 S-ATA ports plus a PCIe to dual m-SATA for the OS

Code:

root@server[~]# lspci 00:00.0 Host bridge: Intel Corporation Comet Lake-S 6c Host Bridge/DRAM Controller (rev 03) 00:02.0 VGA compatible controller: Intel Corporation CometLake-S GT2 [UHD Graphics 630] (rev 03) 00:14.0 USB controller: Intel Corporation Comet Lake PCH-V USB Controller 00:14.2 Signal processing controller: Intel Corporation Comet Lake PCH-V Thermal Subsystem 00:16.0 Communication controller: Intel Corporation Device a3ba 00:17.0 SATA controller: Intel Corporation 400 Series Chipset Family SATA AHCI Controller 00:1b.0 PCI bridge: Intel Corporation Device a3e9 (rev f0) 00:1b.4 PCI bridge: Intel Corporation Device a3eb (rev f0) 00:1c.0 PCI bridge: Intel Corporation Device a394 (rev f0) 00:1c.6 PCI bridge: Intel Corporation Device a396 (rev f0) 00:1c.7 PCI bridge: Intel Corporation Device a397 (rev f0) 00:1d.0 PCI bridge: Intel Corporation Device a398 (rev f0) 00:1f.0 ISA bridge: Intel Corporation Device a3c8 00:1f.2 Memory controller: Intel Corporation Memory controller 00:1f.4 SMBus: Intel Corporation Comet Lake PCH-V SMBus Host Controller 04:00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial ATA Controller ( rev 02) 05:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01) 05:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection (rev 01)

I never had similar issues with 22.02.1 or Core before. Any ideas please? Thanks.

Hi All,

After updating my 22.02.1 installation last night, the server is now failing to boot:
View attachment 56273
Mobo: Gigabyte D460M DS3H
CPU: Intel Core i5-10400
Mem: 64GB Non-ECC DDR4
For storage I'm using the on-board 6 S-ATA ports plus a PCIe to dual m-SATA for the OS

Code:

root@server[~]# lspci
00:00.0 Host bridge: Intel Corporation Comet Lake-S 6c Host Bridge/DRAM Controller (rev 03)
00:02.0 VGA compatible controller: Intel Corporation CometLake-S GT2 [UHD Graphics 630] (rev 03)
00:14.0 USB controller: Intel Corporation Comet Lake PCH-V USB Controller
00:14.2 Signal processing controller: Intel Corporation Comet Lake PCH-V Thermal Subsystem
00:16.0 Communication controller: Intel Corporation Device a3ba
00:17.0 SATA controller: Intel Corporation 400 Series Chipset Family SATA AHCI Controller
00:1b.0 PCI bridge: Intel Corporation Device a3e9 (rev f0)
00:1b.4 PCI bridge: Intel Corporation Device a3eb (rev f0)
00:1c.0 PCI bridge: Intel Corporation Device a394 (rev f0)
00:1c.6 PCI bridge: Intel Corporation Device a396 (rev f0)
00:1c.7 PCI bridge: Intel Corporation Device a397 (rev f0)
00:1d.0 PCI bridge: Intel Corporation Device a398 (rev f0)
00:1f.0 ISA bridge: Intel Corporation Device a3c8
00:1f.2 Memory controller: Intel Corporation Memory controller
00:1f.4 SMBus: Intel Corporation Comet Lake PCH-V SMBus Host Controller
04:00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial ATA Controller (                       rev 02)
05:00.0 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection                        (rev 01)
05:00.1 Ethernet controller: Intel Corporation 82576 Gigabit Network Connection                        (rev 01)

I never had similar issues with 22.02.1 or Core before.
Any ideas please?

Thanks.

same here. I boot from a USB mirror (yes, I know...)

Went back to 22.02.1 and everything is fine.

 

[Marek77]

running that in terminal seem to resolv my problem :
cli -c 'system advanced update kernel_extra_options="ahci.ahciem_enable=0"'

not the same case than here but it seem's to work for me : https://jira.ixsystems.com/browse/NAS-116821?filter=-6

Thanks Larod, this fixed my booting issue with the new update too.
Being new to TrueNas, i am using a Qnap 4 bay with 2 USB SSD, one for truenas and the other for app installs.
With out that line of code, the only way my NAS would boot was by removing all the hotswap drive caddies from the case and unplugging the APPs USB drive. Then the system did boot from my USB SSD TrueNAS install drive.

 

[Cabby]

Had the same problem with an old case that had a card reader installed in the unused floppy bay, connected via an usb header on the main board.

 

[MikeLowry]

running that in terminal seem to resolv my problem :
cli -c 'system advanced update kernel_extra_options="ahci.ahciem_enable=0"'

Where do I add this? - not able to SSH as the boot process does not complete.

Do I add this in advanced options on the GRUB boot screen?

 

[larod241]

Where do I add this? - not able to SSH as the boot process does not complete.

Do I add this in advanced options on the GRUB boot screen?

No, you to choose to boot the 22.02.1 version and then, use SSH to running the commande in CLI.
After that, you can reboot int the 22.02.2 environement

 

[MikeLowry]

No, you to choose to boot the 22.02.1 version and then, use SSH to running the commande in CLI.
After that, you can reboot int the 22.02.2 environement

Thank you.

I do not have any USB attached but the QNAP 4 bay has a DoM (Disk on Module) - which could be a similar issue. Will try this today and report.

Cheers
M

 

[dbb12345]

Don't force the update it needs a patch anyway (in the works). This may be fixed then anyway along with few other broken things

 

[MikeLowry]

Don't force the update it needs a patch anyway (in the works). This may be fixed then anyway along with few other broken things

Hi,

Was this fixed in the hotpatch: 22.02.2.1?

Seems to be fixed in This JIRA, which is a duplicate or related to the issue discussed and reported here.

I am currently running TrueNAS-SCALE-22.02.0 - is it recommended to update directly to 22.02.2.1 hotpatch?

Cheers
M