New truenas scale is shutting down with out command given

[gasemans]

Hi

I have installed truenas scale on a supermicro server.
but i have some weird problems with it.

It is shutting down between 2 and 25 minutes every time.

I have checked cronejobs. and the scripts but there is nothing there.
I tried to check the logs but when i am in the shell and almost at the logs i already see it shutting down.

First i thought it was a high temp cpu.
But then i would execpt the mainboard to sound an alarm. (checked if that alarm is working and it is)
and i checked the temp with the IPMI and when the shutdown is happening the CPU was 55 degrees max.

I removed the keyboard to check if it is not just a bad keyboard sending the 9 for shutdown.
but no still a shutdown.

The weird thing is that is not just a powerdown. It is a gracefull shutdown.

So it is not a PSU that is being pushed to hard. (checked the max wattage and it is 160Watt @max.)

There are no errors reported.
Only created the disk pools.
and installed 4 dockers.

Didnt had a change to create any SMB share yes.
Any idea's how to troubleshoot this?


Hardware :

1. Supermicro X10SLM+-LN4F​

2. Intel Xeon E3-1270 v3​

3. 32GB mem​

4. 2* Intel DC S3520 2,5" 800GB (OS / MIRROR)​

5. 300 Watt supermicro PSU​

6. 2* 2TB Samsung HDD (DATA/MIRROR)​

7. 2* 500GB (DATA(DOCKER)/MIRROR)​

​

 

[jgreco]

Take it back to the burn-in and testing phase.

Building, Burn-In, and Testing your FreeNAS system

I've been meaning to post some guidance here for a while now. We frequently see people come to the forums with hardware problems that should have washed out in the system build process, but since many of the users here are DIY'ers without professional experience building servers, it goes from...

www.truenas.com

 

[gasemans]

I habe done the burn in test without issues.
No errors found.
Also if the hardware would fail i would not expect the machine to do a gracefull shutdown.

That makes it really weird.
when i see the ip go down and check the screen it is doing a propper shutdown.

 

[Delgon]

Hmmm, I have something similar.
I tested the hardware before and so on.
Installed 22.12.2 Scale and it was ok for 4 days. I did a few reboots on the first day, but after that, it was able to be online for 4 days with no problem until I shut it down via GUI. After that, now it restarts kinda like yours, after 2-5 minutes in general. There is nothing in the logs I could see, and just like you mentioned, it looks just like a normal graceful shutdown, nothing instant. The terminal and everything in it gets SIGHUP and everything shuts down.
It feels super weird and I was not able to get it to stay online since then. It just does a graceful shutdown without any indication in any system logs.

I noticed something but might be just a coincidence, it looks like it can stay on without shutting down (at least longer) when I do not enter the shell via the online GUI or WebUI at all. I'm testing now without entering it altho it would be so bad without it as I do a lot via shell and WebUI XD

 

[gasemans]

well i have not used the shell at all and the shutdown is triggert some how.

Didnt have any time yet to look again for the issue.
I am thinking about removing the mainboard out of the case.
Only boot disks and see if it still happends then.

for now i am still clueless......

 

[Delgon]

I might redo everything anyway and move to better imo 22.02.
From what i can see, 22.12 does not allow for setting dockers host paths and SMB/NFS shares in the same location which is such a bad design imo. I want docker with tftp server which needs its own data, and kernels from NFS. As well as torrenting or transcoding dockers. Not being able to access those from my machines via SMB/NFS and forcing me to login to truenas system and move or manage files further via shell is just not for me.

 

[gasemans]

Hmmm and now it stopped shutting down.
BUT my kubernetes cluster is no longer working...
Bit confusing when you install dockers but it reports an issue with kubernetes...

It looks like one of my harddrives where the docker containers are stored is doing something weird.
not sure why it is giving issues.
And that should not trigger a gracefull shutdown...

I am going to start all over again i think.

 

[NugentS]

Do you have a UPS attached and configured. I find that's a good source of unexplained graceful shutdowns

 

[gasemans]

Nope.
No ups in between (yet)
Will get one in between but i dont have one installed yet.

I did a clean install.
And no issues yet.

really strange because i have reinstalled it 3 times before and kept getting the same issue.