Truenas Scale - random restarts

[hrayrwannis]

dear Forum,

I've been having some random restarts on my truenas scale system recently. The server is home server for media, running plex, security cams and backups.

Some server details:
- TrueNAS-SCALE-22.12.3.3
- Cpu: 13th Gen Intel(R) Core(TM) i7-13700K
- motherboard: CUK ASRock H670M-ITX/ax Mini ITX Motherboard for 12th Gen Intel LGA 1700 CPUs at 125W PL1 with PCIe 5.0 x16 Graphics
- RAM: Corsair Vengeance LPX 64GB (2x 32GB) DDR4 3200(PC4-25600) C161.35V Desktop Memory -Black
- 1 pool if RAIDz1: 3X Seagate Exos X18 18TB Enterprise HDD - CMR 3.5 Inch Hyperscale SATA 6Gb/s, 7200 RPM, 512e and 4Kn FastFormat, Low Latency with Enhanced Caching (ST18000NM000J)
- SSD boot drive: KINGSTON SA400S37120G


I've seen some other random restart posts though nothing similar (i think).

the output from sudo journalctl | grep shutdow (as suggested in another post) puts out the below- though not sure what to make of it?

admin@truenas[~]$ sudo journalctl | grep shutdown
Nov 06 15:37:17 truenas systemd[1]: Starting ix-shutdown.service - Exec TrueNAS shutdown tasks...
Nov 06 15:37:17 truenas systemd[1]: Finished ix-shutdown.service - Exec TrueNAS shutdown tasks.
Nov 06 15:37:48 truenas systemd[1]: Reached target virt-guest-shutdown.target - Libvirt guests shutdown.
Nov 06 15:38:50 truenas dockerd[7762]: time="2023-11-06T15:38:50.269563841+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:38:52 truenas dockerd[7762]: time="2023-11-06T15:38:52.668538448+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:38:53 truenas dockerd[7762]: time="2023-11-06T15:38:53.426279349+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:38:55 truenas dockerd[7762]: time="2023-11-06T15:38:55.866497759+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:38:57 truenas dockerd[7762]: time="2023-11-06T15:38:57.675739095+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:38:58 truenas dockerd[7762]: time="2023-11-06T15:38:58.040707733+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:02 truenas dockerd[7762]: time="2023-11-06T15:39:02.514074849+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:03 truenas dockerd[7762]: time="2023-11-06T15:39:03.495791121+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:04 truenas dockerd[7762]: time="2023-11-06T15:39:04.281718861+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:05 truenas dockerd[7762]: time="2023-11-06T15:39:05.418371383+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:09 truenas dockerd[7762]: time="2023-11-06T15:39:09.412939088+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:09 truenas dockerd[7762]: time="2023-11-06T15:39:09.638988416+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:09 truenas dockerd[7762]: time="2023-11-06T15:39:09.894333935+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:10 truenas dockerd[7762]: time="2023-11-06T15:39:10.512864766+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:10 truenas dockerd[7762]: time="2023-11-06T15:39:10.806928552+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:10 truenas dockerd[7762]: time="2023-11-06T15:39:10.916438986+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:11 truenas dockerd[7762]: time="2023-11-06T15:39:11.104364241+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:12 truenas dockerd[7762]: time="2023-11-06T15:39:12.809380609+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:13 truenas dockerd[7762]: time="2023-11-06T15:39:13.264368076+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:13 truenas dockerd[7762]: time="2023-11-06T15:39:13.486929885+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:13 truenas dockerd[7762]: time="2023-11-06T15:39:13.801884132+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:14 truenas dockerd[7762]: time="2023-11-06T15:39:14.443780302+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:14 truenas dockerd[7762]: time="2023-11-06T15:39:14.640154438+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:14 truenas dockerd[7762]: time="2023-11-06T15:39:14.949278707+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:15 truenas dockerd[7762]: time="2023-11-06T15:39:15.938361807+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:16 truenas dockerd[7762]: time="2023-11-06T15:39:16.178494534+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:16 truenas dockerd[7762]: time="2023-11-06T15:39:16.766698675+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:17 truenas dockerd[7762]: time="2023-11-06T15:39:17.729655916+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:18 truenas dockerd[7762]: time="2023-11-06T15:39:18.546200602+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:19 truenas dockerd[7762]: time="2023-11-06T15:39:19.120429328+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:20 truenas dockerd[7762]: time="2023-11-06T15:39:20.420498520+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:20 truenas dockerd[7762]: time="2023-11-06T15:39:20.571493823+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:21 truenas dockerd[7762]: time="2023-11-06T15:39:21.650580781+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:22 truenas dockerd[7762]: time="2023-11-06T15:39:22.075676979+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:22 truenas dockerd[7762]: time="2023-11-06T15:39:22.246205368+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:23 truenas dockerd[7762]: time="2023-11-06T15:39:23.081504387+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:24 truenas dockerd[7762]: time="2023-11-06T15:39:24.480887647+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:26 truenas dockerd[7762]: time="2023-11-06T15:39:26.194442122+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:26 truenas dockerd[7762]: time="2023-11-06T15:39:26.421661230+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:26 truenas dockerd[7762]: time="2023-11-06T15:39:26.586854563+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:26 truenas dockerd[7762]: time="2023-11-06T15:39:26.699494365+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:27 truenas dockerd[7762]: time="2023-11-06T15:39:27.510889656+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:28 truenas dockerd[7762]: time="2023-11-06T15:39:28.364252616+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:29 truenas dockerd[7762]: time="2023-11-06T15:39:29.033791819+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:29 truenas dockerd[7762]: time="2023-11-06T15:39:29.724073607+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:30 truenas dockerd[7762]: time="2023-11-06T15:39:30.158971528+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:30 truenas dockerd[7762]: time="2023-11-06T15:39:30.846636508+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:31 truenas dockerd[7762]: time="2023-11-06T15:39:31.114919816+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:31 truenas dockerd[7762]: time="2023-11-06T15:39:31.464272407+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:31 truenas dockerd[7762]: time="2023-11-06T15:39:31.762487097+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:31 truenas dockerd[7762]: time="2023-11-06T15:39:31.888612093+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:32 truenas dockerd[7762]: time="2023-11-06T15:39:32.337202662+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:33 truenas dockerd[7762]: time="2023-11-06T15:39:33.458249744+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:34 truenas dockerd[7762]: time="2023-11-06T15:39:34.054737224+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:34 truenas dockerd[7762]: time="2023-11-06T15:39:34.548786373+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:35 truenas dockerd[7762]: time="2023-11-06T15:39:35.342518749+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:35 truenas dockerd[7762]: time="2023-11-06T15:39:35.818036532+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:36 truenas dockerd[7762]: time="2023-11-06T15:39:36.044396201+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:36 truenas dockerd[7762]: time="2023-11-06T15:39:36.945653744+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:39 truenas dockerd[7762]: time="2023-11-06T15:39:39.011038368+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:39 truenas dockerd[7762]: time="2023-11-06T15:39:39.241458897+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:39 truenas dockerd[7762]: time="2023-11-06T15:39:39.803705442+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:41 truenas dockerd[7762]: time="2023-11-06T15:39:41.811306784+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:42 truenas dockerd[7762]: time="2023-11-06T15:39:42.831319305+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:43 truenas dockerd[7762]: time="2023-11-06T15:39:43.862575085+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:45 truenas dockerd[7762]: time="2023-11-06T15:39:45.039939414+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:45 truenas dockerd[7762]: time="2023-11-06T15:39:45.795952018+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:46 truenas dockerd[7762]: time="2023-11-06T15:39:46.065929182+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:46 truenas dockerd[7762]: time="2023-11-06T15:39:46.994440005+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:47 truenas dockerd[7762]: time="2023-11-06T15:39:47.965835384+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:48 truenas dockerd[7762]: time="2023-11-06T15:39:48.328798252+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:49 truenas dockerd[7762]: time="2023-11-06T15:39:49.220809912+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:49 truenas dockerd[7762]: time="2023-11-06T15:39:49.481154087+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:50 truenas dockerd[7762]: time="2023-11-06T15:39:50.218268861+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:51 truenas dockerd[7762]: time="2023-11-06T15:39:51.193974421+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:51 truenas dockerd[7762]: time="2023-11-06T15:39:51.840036245+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:52 truenas dockerd[7762]: time="2023-11-06T15:39:52.292191227+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:53 truenas dockerd[7762]: time="2023-11-06T15:39:53.135339132+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:53 truenas dockerd[7762]: time="2023-11-06T15:39:53.846771425+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:54 truenas dockerd[7762]: time="2023-11-06T15:39:54.115385835+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:55 truenas dockerd[7762]: time="2023-11-06T15:39:55.917588597+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:56 truenas dockerd[7762]: time="2023-11-06T15:39:56.383990015+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:56 truenas dockerd[7762]: time="2023-11-06T15:39:56.830573079+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:58 truenas dockerd[7762]: time="2023-11-06T15:39:58.012656399+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:39:59 truenas dockerd[7762]: time="2023-11-06T15:39:59.264327995+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:40:00 truenas dockerd[7762]: time="2023-11-06T15:40:00.056762626+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:40:00 truenas dockerd[7762]: time="2023-11-06T15:40:00.332671290+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:40:01 truenas dockerd[7762]: time="2023-11-06T15:40:01.016969963+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:40:02 truenas dockerd[7762]: time="2023-11-06T15:40:02.249012350+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:40:02 truenas dockerd[7762]: time="2023-11-06T15:40:02.729524120+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:40:57 truenas dockerd[7762]: time="2023-11-06T15:40:57.826148401+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:41:09 truenas dockerd[7762]: time="2023-11-06T15:41:09.861091178+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:41:14 truenas dockerd[7762]: time="2023-11-06T15:41:14.287827539+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:41:21 truenas dockerd[7762]: time="2023-11-06T15:41:21.308989387+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:41:21 truenas dockerd[7762]: time="2023-11-06T15:41:21.901467222+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:42:03 truenas dockerd[7762]: time="2023-11-06T15:42:03.467988439+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:42:03 truenas dockerd[7762]: time="2023-11-06T15:42:03.900395669+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:42:07 truenas dockerd[7762]: time="2023-11-06T15:42:07.742862066+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:42:07 truenas dockerd[7762]: time="2023-11-06T15:42:07.838417683+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:44:25 truenas dockerd[7762]: time="2023-11-06T15:44:25.172877574+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1
Nov 06 15:44:49 truenas dockerd[7762]: time="2023-11-06T15:44:49.268468106+03:00" level=info msg="loading plugin \"io.containerd.internal.v1.shutdown\"..." runtime=io.containerd.runc.v2 type=io.containerd.internal.v1

From monitoring the reporting on truenas scale you can see the dropout at 15:34 and comes back 14 15:40:

similarly the outputs from multireport.ch on disk health is attached.

Where can i look perhaps for more evidence what can be the culpirt?

thanks in advance.

 

[sfatula]

I suspect the problem occured before 15:37:17 since that's where shutdown started, but the question is why did it start, so any relevant log entries should be posted before that time.

 

[hrayrwannis]

I suspect the problem occured before 15:37:17 since that's where shutdown started, but the question is why did it start, so any relevant log entries should be posted before that time.

thanks a lot for your response. Any idea how i can get the logs before?