TrueNAS-SCALE-22.02-RC.2
Intel(R) Core(TM) i5-10400 CPU @ 2.90GHz
32GB RAM
boot nvme 256GB Samung 860 EVO
2 x 500GB Samsung 850 pro
Please let me know if you need more information.
Ran the system for about 3 weeks using TRUENAS Core and never had a problem. I decided to try TrueNAS Scale, fresh install, and after about 24 hours webui and ssh becomes unresponsive. I can ping the system and the VMs still work. I have to hard reboot the system to get the webui to start working. I re-installed TrueNAS Scale just in case it was a bad install and still the same. After about 24 hours webui stops responding.
I see in the error log: kernel: nvme nvme0: Device not ready; aborting reset, CSTS=0x1. But like I said I never had this issue with TrueNAS Core.
I'm leaning towards a bad drive but thought I would see if anyone else has had this issue first.
Here is what is in the error log.
Jan 16 01:14:01 truenas CRON[4026655]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:15:40 truenas kernel: nvme nvme0: Device not ready; aborting reset, CSTS=0x1
Jan 16 01:16:01 truenas CRON[4029766]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:16:11 truenas kernel: nvme nvme0: Device not ready; aborting reset, CSTS=0x1
Jan 16 01:16:38 truenas kernel: INFO: task txg_sync:580 blocked for more than 120 seconds.
Jan 16 01:16:38 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:16:38 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:16:38 truenas kernel: INFO: task collectd:7721 blocked for more than 120 seconds.
Jan 16 01:16:38 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:16:38 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:16:42 truenas kernel: nvme nvme0: Device not ready; aborting reset, CSTS=0x1
Jan 16 01:16:42 truenas kernel: blk_update_request: I/O error, dev nvme0n1, sector 203940584 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
Jan 16 01:16:42 truenas kernel: blk_update_request: I/O error, dev nvme0n1, sector 202647336 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
Jan 16 01:17:01 truenas CRON[4031199]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:18:01 truenas CRON[4032654]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:20:01 truenas CRON[4035271]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:20:40 truenas kernel: INFO: task systemd:1 blocked for more than 120 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:40 truenas kernel: INFO: task txg_sync:580 blocked for more than 121 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:40 truenas kernel: INFO: task asyncio_loop:995 blocked for more than 121 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:40 truenas kernel: INFO: task loop_monitor:1650 blocked for more than 121 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:40 truenas kernel: INFO: task collectd:7721 blocked for more than 121 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:41 truenas kernel: INFO: task k3s-server:27045 blocked for more than 121 seconds.
Jan 16 01:20:41 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:41 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:41 truenas kernel: INFO: task Plex Media Serv:19113 blocked for more than 121 seconds.
Jan 16 01:20:41 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:41 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:41 truenas kernel: INFO: task zed:4030714 blocked for more than 122 seconds.
Jan 16 01:20:41 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:41 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:22:01 truenas CRON[4037851]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Thanks,
Joel
Intel(R) Core(TM) i5-10400 CPU @ 2.90GHz
32GB RAM
boot nvme 256GB Samung 860 EVO
2 x 500GB Samsung 850 pro
Please let me know if you need more information.
Ran the system for about 3 weeks using TRUENAS Core and never had a problem. I decided to try TrueNAS Scale, fresh install, and after about 24 hours webui and ssh becomes unresponsive. I can ping the system and the VMs still work. I have to hard reboot the system to get the webui to start working. I re-installed TrueNAS Scale just in case it was a bad install and still the same. After about 24 hours webui stops responding.
I see in the error log: kernel: nvme nvme0: Device not ready; aborting reset, CSTS=0x1. But like I said I never had this issue with TrueNAS Core.
I'm leaning towards a bad drive but thought I would see if anyone else has had this issue first.
Here is what is in the error log.
Jan 16 01:14:01 truenas CRON[4026655]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:15:40 truenas kernel: nvme nvme0: Device not ready; aborting reset, CSTS=0x1
Jan 16 01:16:01 truenas CRON[4029766]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:16:11 truenas kernel: nvme nvme0: Device not ready; aborting reset, CSTS=0x1
Jan 16 01:16:38 truenas kernel: INFO: task txg_sync:580 blocked for more than 120 seconds.
Jan 16 01:16:38 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:16:38 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:16:38 truenas kernel: INFO: task collectd:7721 blocked for more than 120 seconds.
Jan 16 01:16:38 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:16:38 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:16:42 truenas kernel: nvme nvme0: Device not ready; aborting reset, CSTS=0x1
Jan 16 01:16:42 truenas kernel: blk_update_request: I/O error, dev nvme0n1, sector 203940584 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
Jan 16 01:16:42 truenas kernel: blk_update_request: I/O error, dev nvme0n1, sector 202647336 op 0x1:(WRITE) flags 0x0 phys_seg 1 prio class 0
Jan 16 01:17:01 truenas CRON[4031199]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:18:01 truenas CRON[4032654]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:20:01 truenas CRON[4035271]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Jan 16 01:20:40 truenas kernel: INFO: task systemd:1 blocked for more than 120 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:40 truenas kernel: INFO: task txg_sync:580 blocked for more than 121 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:40 truenas kernel: INFO: task asyncio_loop:995 blocked for more than 121 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:40 truenas kernel: INFO: task loop_monitor:1650 blocked for more than 121 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:40 truenas kernel: INFO: task collectd:7721 blocked for more than 121 seconds.
Jan 16 01:20:40 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:40 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:41 truenas kernel: INFO: task k3s-server:27045 blocked for more than 121 seconds.
Jan 16 01:20:41 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:41 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:41 truenas kernel: INFO: task Plex Media Serv:19113 blocked for more than 121 seconds.
Jan 16 01:20:41 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:41 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:20:41 truenas kernel: INFO: task zed:4030714 blocked for more than 122 seconds.
Jan 16 01:20:41 truenas kernel: Tainted: P W OE 5.10.81+truenas #1
Jan 16 01:20:41 truenas kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 16 01:22:01 truenas CRON[4037851]: pam_env(cron:session): Unable to open env file: /etc/default/locale: No such file or directory
Thanks,
Joel