Storage stopped working with panic IO

tbaror

Contributor
Joined
Mar 20, 2013
Messages
105
Hello,

we had issue with storage disk replace it and while system did rebuild , we found out that its not accessible anymore , got into ipmi and found out following screen shown below ,panic I/O , now i am not in panic bit worried , even if i type continue or reboot in console its reboot and gets into same status
Any suggestion , please advice
Thanks
freenas-panic.png
 
Joined
Oct 18, 2018
Messages
969
What are the results of the smart tests run against the boot pools and storage pools? Those will help determine if the system detected errors prior to this issue. If you set up automatic SMART tests and email notification you should find those reports in your email.

What issues did you have with the disk such that you replaced it? Is it possible that the disk controller was bad and not the actual disk itself? If so, this may be the source of your issue. I'm sorta guessing here not knowing more of what is wrong. But, posting any information you have about earlier failures would be really helpful.

It would also be really helpful if you posted your exact build specs including hardware and freenas version.
 

tbaror

Contributor
Joined
Mar 20, 2013
Messages
105
Thanks for the response
storage is with latest stable FreeNAS-11.2-U5 (Build Date: Jun 24, 2019 18:41)
system where inspected recently by Supermicro seller, i guess its ok, but you never know
anyway prior to panic i/o , i got following
Thanks

freenas-err2.png

the storage build spec is
Disk pool
4x RZ2x 9 disks ,model Vendor:SEAGATE Product:ST10000NM0096 Revision:E001
Nvme drives
LOG
drive mirror 2x INTEL SSDPE2ME800G4
CACHE
drive stip 2x INTEL SSDPE2ME800G4
System oveall health

In addition i see inside server IPMI that all hardware component are healthy including NVME drives
Chassis model and System
SSG-6048R-E1CR60L

CPU 2xProcessor:Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz
Memory:512Gbytes
Network 4x10G nic
 
Joined
Oct 18, 2018
Messages
969
system where inspected recently by Supermicro seller, i guess its ok, but you never know
Well, whether that can be trusted or not depends a lot on what they checked.

Are you able to access the FreeNAS GUI at all? Are you able to get the output of zpool status? It sounds like you can't but just looking for clarification on this.

Based on everything above it looks like you're having issues with the device at da16. Can you identify this disk? Is it your boot disk by chance? If this is an issue with your boot device it could be that you need to replace your boot media. Do you get email notifications of SMART test results?
 

tbaror

Contributor
Joined
Mar 20, 2013
Messages
105
da16 is part of the data disks , the os is loaded from satadom, the Freenas boot never complete , its getting into panic I/O , is ther a way to complete the boot without mounting the pool so i can do further diagnostic?
Thanks
 
Top