OK, this is a weird one. I did an upgrade from 12.0 U8 to 13.0 U3.1 last week, and all went well.
-Log onto today and have the following errors:
CRITICAL
Pool vdisk01 state is ONLINE: One or more devices has been removed by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state.
The following devices are not healthy:
Disk HITACHI HUSSL402 CLAR200 XQVAR36A is REMOVED
2023-02-24 16:31:06 (America/New_York)
CRITICAL
Pool vdisk02 state is UNAVAIL: One or more devices are faulted in response to IO failures.
The following devices are not healthy:
Disk ATA TOSHIBA HDWQ140 Y7J1K1ZIFPBE is REMOVED
Disk ATA TOSHIBA HDWQ140 Y7LDK0D4FPBE is REMOVED
2023-02-24 16:31:06 (America/New_York)
XQVAR36A is on da3
Y7J1K1ZIFPBE is on da1
Y7LDK0D4FPB is on da2
So three disk are offline, and one pool is gone because it lost 2 out of 4 disks. But I noticed that they all went offline at the exact same time (2023-02-24 16:31:06).
I am thinking that it might be a power isssue, like a bad cord that took out three disks. So I power off the system, and move Y7LDK0D4FPB from da2 to da5, power up the system, and voila, all the disks are online, and both pools (vdisk01, and vdisk02) are perfectly fine.
The system has been behaving perfectly until the update, and so far, so good with the rebooot. My only thought is since the problem was with da1 to da3, that could it be chip controller incompatibility.
The system was one of those Cheslo 12000 systems with a tyan S5512 motherboard that has 12 SATA/SAS connections on it. I haven't traced the SATA/SAS wires to the ports on the board, but considering that the problem was on da1, da2, and da3, my guess is that they are on the same controller chip
-Log onto today and have the following errors:
CRITICAL
Pool vdisk01 state is ONLINE: One or more devices has been removed by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state.
The following devices are not healthy:
Disk HITACHI HUSSL402 CLAR200 XQVAR36A is REMOVED
2023-02-24 16:31:06 (America/New_York)
CRITICAL
Pool vdisk02 state is UNAVAIL: One or more devices are faulted in response to IO failures.
The following devices are not healthy:
Disk ATA TOSHIBA HDWQ140 Y7J1K1ZIFPBE is REMOVED
Disk ATA TOSHIBA HDWQ140 Y7LDK0D4FPBE is REMOVED
2023-02-24 16:31:06 (America/New_York)
XQVAR36A is on da3
Y7J1K1ZIFPBE is on da1
Y7LDK0D4FPB is on da2
So three disk are offline, and one pool is gone because it lost 2 out of 4 disks. But I noticed that they all went offline at the exact same time (2023-02-24 16:31:06).
I am thinking that it might be a power isssue, like a bad cord that took out three disks. So I power off the system, and move Y7LDK0D4FPB from da2 to da5, power up the system, and voila, all the disks are online, and both pools (vdisk01, and vdisk02) are perfectly fine.
The system has been behaving perfectly until the update, and so far, so good with the rebooot. My only thought is since the problem was with da1 to da3, that could it be chip controller incompatibility.
The system was one of those Cheslo 12000 systems with a tyan S5512 motherboard that has 12 SATA/SAS connections on it. I haven't traced the SATA/SAS wires to the ports on the board, but considering that the problem was on da1, da2, and da3, my guess is that they are on the same controller chip
Last edited: