Hello,
I'm having an issue when I try to replace a failed drive, the SAS drives don't register properly for some reason, your help would be much appreciated.
The hardware setup is a Supermicro server running 12.0-RC1, 4x SAS2308 (two used, adapters 2 and 3) and 2x SuperMicro JBODs
SAS Cabling
JBOD #1 Port 0 -> HBA #2 Port 0
JBOD #1 Port 1 -> HBA #3 Port 0
JBOD #2 Port 0 -> HBA #2 Port 1
JBOD #2 Port 1 -> HBA #3 Port 1
The problem drives, replaced failed units in the same slot.
I would expect them to show up as RDY but instead they're coming up as AVL
From sas2ircu user guide: "Available (AVL) – The drive might not be ready, and it is not suitable for use in a volume or a hot spare pool."
One odd thing I noticed was that during install TrueNAS seems to have flashed the HBA FW, it was too fast to be sure but I think that's what happened.
Strangely the HBA's with the JBODs connected are on FW v15 and the un-used on FW V20
Any idea on how to resolve this issue?
I'm thinking of connecting the JBODS into the HBA's with the FW version 20.00.04.00 as a test. Thoughts?
Thank you for reading
I'm having an issue when I try to replace a failed drive, the SAS drives don't register properly for some reason, your help would be much appreciated.
The hardware setup is a Supermicro server running 12.0-RC1, 4x SAS2308 (two used, adapters 2 and 3) and 2x SuperMicro JBODs
SAS Cabling
JBOD #1 Port 0 -> HBA #2 Port 0
JBOD #1 Port 1 -> HBA #3 Port 0
JBOD #2 Port 0 -> HBA #2 Port 1
JBOD #2 Port 1 -> HBA #3 Port 1
camcontrol rescan all doesn't help, drives remain in the same state. Neither has a reboot of the system.Code:
[~]# sas2ircu list
LSI Corporation SAS2 IR Configuration Utility.
Version 20.00.00.00 (2014.09.18)
Copyright (c) 2008-2014 LSI Corporation. All rights reserved.
Adapter Vendor Device SubSys SubSys
Index Type ID ID Pci Address Ven ID Dev ID
----- ------------ ------ ------ ----------------- ------ ------
0 SAS2308_2 1000h 87h 00h:06h:00h:00h 1000h 3040h
Adapter Vendor Device SubSys SubSys
Index Type ID ID Pci Address Ven ID Dev ID
----- ------------ ------ ------ ----------------- ------ ------
1 SAS2308_2 1000h 87h 00h:08h:00h:00h 1000h 3040h
Adapter Vendor Device SubSys SubSys
Index Type ID ID Pci Address Ven ID Dev ID
----- ------------ ------ ------ ----------------- ------ ------
2 SAS2308_2 1000h 87h 00h:88h:00h:00h 1000h 3040h
Adapter Vendor Device SubSys SubSys
Index Type ID ID Pci Address Ven ID Dev ID
----- ------------ ------ ------ ----------------- ------ ------
3 SAS2308_2 1000h 87h 00h:8ah:00h:00h 1000h 3040h
The problem drives, replaced failed units in the same slot.
I would expect them to show up as RDY but instead they're coming up as AVL
From sas2ircu user guide: "Available (AVL) – The drive might not be ready, and it is not suitable for use in a volume or a hot spare pool."
Code:
#sas2ircu 2 DISPLAY .... Device is a Hard disk Enclosure # : 5 Slot # : 2 SAS Address : 5000c50-0-b70b-b28d State : Available (AVL) Manufacturer : Model Number : Firmware Revision : Serial No : GUID : N/A Protocol : SAS Drive Type : SAS_HDD Device is a Hard disk Enclosure # : 5 Slot # : 3 SAS Address : 5000c50-0-b70c-2e8d State : Available (AVL) Manufacturer : Model Number : Firmware Revision : Serial No : GUID : N/A Protocol : SAS Drive Type : SAS_HDD .....
sesutil show shows them as "OK, Swapped"Code:
ses8: <LSI SAS2X36 0e12>; ID: 5003048001ff623f Desc Dev Model Ident Size/Status Slot 01 da114 SEAGATE ST4000NM0023 Z1Z8LRBF0000R540WKTH 4T Slot 02 da115 SEAGATE ST4000NM0023 Z1Z8LNYB0000R540VRWJ 4T Slot 03 - - - OK, Swapped Slot 04 - - - OK, Swapped Slot 05 da116 SEAGATE ST4000NM0023 Z1Z8LM3Z0000C5403R3Z 4T Slot 06 da117 SEAGATE ST4000NM0023 Z1Z8M2G10000R54027BL 4T Slot 07 da118 SEAGATE ST4000NM0023 Z1Z8LMLV0000C5407DZZ 4T Slot 08 da119 SEAGATE ST4000NM0023 Z1Z8LNRD0000R540WMCH 4T Slot 09 da120 SEAGATE ST4000NM0025 ZC12YNXZ0000R802TLC6 4T Slot 10 - - - Not Installed Slot 11 da121 SEAGATE ST4000NM0125 ZC12R0DF0000R749QR1Y 4T Slot 12 da122 SEAGATE ST4000NM0125 ZC12R0B90000R749RLN1 4T Slot 13 da123 SEAGATE ST4000NM0125 ZC12R0SQ0000C7522DDH 4T Slot 14 da124 SEAGATE ST4000NM0125 ZC127LW10000R746BMCV 4T Slot 15 da125 SEAGATE ST4000NM0125 ZC127LRD0000R746SBC2 4T Slot 16 da126 SmrtStor SDLKOEDM200G5CA1 202A1E66 20G Slot 17 - - - Not Installed Slot 18 - - - Not Installed Slot 19 - - - Not Installed Slot 20 - - - Not Installed Slot 21 - - - Not Installed
One odd thing I noticed was that during install TrueNAS seems to have flashed the HBA FW, it was too fast to be sure but I think that's what happened.
Strangely the HBA's with the JBODs connected are on FW v15 and the un-used on FW V20
Code:
[~]# sas2flash -listall
LSI Corporation SAS2 Flash Utility
Version 16.00.00.00 (2013.03.01)
Copyright (c) 2008-2013 LSI Corporation. All rights reserved
Adapter Selected is a LSI SAS: SAS2308_2(D1)
Num Ctlr FW Ver NVDATA x86-BIOS PCI Addr
----------------------------------------------------------------------------
0 SAS2308_2(D1) 20.00.04.00 14.01.00.06 07.39.00.00 00:06:00:00
1 SAS2308_2(D1) 20.00.04.00 14.01.00.06 07.39.00.00 00:08:00:00
2 SAS2308_2(D1) 15.00.00.00 0f.00.00.03 07.29.00.00 00:88:00:00
3 SAS2308_2(D1) 15.00.00.00 0f.00.00.03 07.29.00.00 00:8a:00:00
Finished Processing Commands Successfully.
Exiting SAS2Flash.
Any idea on how to resolve this issue?
I'm thinking of connecting the JBODS into the HBA's with the FW version 20.00.04.00 as a test. Thoughts?
Thank you for reading
