TrueNAS-13.0-U6.1 SAS drives beyond da13 not showing up in GUI

[MasterTacoChief]

TrueNAS-13.0-U6.1, R730 with LSI9201-16e, DS4246 disk shelf. SAS drives up to da13 show up in the GUI, but when inserting additional drives they show up in dmesg and camcontrol but not in the GUI when hotplugged. All these disks have been used in both this system and another nearly identical one with TrueNAS in the past.
I just inserted 6x 8TB drives in this shelf (da12-17), and only da12 and da13 appeared in the GUI. They also do not show up in the options to create a new pool. I added two additional 4TB drives (da18, da19) that had just been removed from this system before adding the 8TB drives, and they also show up in dmesg and camcontrol but not in the GUI. I haven't tried rebooting yet since I have some pending file writes in the next hour or so but will try that once I can have some downtime.

dmesg when disks inserted:
ses0: da12,pass13 in Array Device Slot 11, SAS Slot: 1+ phys at slot 10
da12 at mps0 bus 0 scbus0 target 88 lun 0
da12: <HGST H7280B520SUN8.0T A374> Fixed Direct Access SPC-4 SCSI device
da12: Serial Number 001740S3B0BL 7SH3B0BL
da12: 600.000MB/s transfers
da12: Command Queueing enabled
da12: 7501160MB (15362376264 512 byte sectors, DIF type 1)
ses0: da13,pass14 in Array Device Slot 7, SAS Slot: 1+ phys at slot 6
da13 at mps0 bus 0 scbus0 target 89 lun 0
da13: <HGST H7280B520SUN8.0T A374> Fixed Direct Access SPC-4 SCSI device
da13: Serial Number 001742S5JV0L 7SH5JV0L
da13: 600.000MB/s transfers
da13: Command Queueing enabled
da13: 7501160MB (15362376264 512 byte sectors, DIF type 1)
ses0: da14,pass15 in Array Device Slot 3, SAS Slot: 1+ phys at slot 2
da14 at mps0 bus 0 scbus0 target 62 lun 0
da14: <HGST H7280B520SUN8.0T A374> Fixed Direct Access SPC-4 SCSI device
da14: Serial Number 001740SKTBPK 7SGKTBPK
da14: 600.000MB/s transfers
da14: Command Queueing enabled
da14: 7501160MB (15362376264 512 byte sectors, DIF type 1)
ses0: da15,pass16 in Array Device Slot 12, SAS Slot: 1+ phys at slot 11
da15 at mps0 bus 0 scbus0 target 65 lun 0
da15: <HGST H7280B520SUN8.0T A374> Fixed Direct Access SPC-4 SCSI device
da15: Serial Number 001743S4GMJK 7SH4GMJK
da15: 600.000MB/s transfers
da15: Command Queueing enabled
da15: 7501160MB (15362376264 512 byte sectors, DIF type 1)
ses0: da16,pass17 in Array Device Slot 8, SAS Slot: 1+ phys at slot 7
da16 at mps0 bus 0 scbus0 target 64 lun 0
da16: <HGST H7280B520SUN8.0T A374> Fixed Direct Access SPC-4 SCSI device
da16: Serial Number 001743S5J8HL 7SH5J8HL
da16: 600.000MB/s transfers
da16: Command Queueing enabled
da16: 7501160MB (15362376264 512 byte sectors, DIF type 1)
ses0: da17,pass18 in Array Device Slot 4, SAS Slot: 1+ phys at slot 3
da17 at mps0 bus 0 scbus0 target 63 lun 0
da17: <HGST H7280B520SUN8.0T A374> Fixed Direct Access SPC-4 SCSI device
da17: Serial Number 001741S45Y2K 7SH45Y2K
da17: 600.000MB/s transfers
da17: Command Queueing enabled
da17: 7501160MB (15362376264 512 byte sectors, DIF type 1)

camcontrol devlist
<NETAPP DS424-E6EBD 221a> at scbus0 target 43 lun 0 (ses0,pass4)
<WDC WD40EFRX-68WT0SM 4321> at scbus0 target 54 lun 0 (da3,pass3)
<WDC WD40EFRX-68N32SM 4321> at scbus0 target 55 lun 0 (da2,pass2)
<HGST HUS724040ALS640 W1CG> at scbus0 target 59 lun 0 (da19,pass27)
<HGST HUS724040ALS640 W1CG> at scbus0 target 60 lun 0 (da18,pass26)
<HGST H7280B520SUN8.0T A374> at scbus0 target 62 lun 0 (da14,pass15)
<HGST H7280B520SUN8.0T A374> at scbus0 target 63 lun 0 (da17,pass18)
<HGST H7280B520SUN8.0T A374> at scbus0 target 64 lun 0 (da16,pass17)
<HGST H7280B520SUN8.0T A374> at scbus0 target 65 lun 0 (da15,pass16)
<ATA HGST HUS724040AL AA70> at scbus0 target 66 lun 0 (da4,pass5)
<ATA HGST HUS724040AL AA70> at scbus0 target 67 lun 0 (da5,pass6)
<HGST HUS724040ALA64SM 4321> at scbus0 target 69 lun 0 (da0,pass0)
<HGST HUH721010AL42C0 A38K> at scbus0 target 71 lun 0 (da11,pass12)
<HGST HUH721010AL42C0 A3Z4> at scbus0 target 72 lun 0 (da6,pass7)
<HGST HUH721010AL42C0 A3Z4> at scbus0 target 73 lun 0 (da10,pass11)
<HGST HUH721010AL42C0 A38K> at scbus0 target 74 lun 0 (da7,pass8)
<HGST HUH721010AL42C0 A38K> at scbus0 target 75 lun 0 (da8,pass9)
<HGST HUH721010AL42C0 A38K> at scbus0 target 76 lun 0 (da9,pass10)
<HGST HUS724040ALS640 A280> at scbus0 target 87 lun 0 (da1,pass1)
<HGST H7280B520SUN8.0T A374> at scbus0 target 88 lun 0 (da12,pass13)
<HGST H7280B520SUN8.0T A374> at scbus0 target 89 lun 0 (da13,pass14)
<KINGSTON SA400S37120G SBFK61K1> at scbus1 target 0 lun 0 (ada0,pass19)
<SAMSUNG MZ7LH1T9HMLT-00005 HXT7104Q> at scbus2 target 0 lun 0 (ada1,pass20)
<SAMSUNG MZ7LH1T9HMLT-00005 HXT7104Q> at scbus3 target 0 lun 0 (ada2,pass21)
<KINGSTON SA400S37120G SBFK71E0> at scbus4 target 0 lun 0 (ada3,pass22)
<AHCI SGPIO Enclosure 2.00 0001> at scbus5 target 0 lun 0 (ses1,pass23)
<TOSHIBA THNSN8480PCSE 8EET6101> at scbus9 target 0 lun 0 (ada4,pass24)
<AHCI SGPIO Enclosure 2.00 0001> at scbus12 target 0 lun 0 (ses2,pass25)

sas2flash -list
LSI Corporation SAS2 Flash Utility
Version 16.00.00.00 (2013.03.01)
Copyright (c) 2008-2013 LSI Corporation. All rights reserved

Adapter Selected is a LSI SAS: SAS2116_1(B1)

Controller Number : 0
Controller : SAS2116_1(B1)
PCI Address : 00:03:00:00
SAS Address : 500062b-2-00d5-7380
NVDATA Version (Default) : 14.01.00.07
NVDATA Version (Persistent) : 14.01.00.07
Firmware Product ID : 0x2213 (IT)
Firmware Version : 20.00.06.00
NVDATA Vendor : LSI
NVDATA Product ID : SAS9201-16e
BIOS Version : 07.39.02.00
UEFI BSD Version : N/A
FCODE Version : N/A
Board Name : SAS9201-16e
Board Assembly : H3-25577-00A
Board Tracer Number : SV44315135

Finished Processing Commands Successfully.
Exiting SAS2Flash.

 

[Ericloewe]

That's a bit odd, are you sure it's not just a pagination thing? Sometimes the page selector ends up outside the window rectangle, which leads to confusion.

Sidenote: the HBA firmware is not quite right: you want 20.00.07. This is almost certainly unrelated to your issue.

 

[MasterTacoChief]

Thanks for the hint on the firmware, I'll upgrade that soon. I had assumed they were done updating firmware for these old controllers at least one acquisition ago.

I had thought about the page selector and it definitely wasn't there. Also only two drives being available when creating a new pool was another hint something was up.

Well a reboot fixed it, all drives present now. There must be something going on in the GUI once a certain number of hot-insertions occurs. I happened to be moving drives around in the disk shelf to organize things when this happened.