Improved support for identifying location of drives without LED support

[spotter]

It's well known that TrueNAS Scale can't control the LED on something like an R720XD. However, that doesn't mean it has to let the user fly totally blind.

While sas2ircu will fail when one tries to use locate, the information provided it's display command is good to identify which slot/bay a drive is in. It would seem to be a major quality of life improvement for TrueNAS to be able to expose this via the UI to administrators.

Additionally, I have SAS drives that seem to be problematic "serial number" wise (i.e the serial number reported by normal tools (sas2ircu does report what is printed) doesn't reflect what is printed on the drive). However, they also have a WWN printed on them that is accurate to what linux detects AND what sas2ircu shows. It be nice if a) the UI could expose the WWN for physical devices in addition to the serial # and be able to use this information to corrolate the slot/bay information I mention above.

TrueNAS could show a visual diagram that shows which drive is faulty, instead of just having to rely on guessing or a manually generated text file that has serial number to bay mappings.

thoughts?

 

[Johnny Fartpants]

While sas2ircu will fail when one tries to use locate

Will it? I don't use SCALE that much but it works great on CORE.

 

[spotter]

Will it? I don't use SCALE that much but it works great on CORE.

on my r720xd that hss the HBA in IT mode

# sas2ircu 0 locate 2:0 on LSI Corporation SAS2 IR Configuration Utility. Version 20.00.00.00 (2014.09.18) Copyright (c) 2008-2014 LSI Corporation. All rights reserved. SAS2IRCU: IocStatus = 4 IocLogInfo = 824180928 SAS2IRCU: SEP write request failed. Cannot perform LOCATE. SAS2IRCU: Error executing command LOCATE.

from googling this seems to be the expected behavior for it when in IT mode. (also lots of comments here saying similiar). Perhaps if its in IR mode with each drive bein a single raid0 presenting to truenas it works. but that's not a reccomended configuration.

 

[Johnny Fartpants]

All of my old 9207-8e's worked fine in IT mode and all of my 9300-8e's work fine in IT mode. What controller are you using?

PS: I am only talking about CORE not SCALE.

 

[morganL]

It's well known that TrueNAS Scale can't control the LED on something like an R720XD. However, that doesn't mean it has to let the user fly totally blind.

While sas2ircu will fail when one tries to use locate, the information provided it's display command is good to identify which slot/bay a drive is in. It would seem to be a major quality of life improvement for TrueNAS to be able to expose this via the UI to administrators.

Additionally, I have SAS drives that seem to be problematic "serial number" wise (i.e the serial number reported by normal tools (sas2ircu does report what is printed) doesn't reflect what is printed on the drive). However, they also have a WWN printed on them that is accurate to what linux detects AND what sas2ircu shows. It be nice if a) the UI could expose the WWN for physical devices in addition to the serial # and be able to use this information to corrolate the slot/bay information I mention above.

TrueNAS could show a visual diagram that shows which drive is faulty, instead of just having to rely on guessing or a manually generated text file that has serial number to bay mappings.

thoughts?

TrueNAS enterprise appliances (and Minis) do have the graphical display being asked for. Its only feasible because we know the exact hardware, cabling of each appliance and we do testing with each release of CORE and SCALE.

The WWN display is an interesting suggestion. I assume you can get it though a CLI command. Have you tried?

In any case, create a suggestion ticket, report it in a thread and ask for upvotes. Its better if the CLI commands are known and documneted in the meantime.

 

[spotter]

TrueNAS enterprise appliances (and Minis) do have the graphical display being asked for. Its only feasible because we know the exact hardware, cabling of each appliance and we do testing with each release of CORE and SCALE.

what could be useful is to just print out the information that sas2ircu provides. example

i.e. from my r720xd

Code:

root@truenas[~]# sas2ircu list     
LSI Corporation SAS2 IR Configuration Utility.
Version 20.00.00.00 (2014.09.18) 
Copyright (c) 2008-2014 LSI Corporation. All rights reserved. 


         Adapter      Vendor  Device                       SubSys  SubSys 
 Index    Type          ID      ID    Pci Address          Ven ID  Dev ID 
 -----  ------------  ------  ------  -----------------    ------  ------ 
   0     SAS2308_2     1000h    87h   00h:03h:00h:00h      1028h   1f34h 
SAS2IRCU: Utility Completed Successfully.

root@truenas[~]# sas2ircu 0 display
LSI Corporation SAS2 IR Configuration Utility.
Version 20.00.00.00 (2014.09.18) 
Copyright (c) 2008-2014 LSI Corporation. All rights reserved. 

Read configuration has been initiated for controller 0
------------------------------------------------------------------------
Controller information
------------------------------------------------------------------------
  Controller type                         : SAS2308_2
  BIOS version                            : 7.39.02.00
  Firmware version                        : 20.00.07.00
  Channel description                     : 1 Serial Attached SCSI
  Initiator ID                            : 0
  Maximum physical devices                : 1023
  Concurrent commands supported           : 10240
  Slot                                    : Unknown
  Segment                                 : 0
  Bus                                     : 3
  Device                                  : 0
  Function                                : 0
  RAID Support                            : No
------------------------------------------------------------------------
IR Volume information
------------------------------------------------------------------------
------------------------------------------------------------------------
Physical device information
------------------------------------------------------------------------
Initiator at ID #0

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 0
  SAS Address                             : 5000c50-0-a747-7c59
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 000123WW
  GUID                                    : 5000c500a7477c5b
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 1
  SAS Address                             : 5000c50-0-a742-8cd1
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 00010RN3
  GUID                                    : 5000c500a7428cd3
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 2
  SAS Address                             : 5000c50-0-b723-2851
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 0005RKZ5
  GUID                                    : 5000c500b7232853
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 3
  SAS Address                             : 5000c50-0-a75e-e345
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 00016G8L
  GUID                                    : 5000c500a75ee347
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 4
  SAS Address                             : 5000c50-0-a75d-e641
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 000163EQ
  GUID                                    : 5000c500a75de643
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 5
  SAS Address                             : 5000c50-0-a75f-5389
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 00016FR6
  GUID                                    : 5000c500a75f538b
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 6
  SAS Address                             : 500056b-3-6789-abe2
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : ATA     
  Model Number                            : ST14000NE0008-2R
  Firmware Revision                       : EN02
  Serial No                               : ZL2LYH44
  GUID                                    : 5000c500dcc80470
  Protocol                                : SATA
  Drive Type                              : SATA_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 7
  SAS Address                             : 500056b-3-6789-abe3
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : ATA     
  Model Number                            : ST14000NE0008-2R
  Firmware Revision                       : EN02
  Serial No                               : ZTM0F6ZQ
  GUID                                    : 5000c500dcd724d7
  Protocol                                : SATA
  Drive Type                              : SATA_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 8
  SAS Address                             : 5000c50-0-aeac-a8d1
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 0004LYD1
  GUID                                    : 5000c500aeaca8d3
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 9
  SAS Address                             : 5000c50-0-b723-2aa1
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 0003GGDE
  GUID                                    : 5000c500b7232aa3
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 10
  SAS Address                             : 5000c50-0-a749-a631
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 000122KS
  GUID                                    : 5000c500a749a633
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 11
  SAS Address                             : 5000c50-0-a742-58c1
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 13351935/27344764927
  Manufacturer                            : 
  Model Number                            : OOS14000G       
  Firmware Revision                       : BE83
  Serial No                               : 00010S9W
  GUID                                    : 5000c500a74258c3
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 12
  SAS Address                             : 5000c50-0-8fb9-26a9
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 572325/1172123567
  Manufacturer                            : SEAGATE 
  Model Number                            : ST600MP0005     
  Firmware Revision                       : VT33
  Serial No                               : S7M0V77J
  GUID                                    : 5000c5008fb926ab
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a Hard disk
  Enclosure #                             : 2
  Slot #                                  : 13
  SAS Address                             : 5000c50-0-8fb9-363d
  State                                   : Ready (RDY)
  Size (in MB)/(in sectors)               : 572325/1172123567
  Manufacturer                            : SEAGATE 
  Model Number                            : ST600MP0005     
  Firmware Revision                       : VT33
  Serial No                               : S7M0V70K
  GUID                                    : 5000c5008fb9363f
  Protocol                                : SAS
  Drive Type                              : SAS_HDD

Device is a unknown device
  Enclosure #                             : 2
  Slot #                                  : 24
  SAS Address                             : 500056b-3-6789-abfd
  State                                   : Standby (SBY)
  Manufacturer                            : DP      
  Model Number                            : SAS2 EXP BP     
  Firmware Revision                       : 1.07
  Serial No                               : x360107
  GUID                                    : N/A
  Protocol                                : SAS
  Drive Type                              : SAS_HDD
------------------------------------------------------------------------
Enclosure information
------------------------------------------------------------------------
  Enclosure#                              : 1
  Logical ID                              : 5b8ca3a0:e8771a00
  Numslots                                : 8
  StartSlot                               : 0
  Enclosure#                              : 2
  Logical ID                              : 500056b3:6789abff
  Numslots                                : 38
  StartSlot                               : 0
------------------------------------------------------------------------
SAS2IRCU: Command DISPLAY Completed Successfully.
SAS2IRCU: Utility Completed Successfully.

The WWN display is an interesting suggestion. I assume you can get it though a CLI command. Have you tried?

The GUID is the WWN as one can see in /dev/disk/by-id

Code:

root@truenas[~]# ls -l /dev/disk/by-id/wwn-0x* |grep -v part
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c5008fb926ab -> ../../sdm
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c5008fb9363f -> ../../sdl
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500a74258c3 -> ../../sdh
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500a7428cd3 -> ../../sdk
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500a7477c5b -> ../../sda
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500a749a633 -> ../../sdf
lrwxrwxrwx 1 root root  9 Sep  6 13:36 /dev/disk/by-id/wwn-0x5000c500a75de643 -> ../../sdo
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500a75ee347 -> ../../sdn
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500a75f538b -> ../../sdj
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500aeaca8d3 -> ../../sde
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500b7232853 -> ../../sdg
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500b7232aa3 -> ../../sdd
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500dcc80470 -> ../../sdb
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x5000c500dcd724d7 -> ../../sdc
lrwxrwxrwx 1 root root  9 Sep  6 13:29 /dev/disk/by-id/wwn-0x600508e07e726177809ebff484214005 -> ../../sdi

also visible in smartctl

Code:

root@truenas[~]# smartctl -a /dev/sde
smartctl 7.2 2020-12-30 r5155 [x86_64-linux-5.15.107+truenas] (local build)
Copyright (C) 2002-20, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Vendor:               
Product:              OOS14000G
Revision:             BE83
Compliance:           SPC-5
User Capacity:        14,000,519,643,136 bytes [14.0 TB]
Logical block size:   512 bytes
Physical block size:  4096 bytes
LU is fully provisioned
Rotation Rate:        7200 rpm
Form Factor:          3.5 inches
Logical Unit id:      0x5000c500aeaca8d3
Serial number:        0004LYD10000C0114FQE
Device type:          disk
Transport protocol:   SAS (SPL-3)
Local Time is:        Sat Sep  9 10:55:07 2023 PDT
SMART support is:     Available - device has SMART capability.
SMART support is:     Enabled
Temperature Warning:  Enabled

=== START OF READ SMART DATA SECTION ===
SMART Health Status: OK
Current Drive Temperature:     0 C
Drive Trip Temperature:        0 C

Elements in grown defect list: 0

Error Counter logging not supported

Device does not support Self Test logging

as one can see for this white label sas drive, the serial # in sasctl is an expanded version of what's sas2ircu shows (though perhaps I was wrong above and the serial # isn't related to what's written on the drive).

In any case, create a suggestion ticket, report it in a thread and ask for upvotes. Its better if the CLI commands are known and documneted in the meantime.

Ok, I'll look into doing that.