Updated to U4 and now none of my disks show - Best way to troubleshoot?

HarambeLives

Contributor
Joined
Jul 19, 2021
Messages
153
Running on 13-U3.1 everything was great on my second NAS, no issues

Upgraded to 13-U4, and none of my data disks show up! They did however show up in the LSI list from the HBA booting when the system was turning on. Went back to U3.1 and still no disks.

What is the best way to go about figuring out the issue here? The only thing I can think is that this card is on pretty old firmware, and maybe the U4 added a new driver that removes support? But, then going to U3.1 should work again right?

If I do sas2flash -listall I get a message about no LSI Adapters found

But, If I do dmesg | grep mps I get this, showing me that the card and disk are there!

Code:
root@NASBK[~]# dmesg | grep mps
mps0: <Avago Technologies (LSI) SAS2008> port 0xe000-0xe0ff mem 0xdf1c0000-0xdf1c3fff,0xdf180000-0xdf1bffff irq 16 at device 0.0 on pci1
mps0: Firmware: 10.00.05.00, Driver: 21.02.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
da0 at mps0 bus 0 scbus0 target 4 lun 0
da1 at mps0 bus 0 scbus0 target 5 lun 0
da2 at mps0 bus 0 scbus0 target 6 lun 0
da3 at mps0 bus 0 scbus0 target 7 lun 0
mps0: <Avago Technologies (LSI) SAS2008> port 0xe000-0xe0ff mem 0xdf1c0000-0xdf1c3fff,0xdf180000-0xdf1bffff irq 16 at device 0.0 on pci1
mps0: Firmware: 10.00.05.00, Driver: 21.02.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
da0 at mps0 bus 0 scbus0 target 4 lun 0
da1 at mps0 bus 0 scbus0 target 5 lun 0
da2 at mps0 bus 0 scbus0 target 6 lun 0
da3 at mps0 bus 0 scbus0 target 7 lun 0


How can I figure out why these disks don't show?

The boot log also shows it syncing 7 disks, which I think is correct

* A flash drive I have connected
* Virtual TinyPilot Media
* Boot Device
* 4 x SAS Disks

Code:
Mar  8 13:44:11 NASBK Starting devd.
Mar  8 13:44:11 NASBK Autoloading module: ichsmb
Mar  8 13:44:11 NASBK Starting zfsd.
Mar  8 13:44:11 NASBK Setting hostuuid: 3bc28570-1946-0000-0000-000000000000.
Mar  8 13:44:11 NASBK Setting hostid: 0xc34f0bba.
Mar  8 13:44:11 NASBK <118>middlewared: starting                                       middlewared: loaded plugin middlewared.plugins.mail         middlewared: loaded plugin middlewared.plugins.webdav       middlewared: loaded plugin middlewared.plugins.tftp         middlewared: loaded plugin middlewared.plugins.activedirectomiddlewared: loaded plugin middlewared.plugins.pool         middlewared: loaded plugin middlewared.plugins.smb          middlewared: loaded plugin middlewared.plugins.etc          middlewared: loaded plugin middlewared.plugins.usage        middlewared: loaded plugin middlewared.plugins.zettarepl    middlewared: loaded plugin middlewared.plugins.filesystem   middlewared: loaded plugin middlewared.plugins.device       middlewared: loaded plugin middlewared.plugins.ipmi         middlewared: loaded plugin middlewared.plugins.sysdataset   middlewared: loaded plugin middlewared.plugins.update       middlewared: loaded plugin middlewared.plugins.directoryservmiddlewared: loaded plugin middlewared.plugins.afp          middlewared: loaded plugin middlewared.plugins.iscsi        middlewared: loaded plugin middlewared.plugins.kerberos     middlewared: loaded plugin middlewared.plugins.lldp         middlewared: loaded plugin middlewared.plugins.multipath    middlewared: loaded plugin middlewared.plugins.s3           middlewared: loaded plugin middlewared.plugins.support      middlewared: loaded plugin middlewared.plugins.bootenv      middlewared: loaded plugin middlewared.plugins.keyvalue     middlewared: loaded plugin middlewared.plugins.alert        middlewared: loaded plugin middlewared.plugins.boot         middlewared: loaded plugin middlewared.plugins.replication  middlewared: loaded plugin middlewared.plugins.account      middlewared: loaded plugin middlewared.plugins.ssh          middlewared: loaded plugin middlewared.plugins.idmap        middlewared: loaded plugin middlewared.plugins.pwenc        middlewared: loaded plugin middlewared.plugins.unscheduled_rmiddlewared: loaded plugin middlewared.plugins.auth         middlewared: loaded plugin middlewared.plugins.jail_freebsd middlewared: loaded plugin middlewared.plugins.snmp         middlewared: loaded plugin middlewared.plugins.keychain     middlewared: loaded plugin middlewared.plugins.config       middlewared: loaded plugin middlewared.plugins.trueview     middlewared: loaded plugin middlewared.plugins.ec2          middlewared: loaded plugin middlewared.plugins.webui        middlewared: loaded plugin middlewared.plugins.acme_protocolmiddlewared: loaded plugin middlewared.plugins.crypto       middlewared: loaded plugin middlewared.plugins.hardware     middlewared: loaded plugin middlewared.plugins.disk         middlewared: loaded plugin middlewared.plugins.vmware       middlewared: loaded plugin middlewared.plugins.geom         middlewared: loaded plugin middlewared.plugins.nis          middlewared: loaded plugin middlewared.plugins.vm           middlewared: loaded plugin middlewared.plugins.tunables     middlewared: loaded plugin middlewared.plugins.cache        middlewared: loaded plugin middlewared.plugins.rsync        middlewared: loaded plugin middlewared.plugins.init_shutdownmiddlewared: loaded plugin middlewared.plugins.vpn          middlewared: loaded plugin middlewared.plugins.zfs          middlewared: loaded plugin middlewared.plugins.ntp          middlewared: loaded plugin middlewared.plugins.migration    middlewared: loaded plugin middlewared.plugins.service      middlewared: loaded plugin middlewared.plugins.api_key      middlewared: loaded plugin middlewared.plugins.cron         middlewared: loaded plugin middlewared.plugins.snapshot     middlewared: loaded plugin middlewared.plugins.smart        middlewared: loaded plugin middlewared.plugins.ldap         middlewared: loaded plugin middlewared.plugins.cloud_sync   middlewared: loaded plugin middlewared.plugins.ups          middlewared: loaded plugin middlewared.plugins.dyndns       middlewared: loaded plugin middlewared.plugins              middlewared: loaded plugin middlewared.plugins.ftp          middlewared: loaded plugin middlewared.plugins.stats        middlewared: loaded plugin middlewared.plugins.network      middlewared: loaded plugin middlewared.plugins.nfs          middlewared: loaded plugin middlewared.plugins.system       middlewared: loaded plugin middlewared.plugins.pool_.format_middlewared: loaded plugin middlewared.plugins.pool_.import_middlewared: loaded plugin middlewared.plugins.pool_.replacemiddlewared: loaded plugin middlewared.plugins.pool_        middlewared: loaded plugin middlewared.plugins.pool_.expand middlewared: loaded plugin middlewared.plugins.pool_.encryptmiddlewared: loaded plugin middlewared.plugins.pool_.encryptmiddlewared: loaded plugin middlewared.plugins.pool_.attach_middlewared: loaded plugin middlewared.plugins.pool_.info   middlewared: loaded plugin middlewared.plugins.pool_.import_middlewared: loaded plugin middlewared.plugins.iscsi_.iscsi_middlewared: loaded plugin middlewared.plugins.iscsi_.globalmiddlewared: loaded plugin middlewared.plugins.iscsi_       middlewared: loaded plugin middlewared.plugins.interface.lagmiddlewared: loaded plugin middlewared.plugins.interface.capmiddlewared: loaded plugin middlewared.plugins.interface.netmiddlewared: loaded plugin middlewared.plugins.interface.dhcmiddlewared: loaded plugin middlewared.plugins.interface    middlewared: loaded plugin middlewared.plugins.interface.typmiddlewared: loaded plugin middlewared.plugins.interface.conmiddlewared: loaded plugin middlewared.plugins.interface.linmiddlewared: loaded plugin middlewared.plugins.interface.brimiddlewared: loaded plugin middlewared.plugins.interface.lagmiddlewared: loaded plugin middlewared.plugins.interface.conmiddlewared: loaded plugin middlewared.plugins.interface.vlamiddlewared: loaded plugin middlewared.plugins.boot_        middlewared: loaded plugin middlewared.plugins.boot_.format middlewared: loaded plugin middlewared.plugins.boot_.boot_lomiddlewared: loaded plugin middlewared.plugins.geom_.cache  middlewared: loaded plugin middlewared.plugins.geom_        middlewared: loaded plugin middlewared.plugins.device_.devd_middlewared: loaded plugin middlewared.plugins.device_      middlewared: loaded plugin middlewared.plugins.update_.utilsmiddlewared: loaded plugin middlewared.plugins.update_.instamiddlewared: loaded plugin middlewared.plugins.update_.uploamiddlewared: loaded plugin middlewared.plugins.update_.trainmiddlewared: loaded plugin middlewared.plugins.update_.instamiddlewared: loaded plugin middlewared.plugins.update_.utilsmiddlewared: loaded plugin middlewared.plugins.update_.pendimiddlewared: loaded plugin middlewared.plugins.update_.downlmiddlewared: loaded plugin middlewared.plugins.update_.downlmiddlewared: loaded plugin middlewared.plugins.update_.trainmiddlewared: loaded plugin middlewared.plugins.update_      middlewared: loaded plugin middlewared.plugins.account_.syncmiddlewared: loaded plugin middlewared.plugins.account_     middlewared: loaded plugin middlewared.plugins.nfs_.v4_freebmiddlewared: loaded plugin middlewared.plugins.nfs_.krb5    middlewared: loaded plugin middlewared.plugins.nfs_         middlewared: loaded plugin middlewared.plugins.nfs_.sec     middlewared: loaded plugin middlewared.plugins.hardware_.mcamiddlewared: loaded plugin middlewared.plugins.hardware_    middlewared: loaded plugin middlewared.plugins.mail_.gmail  middlewared: loaded plugin middlewared.plugins.mail_        middlewared: loaded plugin middlewared.plugins.zfs_.zfs_evenmiddlewared: loaded plugin middlewared.plugins.zfs_.events  middlewared: loaded plugin middlewared.plugins.zfs_         middlewared: loaded plugin middlewared.plugins.zfs_.disks_frmiddlewared: loaded plugin middlewared.plugins.disk_.temperamiddlewared: loaded plugin middlewared.plugins.disk_.swap_comiddlewared: loaded plugin middlewared.plugins.disk_.hddstanmiddlewared: loaded plugin middlewared.plugins.disk_.disk_inmiddlewared: loaded plugin middlewared.plugins.disk_.encryptmiddlewared: loaded plugin middlewared.plugins.disk_.dumpdevmiddlewared: loaded plugin middlewared.plugins.disk_.availabmiddlewared: loaded plugin middlewared.plugins.disk_.smart  middlewared: loaded plugin middlewared.plugins.disk_.disk_evmiddlewared: loaded plugin middlewared.plugins.disk_.swap_mimiddlewared: loaded plugin middlewared.plugins.disk_.wipe   middlewared: loaded plugin middlewared.plugins.disk_.smartctmiddlewared: loaded plugin middlewared.plugins.disk_.remove_middlewared: loaded plugin middlewared.plugins.disk_.identifmiddlewared: loaded plugin middlewared.plugins.disk_        middlewared: loaded plugin middlewared.plugins.disk_.nvme_frmiddlewared: loaded plugin middlewared.plugins.disk_.swap_remiddlewared: loaded plugin middlewared.plugins.disk_.format middlewared: loaded plugin middlewared.plugins.disk_.sync   middlewared: loaded plugin middlewared.plugins.disk_.overpromiddlewared: loaded plugin middlewared.plugins.disk_.smart_amiddlewared: loaded plugin middlewared.plugins.disk_.info   middlewared: loaded plugin middlewared.plugins.disk_.zfs_guimiddlewared: loaded plugin middlewared.plugins.disk_.label_fmiddlewared: loaded plugin middlewared.plugins.zettarepl_.utmiddlewared: loaded plugin middlewared.plugins.zettarepl_   middlewared: loaded plugin middlewared.plugins.zettarepl_.stmiddlewared: loaded plugin middlewared.plugins.replication_ middlewared: loaded plugin middlewared.plugins.replication_.middlewared: loaded plugin middlewared.plugins.replication_.middlewared: loaded plugin middlewared.plugins.enterprise.m_middlewared: loaded plugin middlewared.plugins.enterprise   middlewared: loaded plugin middlewared.plugins.service_     middlewared: loaded plugin middlewared.plugins.sysctl.hint_imiddlewared: loaded plugin middlewared.plugins.sysctl       middlewared: loaded plugin middlewared.plugins.kmip.sed_keysmiddlewared: loaded plugin middlewared.plugins.kmip.zfs_keysmiddlewared: loaded plugin middlewared.plugins.kmip.sync    middlewared: loaded plugin middlewared.plugins.kmip.connectimiddlewared: loaded plugin middlewared.plugins.kmip         middlewared: loaded plugin middlewared.plugins.kmip.update  middlewared: loaded plugin middlewared.plugins.cloud_sync_.cmiddlewared: loaded plugin middlewared.plugins.cloud_sync_  middlewared: loaded plugin middlewared.plugins.smb_.passdb  middlewared: loaded plugin middlewared.plugins.smb_.status  middlewared: loaded plugin middlewared.plugins.smb_.groupmapmiddlewared: loaded plugin middlewared.plugins.smb_.sharesecmiddlewared: loaded plugin middlewared.plugins.smb_.sid     middlewared: loaded plugin middlewared.plugins.smb_         middlewared: loaded plugin middlewared.plugins.smb_.admin_grmiddlewared: loaded plugin middlewared.plugins.smb_.registrymiddlewared: loaded plugin middlewared.plugins.smb_.util_sd middlewared: loaded plugin middlewared.plugins.system_.dmi  middlewared: loaded plugin middlewared.plugins.system_      middlewared: loaded plugin middlewared.plugins.reporting.updmiddlewared: loaded plugin middlewared.plugins.reporting    middlewared: loaded plugin middlewared.plugins.reporting.rrdmiddlewared: loaded plugin middlewared.plugins.reporting.plumiddlewared: loaded plugin middlewared.plugins.reporting.iosmiddlewared: loaded plugin middlewared.plugins.reporting.conmiddlewared: loaded plugin middlewared.plugins.reporting.evemiddlewared: loaded plugin middlewared.plugins.reporting.plumiddlewared: loaded plugin middlewared.plugins.reporting.promiddlewared: loaded plugin middlewared.plugins.vm_.events   middlewared: loaded plugin middlewared.plugins.vm_          middlewared: loaded plugin middlewared.plugins.vm_.connectiomiddlewared: loaded plugin middlewared.plugins.truecommand.emiddlewared: loaded plugin middlewared.plugins.truecommand  middlewared: loaded plugin middlewared.plugins.truecommand.cmiddlewared: loaded plugin middlewared.plugins.truecommand.wmiddlewared: loaded plugin middlewared.plugins.truecommand.umiddlewared: loaded plugin middlewared.plugins.truecommand.pmiddlewared: loaded plugin middlewared.plugins.s3_.attachmenmiddlewared: loaded plugin middlewared.plugins.s3_          middlewared: loaded plugin middlewared.plugins.datastore.conmiddlewared: loaded plugin middlewared.plugins.datastore.wrimiddlewared: loaded plugin middlewared.plugins.datastore.reamiddlewared: loaded plugin middlewared.plugins.datastore.filmiddlewared: loaded plugin middlewared.plugins.datastore.evemiddlewared: loaded plugin middlewared.plugins.datastore    middlewared: loaded plugin middlewared.plugins.datastore.utimiddlewared: loaded plugin middlewared.plugins.datastore.schmiddlewared: loaded plugin middlewared_truenas.plugins.fcpormiddlewared: loaded plugin middlewared_truenas.plugins.sensomiddlewared: loaded plugin middlewared_truenas.plugins.failomiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.truenmiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.enclomiddlewared: loaded plugin middlewared_truenas.plugins.failomiddlewared: loaded plugin middlewared_truenas.plugins.failomiddlewared: loaded plugin middlewared_truenas.plugins.failomiddlewared: loaded plugin middlewared_truenas.plugins.failomiddlewared: loaded plugin middlewared_truenas.plugins.failomiddlewared: loaded plugin middlewared_truenas.plugins.failomiddlewared: loaded plugin middlewared_truenas.plugins.failomiddlewared: resolving plugins schemas                      middlewared: registering services                           middlewared: setting up plugins (datastore) [1/60]          middlewared: setting up plugins (auth) [2/60]               middlewared: setting up plugins (service) [3/60]            middlewared: setting up plugins (pwenc) [4/60]              middlewared: setting up plugins (boot) [5/60]               middlewared: setting up plugins (system) [6/60]             middlewared: setting up plugins (alert) [7/60]              middlewared: setting up plugins (account) [8/60]            middlewared: setting up plugins (network) [9/60]            middlewared: setting up plugins (webdav) [10/60]            middlewared: setting up plugins (activedirectory) [11/60]   middlewared: setting up plugins (pool) [12/60]              middlewared: setting up plugins (smb) [13/60]               middlewared: setting up plugins (etc) [14/60]               middlewared: setting up plugins (usage) [15/60]             middlewared: setting up plugins (zettarepl) [16/60]         middlewared: setting up plugins (filesystem) [17/60]        middlewared: setting up plugins (ipmi) [18/60]              middlewared: setting up plugins (sysdataset) [19/60]        middlewared: setting up plugins (directoryservices) [20/60] middlewared: setting up plugins (afp) [21/60]               middlewared: setting up plugins (iscsi) [22/60]             middlewared: setting up plugins (replication) [23/60]       middlewared: setting up plugins (unscheduled_reboot_alert) [middlewared: setting up plugins (jail_freebsd) [25/60]      middlewared: setting up plugins (trueview) [26/60]          middlewared: setting up plugins (ec2) [27/60]               middlewared: setting up plugins (crypto) [28/60]            middlewared: setting up plugins (disk) [29/60]              middlewared: setting up plugins (vm) [30/60]                middlewared: setting up plugins (cache) [31/60]             middlewared: setting up plugins (rsync) [32/60]             middlewared: setting up plugins (vpn) [33/60]               middlewared: setting up plugins (snapshot) [34/60]          middlewared: setting up plugins (cloud_sync) [35/60]        middlewared: setting up plugins (ups) [36/60]               middlewared: setting up plugins (ftp) [37/60]               middlewared: setting up plugins (nfs) [38/60]               middlewared: setting up plugins (interface.link_address) [39
Mar  8 13:44:11 NASBK <118>middlewared: setting up plugins (device_.devd_events) [40/60middlewared: setting up plugins (mail_.gmail) [41/60]       middlewared: setting up plugins (zfs_.zfs_events) [42/60]   middlewared: setting up plugins (zfs_.events) [43/60]       middlewared: setting up plugins (disk_.hddstandby_force) [44middlewared: setting up plugins (disk_.disk_events) [45/60] middlewared: setting up plugins (disk_.smartctl) [46/60]    middlewared: setting up plugins (disk_.sync) [47/60]        middlewared: setting up plugins (disk_.zfs_guid) [48/60]    middlewared: setting up plugins (enterprise.m_series_nvdimm_middlewared: setting up plugins (sysctl.hint_isp_role_freebsmiddlewared: setting up plugins (kmip) [51/60]              middlewared: setting up plugins (reporting.events) [52/60]  middlewared: setting up plugins (reporting.processes) [53/60middlewared: setting up plugins (truecommand) [54/60]       middlewared: setting up plugins (s3_.attachments) [55/60]   middlewared: setting up plugins (failover) [56/60]          middlewared: setting up plugins (enclosure) [57/60]         middlewared: setting up plugins (failover_.remote) [58/60]  middlewared: setting up plugins (failover_.event) [59/60]   middlewared: setting up plugins (failover_.fenced) [60/60]  middlewared: loading completed                             
Mar  8 13:44:11 NASBK Loading early kernel modules:
Mar  8 13:44:11 NASBK Syncing disks...
Mar  8 13:44:11 NASBK Waiting on devd connection
Mar  8 13:44:11 NASBK Enumerating system disks
Mar  8 13:44:11 NASBK Enumerating geom disk XML information
Mar  8 13:44:11 NASBK Enumerating disk information from database
Mar  8 13:44:11 NASBK Syncing disk 1/3
Mar  8 13:44:11 NASBK Syncing disk 2/3
Mar  8 13:44:11 NASBK Syncing disk 3/3
Mar  8 13:44:11 NASBK Syncing disk 4/3
Mar  8 13:44:11 NASBK Syncing disk 5/3
Mar  8 13:44:11 NASBK Syncing disk 6/3
Mar  8 13:44:11 NASBK Syncing disk 7/3
Mar  8 13:44:11 NASBK Syncing all disks complete!
Mar  8 13:44:11 NASBK Alarm clock
Mar  8 13:44:11 NASBK Starting file system checks:
Mar  8 13:44:11 NASBK Mounting local filesystems:.
Mar  8 13:44:11 NASBK Beginning pools import
Mar  8 13:44:11 NASBK Importing Backup
Mar  8 13:44:11 NASBK Pools import completed
Mar  8 13:44:11 NASBK Updating CPU Microcode...
Mar  8 13:44:11 NASBK Done.
Mar  8 13:44:11 NASBK Setting up harvesting: PURE_RDRAND,[UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
Mar  8 13:44:11 NASBK Feeding entropy: .
Mar  8 13:44:11 NASBK ELF ldconfig path: /lib /usr/lib /usr/lib/compat /usr/local/lib /usr/local/lib/compat/pkg /usr/local/lib/compat /usr/local/lib/compat/pkg /usr/local/lib/e2fsprogs /usr/local/lib/gcc10 /usr/local/lib/perl5/5.32/mach/CORE /usr/local/lib/samba4
Mar  8 13:44:11 NASBK 32-bit compatibility ldconfig path: /usr/local/lib32/compat
 
Last edited:

Samuel Tai

Never underestimate your own stupidity
Moderator
Joined
Apr 24, 2020
Messages
5,399
You may need to manually import your pool. Go to Storage->Pools, and click the blue Add button. Select the existing pool radio button.
 

HarambeLives

Contributor
Joined
Jul 19, 2021
Messages
153
Sadly nothing there listed, and under disks in the UI all the SAS disks are missing
 

Samuel Tai

Never underestimate your own stupidity
Moderator
Joined
Apr 24, 2020
Messages
5,399
Sounds like your HBA may have given up the ghost.
 

HarambeLives

Contributor
Joined
Jul 19, 2021
Messages
153
I'd agree if the BIOS for the card didn't show everything

I just did a fresh install of 13 U3.1, and now they show up. I'll be sticking on 3.1 for a while

1678309231105.png


I'll add updating my firmware to a newer version to the list too!
 
Joined
Oct 22, 2019
Messages
3,641
Seems like the update from U3.1 -> U4 was more than just a small change.

Look at the other thread about the new way the ARC is handled (with ZFS 2.1.9). :confused:
 
Top