SOLVED ESXi with freenas -> freenas does not list HBA Disk - Changed HBA -> solved

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
Hi all,

I've setup ESXi with a freenas VM.


Within the VM during Setup I do see all the disk attached to the HBA and the NVMe storage I've passed to the VM.

I've installed Freenas on a VMDK at the hardware RAID1 where ESXi is installed.

What I do see within the VM:
-during Setup I do see every drive (be it HBA, VMWARE HDD, NVMe Storage)
-after the Setup I do only see the VMWARE HDD and the NVMe Storage
Code:
root@freenas[~]# camcontrol devlist
<NECVMWar VMware SATA CD00 1.00>   at scbus2 target 0 lun 0 (pass0,cd0)
<VMware Virtual disk 2.0>          at scbus32 target 0 lun 0 (pass1,da0)
root@freenas[~]#

Code:
root@freenas[~]# pciconf -lv
hostb0@pci0:0:0:0:      class=0x060000 card=0x197615ad chip=0x71908086 rev=0x01 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '440BX/ZX/DX - 82443BX/ZX/DX Host bridge'
    class      = bridge
    subclass   = HOST-PCI
pcib1@pci0:0:1:0:       class=0x060400 card=0x00000000 chip=0x71918086 rev=0x01 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '440BX/ZX/DX - 82443BX/ZX/DX AGP bridge'
    class      = bridge
    subclass   = PCI-PCI
isab0@pci0:0:7:0:       class=0x060100 card=0x197615ad chip=0x71108086 rev=0x08 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82371AB/EB/MB PIIX4 ISA'
    class      = bridge
    subclass   = PCI-ISA
atapci0@pci0:0:7:1:     class=0x01018a card=0x197615ad chip=0x71118086 rev=0x01 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82371AB/EB/MB PIIX4 IDE'
    class      = mass storage
    subclass   = ATA
none0@pci0:0:7:3:       class=0x068000 card=0x197615ad chip=0x71138086 rev=0x08 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82371AB/EB/MB PIIX4 ACPI'
    class      = bridge
none1@pci0:0:7:7:       class=0x088000 card=0x074015ad chip=0x074015ad rev=0x10 hdr=0x00
    vendor     = 'VMware'
    device     = 'Virtual Machine Communication Interface'
    class      = base peripheral
vgapci0@pci0:0:15:0:    class=0x030000 card=0x040515ad chip=0x040515ad rev=0x00 hdr=0x00
    vendor     = 'VMware'
    device     = 'SVGA II Adapter'
    class      = display
    subclass   = VGA
pcib2@pci0:0:17:0:      class=0x060401 card=0x079015ad chip=0x079015ad rev=0x02 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI bridge'
    class      = bridge
    subclass   = PCI-PCI
pcib3@pci0:0:21:0:      class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib4@pci0:0:21:1:      class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib5@pci0:0:21:2:      class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib6@pci0:0:21:3:      class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib7@pci0:0:21:4:      class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib8@pci0:0:21:5:      class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib9@pci0:0:21:6:      class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib10@pci0:0:21:7:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib11@pci0:0:22:0:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib12@pci0:0:22:1:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib13@pci0:0:22:2:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib14@pci0:0:22:3:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib15@pci0:0:22:4:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib16@pci0:0:22:5:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib17@pci0:0:22:6:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib18@pci0:0:22:7:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib19@pci0:0:23:0:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib20@pci0:0:23:1:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib21@pci0:0:23:2:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib22@pci0:0:23:3:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib23@pci0:0:23:4:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib24@pci0:0:23:5:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib25@pci0:0:23:6:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib26@pci0:0:23:7:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib27@pci0:0:24:0:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib28@pci0:0:24:1:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib29@pci0:0:24:2:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib30@pci0:0:24:3:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib31@pci0:0:24:4:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib32@pci0:0:24:5:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib33@pci0:0:24:6:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib34@pci0:0:24:7:     class=0x060400 card=0x07a015ad chip=0x07a015ad rev=0x01 hdr=0x01
    vendor     = 'VMware'
    device     = 'PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
uhci0@pci0:2:0:0:       class=0x0c0300 card=0x197615ad chip=0x077415ad rev=0x00 hdr=0x00
    vendor     = 'VMware'
    device     = 'USB1.1 UHCI Controller'
    class      = serial bus
    subclass   = USB
ehci0@pci0:2:1:0:       class=0x0c0320 card=0x077015ad chip=0x077015ad rev=0x00 hdr=0x00
    vendor     = 'VMware'
    device     = 'USB2 EHCI Controller'
    class      = serial bus
    subclass   = USB
ahci0@pci0:2:3:0:       class=0x010601 card=0x07e015ad chip=0x07e015ad rev=0x00 hdr=0x00
    vendor     = 'VMware'
    device     = 'SATA AHCI controller'
    class      = mass storage
    subclass   = SATA
mpt0@pci0:3:0:0:        class=0x010700 card=0x197615ad chip=0x00541000 rev=0x01 hdr=0x00
    vendor     = 'Broadcom / LSI'
    device     = 'SAS1068 PCI-X Fusion-MPT SAS'
    class      = mass storage
    subclass   = SAS
nvme0@pci0:4:0:0:       class=0x010802 card=0x2262126f chip=0x2262126f rev=0x03 hdr=0x00
    vendor     = 'Silicon Motion, Inc.'
    class      = mass storage
    subclass   = NVM
none2@pci0:11:0:0:      class=0x010700 card=0x21c7103c chip=0x3239103c rev=0x01 hdr=0x00
    vendor     = 'Hewlett-Packard Company'
    device     = 'Smart Array Gen9 Controllers'
    class      = mass storage
    subclass   = SAS
nvme1@pci0:12:0:0:      class=0x010802 card=0x2262126f chip=0x2262126f rev=0x03 hdr=0x00
    vendor     = 'Silicon Motion, Inc.'
    class      = mass storage
    subclass   = NVM
nvme2@pci0:19:0:0:      class=0x010802 card=0x2262126f chip=0x2262126f rev=0x03 hdr=0x00
    vendor     = 'Silicon Motion, Inc.'
    class      = mass storage
    subclass   = NVM
vmx0@pci0:20:0:0:       class=0x020000 card=0x07b015ad chip=0x07b015ad rev=0x01 hdr=0x00
    vendor     = 'VMware'
    device     = 'VMXNET3 Ethernet Controller'
    class      = network
    subclass   = ethernet
nvme3@pci0:27:0:0:      class=0x010802 card=0x2262126f chip=0x2262126f rev=0x03 hdr=0x00
    vendor     = 'Silicon Motion, Inc.'
    class      = mass storage
    subclass   = NVM
root@freenas[~]#


as seen from the PCI device list:
Code:
none2@pci0:11:0:0:      class=0x010700 card=0x21c7103c chip=0x3239103c rev=0x01 hdr=0x00
    vendor     = 'Hewlett-Packard Company'
    device     = 'Smart Array Gen9 Controllers'
    class      = mass storage
    subclass   = SAS

The HBA is noticed by freenas...

Hardware I am using:
I've tried now multipe HBA all turned out not to be working - what am I doing wrong?
The HP H240 HBA was pulled from another freenas which worked perfectly.. (with that HBA). But that was a bare metal setup.

Code:
root@freenas[~]# egrep 'da[0-9]|cd[0-9]' /var/run/dmesg.boot
da0 at mpt0 bus 0 scbus32 target 0 lun 0
da0: <VMware Virtual disk 2.0> Fixed Direct Access SPC-4 SCSI device
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 61440MB (125829120 512 byte sectors)
da0: quirks=0x140<RETRY_BUSY,STRICT_UNMAP>
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
cd0: <NECVMWar VMware SATA CD00 1.00> Removable CD-ROM SCSI device
cd0: Serial Number 00000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: 745MB (381663 2048 byte sectors)
Trying to mount root from cd9660:iso9660/FREENAS []...
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
cd0: <NECVMWar VMware SATA CD00 1.00> Removable CD-ROM SCSI device
cd0: Serial Number 00000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
da0 at mpt0 bus 0 scbus32 target 0 lun 0
da0: <VMware Virtual disk 2.0> Fixed Direct Access SPC-4 SCSI device
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 61440MB (125829120 512 byte sectors)
da0: quirks=0x140<RETRY_BUSY,STRICT_UNMAP>
GEOM_ELI: Device da0p3.eli created.
GEOM_ELI: Device da0p3.eli destroyed.
GEOM_ELI: Detached da0p3.eli on last close.
da0 at mpt0 bus 0 scbus32 target 0 lun 0
da0: <VMware Virtual disk 2.0> Fixed Direct Access SPC-4 SCSI device
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 61440MB (125829120 512 byte sectors)
da0: quirks=0x140<RETRY_BUSY,STRICT_UNMAP>
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
cd0: <NECVMWar VMware SATA CD00 1.00> Removable CD-ROM SCSI device
cd0: Serial Number 00000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present


Code:

root@freenas[~]# egrep 'ad[0-9]|cd[0-9]' /var/run/dmesg.boot
acpi_acad0: <AC Adapter> on acpi0
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
cd0: <NECVMWar VMware SATA CD00 1.00> Removable CD-ROM SCSI device
cd0: Serial Number 00000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: 745MB (381663 2048 byte sectors)
Trying to mount root from cd9660:iso9660/FREENAS []...
acpi_acad0: <AC Adapter> on acpi0
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
cd0: <NECVMWar VMware SATA CD00 1.00> Removable CD-ROM SCSI device
cd0: Serial Number 00000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
acpi_acad0: <AC Adapter> on acpi0
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
cd0: <NECVMWar VMware SATA CD00 1.00> Removable CD-ROM SCSI device
cd0: Serial Number 00000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
root@freenas[~]#
root@freenas[~]# egrep 'ad[0-9]|cd[0-9]' /var/run/dmesg.boot
acpi_acad0: <AC Adapter> on acpi0
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
cd0: <NECVMWar VMware SATA CD00 1.00> Removable CD-ROM SCSI device
cd0: Serial Number 00000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: 745MB (381663 2048 byte sectors)
Trying to mount root from cd9660:iso9660/FREENAS []...
acpi_acad0: <AC Adapter> on acpi0
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
cd0: <NECVMWar VMware SATA CD00 1.00> Removable CD-ROM SCSI device
cd0: Serial Number 00000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
acpi_acad0: <AC Adapter> on acpi0
cd0 at ahcich0 bus 0 scbus2 target 0 lun 0
cd0: <NECVMWar VMware SATA CD00 1.00> Removable CD-ROM SCSI device
cd0: Serial Number 00000000000000000001
cd0: 600.000MB/s transfers (SATA 3.x, UDMA2, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present
root@freenas[~]#
 
Last edited:

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
what does kldstat show you? do you see either cciss.ko or smartpqi.ko ?

If not, maybe loading one of those with kldload might at least show some difference.

It's not really 100% clear to me what you've set in terms of passthrough settings on ESXi, so I'm just assuming you've done everything right on that side... which may not be the case.

I think you should read this thread and see if you are comfortable continuing with that HBA:
 

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
smartpqi.ko is listed cciss .ko not - how to load it?

Code:
root@freenas[~]# kldstat
Id Refs Address            Size     Name
1   85 0xffffffff80200000 2567020  kernel
2    1 0xffffffff82769000 100ee8   ispfw.ko
3    1 0xffffffff8286a000 fa60     ipmi.ko
4    2 0xffffffff8287a000 2d70     smbus.ko
5    1 0xffffffff8287d000 32cc8    if_bnxt.ko
6    1 0xffffffff828b0000 2243e8   if_qlxgbe.ko
7    1 0xffffffff82ad5000 f1440    ocs_fc.ko
8    1 0xffffffff82bc7000 22150    smartpqi.ko
9    1 0xffffffff82bea000 8a40     freenas_sysctl.ko
10    1 0xffffffff82e19000 330048   vmm.ko
11    1 0xffffffff8314a000 a84      nmdm.ko
12    1 0xffffffff8314b000 2ec      dtraceall.ko
13    9 0xffffffff8314c000 39a78    dtrace.ko
14    1 0xffffffff83186000 5c0      dtmalloc.ko
15    1 0xffffffff83187000 1898     dtnfscl.ko
16    1 0xffffffff83189000 1d61     fbt.ko
17    1 0xffffffff8318b000 53240    fasttrap.ko
18    1 0xffffffff831df000 bcc      sdt.ko
19    1 0xffffffff831e0000 6af0     systrace.ko
20    1 0xffffffff831e7000 6ac8     systrace_freebsd32.ko
21    1 0xffffffff831ee000 f9c      profile.ko
22    1 0xffffffff831ef000 39f4     geom_multipath.ko
23    1 0xffffffff831f3000 14320    hwpmc.ko
24    1 0xffffffff83208000 7140     t3_tom.ko
25    2 0xffffffff83210000 aa8      toecore.ko
26    1 0xffffffff83211000 f8d0     t4_tom.ko
27    1 0xffffffff83221000 27f8     vmmemctl.ko
28    1 0xffffffff83224000 23e0     vmxnet.ko
29    1 0xffffffff83227000 2eb8     vmblock.ko
30    1 0xffffffff8322a000 1780     uhid.ko
root@freenas[~]#


As I've passed 4 NVMe drives to the VM, which are working fine I assume everything within ESXi is fine.

I would like to stick with the H240.. I have LSI with SAS3008 HBAs but those made other issues. once passed to the VM, freenas was stuck during boot...
 
Last edited:

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
and if you load the driver? kldload cciss.ko
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
maybe you will need to unload smartpqi.ko kldunload smartpqi.ko
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
I have LSI with SAS3008 HBAs but those made other issues. once passed to the VM, freenas was stuck during boot...
Then you're clearly doing something wrong in ESXi... these HBAs will be supported well in FreeNAS.
 

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
Code:
root@freenas[~]# kldload cciss.ko
kldload: can't load cciss.ko: No such file or directory

Idea?
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
maybe the smartpqi.ko is the right one (even though it doesn't seem to work)... seems the cciss.ko reference was for FreeBSD full build (so not included in FreeNAS).

Maybe there are some suggestions here that will help:
 

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
I am running 4 HP H240 in IT mode at two other freenas bare metal units.
I've cross swapped one of those to the ESX. same issue within the VM.
the one from the esx runs without issues on those bare metals freenas
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
I am running 4 HP H240 in IT mode at two other freenas bare metal units.
I've cross swapped one of those to the ESX. same issue within the VM.
the one from the esx runs without issues on those bare metals freenas
I think this points squarely back at the way you are doing the passthrough.

Are you running the vm in bios or uefi mode?
 

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
Bios mode for the vm
I have 5 PCIe devices connected to the vm.
4x NVMe, which work fine
1x HBA
 
Last edited:

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
And in the list under Manage Hardware PCI Devices... do you see it as Active?
 

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
yes
and as said during freenas setup I do see all the drives attached to the HBA.
For fun I've reinstalled freenas with UEFI no change.
Another test I've added the h240 to another VM and installed freenas just for testing on one of the 6tb drives.. that works and I see all the drives at that setup... strange thing..
 

Attachments

  • h240_1.jpg
    h240_1.jpg
    17 KB · Views: 263
  • h240_2.jpg
    h240_2.jpg
    95 KB · Views: 294

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
Found a Supermicro AOC-S2308L-L8i HBA for free. now using this works..
no clue why the H240 is not working, while its working in 2 bare metal builds here..
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
Another test I've added the h240 to another VM and installed freenas just for testing on one of the 6tb drives.. that works and I see all the drives at that setup... strange thing..
So could you re-create the VM from scratch? it seems something peculiar to that VM config then.
 

Herr_Merlin

Patron
Joined
Oct 25, 2019
Messages
200
nope I did not. I removed the PCIe devices and added the other PCIe devices and it worked fine
 
Top