Mal
Cadet
- Joined
- Oct 5, 2021
- Messages
- 5
Hello! Recently I decided to virtualize TrueNAS in ESXi/vSphere: (reason: I was previously using a 4U case with 15 drive bays. Now I have a 4U disk shelf with 24 bays in its place). In the baremetal box I was using a Mellanox ConnectX-2 10gbe card and it performed very well. After virtualizing I noticed that network speed tanked; I maxed out around 2gbps using the VMXNET3 adapter (even with artificial tests with iperf). After a lot of troubleshooting and unsuccessful changes, I just decided to put another ConnectX-2 card in the host and pass it through directly to the VM.
Unfortunately, TrueNAS (12.0 U5) won't even boot with that passthrough card attached. Even the installer hangs and crashes. I get this message before it throws a kernel panic:
I've tried a different PCIe slot, no luck. This is the same card I had in the baremetal machine, and it still works if I throw it back in there.
I'm not sure how to grab the full console output from the kernel panic, if that's possible and would help. All the posts I've found researching this at least got the OS to boot, they were just having trouble actually using the card, but I can't even get that far.
Any tips on where to head next are appreciated. Or if I should just bite the bullet and try a different model card? Thanks!
Hardware:
Supermicro X9DRH-7TF
2x E5-2697v2
256GB RAM
VM specs:
4 cores
32GB RAM (reserved)
16GB boot disk
LSI SAS9207-8e (PCIe passthrough)
Unfortunately, TrueNAS (12.0 U5) won't even boot with that passthrough card attached. Even the installer hangs and crashes. I get this message before it throws a kernel panic:
Code:
mlx4_core0 unable to determine pci device chain minimum bw
I've tried a different PCIe slot, no luck. This is the same card I had in the baremetal machine, and it still works if I throw it back in there.
I'm not sure how to grab the full console output from the kernel panic, if that's possible and would help. All the posts I've found researching this at least got the OS to boot, they were just having trouble actually using the card, but I can't even get that far.
Any tips on where to head next are appreciated. Or if I should just bite the bullet and try a different model card? Thanks!
Hardware:
Supermicro X9DRH-7TF
2x E5-2697v2
256GB RAM
VM specs:
4 cores
32GB RAM (reserved)
16GB boot disk
LSI SAS9207-8e (PCIe passthrough)