Help me troubleshoot PCI passthrough

Joined
Feb 14, 2022
Messages
1
Hi :smile:

I recently shutdown my ESXi server, since the only VM I had running, was a pfSense firewall.
... However I still need said firewall. And my NAS does have a bunch of NICs. So why not spin up a VM running pfSense on it! Makes perfect sense!

Now here comes my challenge: I want to passthough some NICs to my VM, but doing a prerequisite check to see if I'm even able to passthough my PCI devices I get less than desirable results:
root@truenas[~]# acpidump -t | grep DMAR root@truenas[~]#

According to this video and the freeBSD wiki:

Now, I don't judge you for assuming that I'm a dumb-dumb.
But let me assure you: I have been into my UEFI settings and enabled IOMMU and SVM. But there's still no DMAR table to see.

So I'm hoping someone more adept than me, can help me troubleshoot this issue.

My config:

Mobo: Asus - ROG Strix B550-F GAMING (non-WiFi)
CPU: AMD - Ryzen R5-5600X
OS: TrueNAS Core - 12.0-U7

Stuff I've tried so far.
  • Attempted to see DMAR table, but in Ubuntu.
  • Flashed UEFI firmware to a much older version.
  • Tried fiddling with UEFI settings (loaded defaults, enabled/disabled IOMMU and SVM)
  • Tried issuing a "pciconf -lcv | less" command in shell, but I don't know what I am looking at...
    root@truenas[~]# pciconf -lcv | less
    vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Starship/Matisse Root Complex' class = bridge subclass = HOST-PCI

    vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Starship/Matisse IOMMU' class = base peripheral subclass = IOMMU

    vendor = 'Advanced Micro Devices, Inc. [AMD]' device = 'Starship/Matisse PCIe Dummy Host Bridge' class = bridge subclass = HOST-PCI
 

homer27081990

Patron
Joined
Aug 9, 2022
Messages
321
I have the very same issue.
Setup is:
ProLiant DL380P Gen 8.1 - 4 Port Broadcomm NIC -> TrueNAS BHyve - Passthrough 3 out of 4 ports (3/0/1 3/0/2 3/0/3) -> PfSense
1660075297267.png
1660075336934.png
1660075385462.png
1660075454090.png
1660075400674.png

And in PfSense:
1660075633193.png
1660075704856.png

1660075769603.png

Can someone at least rule out this being a TrueNAS problem?
 

Attachments

  • 1660075416943.png
    1660075416943.png
    8.2 KB · Views: 103

homer27081990

Patron
Joined
Aug 9, 2022
Messages
321
I should also point out that I have a virtual NIC from a TrueNAS bridge with no NICs attached, that is the NIC that is showing up in boot (vtnet0).
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,703
That video resembles @Yorick ... perhaps he can help.
 

homer27081990

Patron
Joined
Aug 9, 2022
Messages
321
That video resembles @Yorick ... perhaps he can help.
Thank you very much for taking the time to comment. I dug a little deeper and I believe I am ready to start a new thread, because although the symptoms are the same, the underlying manifestation of the problem (specific errors and such) seem to be vastly different. Thank you again.
 
Top