XFX RX5700 XT GPU Passthrough to Windows VM - black screen

zubo100

Dabbler
Joined
Aug 25, 2022
Messages
19
Hi everyone, I recently tried to use a Nvidia GTX 760 to passthrough to a Windows VM, but it was not possible, due to not beeing supported.
Nvidia GTX760 GPU Passthrough to Windows 10 VM (Error Code 43 in Device Manager)

I then bought a 2nd hand AMD Rx 5700 Xt and tried using that... Unfortunately, this also seems to be pretty difficult. My current TrueNAS Scale version:
1665917171372.png

The GPU is isolated in the advanced settings:
1665917209824.png

After the installation of the Windows VM I added the GPU for gpu passthrough.
1665917281833.png

After I restarted the VM the device was marked as a "Microsoft Default Adapter" but was later recognized as the Radeon x5700 and was showing properly in the device manager. After I restarted the VM once again, it does not boot. There are no infos available over VNC also. The screen is simply black. (It freezes while trying to load Windows)
1665917395189.png

Connecting over RemoteDesktop of course also does not work.

I have VT-d, and VT-x enabled in BIOS, the CPU is the Intel i7-8700k.
Here is the list of the lspci -v info for anything AMD related:
Code:
01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch (rev c1) (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 126, IOMMU group 1
        Memory at a2200000 (32-bit, non-prefetchable) [size=16K]
        Bus: primary=01, secondary=02, subordinate=03, sec-latency=0
        I/O behind bridge: 00004000-00004fff [size=4K]
        Memory behind bridge: a2100000-a21fffff [size=1M]
        Prefetchable memory behind bridge: 0000000090000000-00000000a01fffff [size=258M]
        Capabilities: [48] Vendor Specific Information: Len=08 <?>
        Capabilities: [50] Power Management version 3
        Capabilities: [58] Express Upstream Port, MSI 00
        Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
        Capabilities: [150] Advanced Error Reporting
        Capabilities: [270] Secondary PCI Express
        Capabilities: [320] Latency Tolerance Reporting
        Capabilities: [400] Data Link Feature <?>
        Capabilities: [410] Physical Layer 16.0 GT/s <?>
        Capabilities: [440] Lane Margining at the Receiver <?>
        Kernel driver in use: pcieport

02:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch (prog-if 00 [Normal decode])
        Flags: bus master, fast devsel, latency 0, IRQ 127, IOMMU group 1
        Bus: primary=02, secondary=03, subordinate=03, sec-latency=0
        I/O behind bridge: 00004000-00004fff [size=4K]
        Memory behind bridge: a2100000-a21fffff [size=1M]
        Prefetchable memory behind bridge: 0000000090000000-00000000a01fffff [size=258M]
        Capabilities: [50] Power Management version 3
        Capabilities: [58] Express Downstream Port (Slot-), MSI 00
        Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Capabilities: [c0] Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch
        Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
        Capabilities: [150] Advanced Error Reporting
        Capabilities: [270] Secondary PCI Express
        Capabilities: [2a0] Access Control Services
        Capabilities: [400] Data Link Feature <?>
        Capabilities: [410] Physical Layer 16.0 GT/s <?>
        Capabilities: [440] Lane Margining at the Receiver <?>
        Kernel driver in use: pcieport

03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 [Radeon RX 5600 OEM/5600 XT / 5700/5700 XT] (rev c1) (prog-if 00 [VGA controller])
        Subsystem: XFX Pine Group Inc. RX 5700 XT RAW II
        Flags: bus master, fast devsel, latency 0, IRQ 148, IOMMU group 1
        Memory at 90000000 (64-bit, prefetchable) [size=256M]
        Memory at a0000000 (64-bit, prefetchable) [size=2M]
        I/O ports at 4000 [size=256k]
        Memory at a2100000 (32-bit, non-prefetchable) [size=512K]
        Expansion ROM at a2180000 [disabled] [size=128K]
        Capabilities: [48] Vendor Specific Information: Len=08 <?>
        Capabilities: [50] Power Management version 3
        Capabilities: [64] Express Legacy Endpoint, MSI 00
        Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
        Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
        Capabilities: [150] Advanced Error Reporting
        Capabilities: [200] Physical Resizable BAR
        Capabilities: [240] Power Budgeting <?>
        Capabilities: [270] Secondary PCI Express
        Capabilities: [2a0] Access Control Services
        Capabilities: [2b0] Address Translation Service (ATS)
        Capabilities: [2c0] Page Request Interface (PRI)
        Capabilities: [2d0] Process Address Space ID (PASID)
        Capabilities: [320] Latency Tolerance Reporting
        Capabilities: [400] Data Link Feature <?>
        Capabilities: [410] Physical Layer 16.0 GT/s <?>
        Capabilities: [440] Lane Margining at the Receiver <?>
        Kernel driver in use: vfio-pci
        Kernel modules: amdgpu

03:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 HDMI Audio
        Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 HDMI Audio
        Flags: bus master, fast devsel, latency 0, IRQ 17, IOMMU group 1
        Memory at a21a0000 (32-bit, non-prefetchable) [size=16K]
        Capabilities: [48] Vendor Specific Information: Len=08 <?>
        Capabilities: [50] Power Management version 3
        Capabilities: [64] Express Legacy Endpoint, MSI 00
        Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
        Capabilities: [100] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
        Capabilities: [150] Advanced Error Reporting
        Capabilities: [2a0] Access Control Services
        Kernel driver in use: vfio-pci
        Kernel modules: snd_hda_intel


Can anyone give me any advice, or pointers or help me out? Do I need to manually do some changes over shell? I found a few older posts that are mentioning blacklisting the GPU, manually editing GRUB, and others, but I am not sure if they are still relevant for my current version of TrueNAS scale, or not. Also in some threads the discussed procedures required command that do not seem to be supported anymore.

Any help is very much appreciated.
Thanks!
 
Last edited:

janos66

Dabbler
Joined
Feb 18, 2022
Messages
21
the problem is not truenas, your card has the resetbug


there are solutions for your issue
 
Last edited:

zubo100

Dabbler
Joined
Aug 25, 2022
Messages
19
Thanks for the advices. In the meantime I had a chance to buy a Nvidia GTX 1080 for a cheap price (because the HDMI ports were causing flickering). So I did that, since my VM is not connected to a monitor. And it all works well... Thanks anyway!
 
Top