Adding PCI Passthrough device no longer working - "Options cannot be loaded"

[darkmatter68]

Hi,

My Plex VM failed to boot because it could not see the Nvidia Tesla P4 GPU.
(sorry, I did not keep the output of the error messages on the screen at the time.)

To get the VM to boot I deleted the "passthrough" device from the VM config.

However, if I try to re-add the GPU as a PCI passthrough device again, I see the 'spinning circle' and the message "Options cannot be loaded".

The Nvidia card is still visible from the onboard BMC of my ASrock ROMED8-2T.

In TrueNAS I can see the GPU in: System Settings -> Advanced, the GPU listed in the "Isolated GPU device(s)" section.

It does not matter if I have the VM powered on or off I am not offered the GPU in the Add Devices section for the VM.

I should see it as: pci_0000_45_00_0

I have updated the Plex VM (running ubuntu) and restarted TrueNAS.


Any ideas?


Thanks in advance,

Andy

TrueNAS: Scale 22.12.3
Mainboard: ASrock ROMED8-2T
CPU: AMD EPYC 7352 (24 core)
Memory 128GB (2 x 64GB)
Disk: 10 x Seagate Exos 18TB
GPU: Nvidia Tesla P4
HBA: Broadcom/LSI 9305-24i

 

[darkmatter68]

Update ...

If I try to 'edit' the VM and add the GPU to the config I see the following message displayed:-

"[EINVAL] attribute.pptdev: '3D controller' based PCI devices are critical for system function and cannot be used for PCI passthrough"

Full error is in the attached screen shot ...

 

[zubo100]

Hi everyone! I have exactly the same problem. Not sure how long my virtual machina was not available, but I noticed it today. My HW Info:
Asrock Z390m-itx/ac with Intel i7-8700K, and 2x 32 GB Crucial memory, and PCI passthrough for my Asus ROG GTX 1080 enabled. (Isolated GPU and Set for passthrough). TrueNAS Scale 22.12.0 (when I noticed the error), currently TrueNAS 22.12.3 (I tried upgrading hoping it may fix the issue.)

The GPU is recognized when using lspci.

GPU is isolated:

But when trying to pass the GPU through to the VM I get the following error:

What I noticed it the the error is not always the same. The error message differs:

[EINVAL] attribute.pptdev: 'VGA compatible controller' based PCI devices are critical for system function and cannot be used for PCI passthrough
[EINVAL] attribute.pptdev: None based PCI devices are critical for system function and cannot be used for PCI passthrough
[EINVAL] attribute.pptdev: 'Audio device' based PCI devices are critical for system function and cannot be used for PCI passthrough

I tried manually adding the PCI device under devices, but I do not know the correct syntax:

However, if I try to re-add the GPU as a PCI passthrough device again, I see the 'spinning circle' and the message "Options cannot be loaded".

The nvidia-smi command failes, stating the there is no driver.

Any help would be very much appreciated. I do not believe that it is a coincidence the we both have the same issue in aprox. 24 hours. Thanks for any advices.

 

[morganL]

This is a known issue in SCALE 22.12.3.... there will be a minor update posted (i think it will be next week).

TrueNAS SCALE Bluefin 22.12.3 is Now Available!

We are pleased to release TrueNAS SCALE 22.12.3! This release includes many new features and improved functionality that span new applications for deprecated services, changes to SMB service, additional tools for troubleshooting, and web UI improvements. Changes include: New applications for...

www.truenas.com

 

[darkmatter68]

Thanks very much Morgan.

Once the update is available I'll test it and post the results here.

 

[darkmatter68]

I can confirm the update: 22.12.3.1 allowed me to re-add the GPU as a passthrough device

root@plex:~# lspci | grep -i nvidia;echo;lsmod | grep -i nvidia 00:07.0 3D controller: NVIDIA Corporation GP104GL [Tesla P4] (rev a1) nvidia_uvm 1216512 2 nvidia_drm 69632 0 nvidia_modeset 1200128 1 nvidia_drm nvidia 35500032 17 nvidia_uvm,nvidia_modeset drm_kms_helper 311296 4 qxl,nvidia_drm drm 622592 7 drm_kms_helper,qxl,nvidia,drm_ttm_helper,nvidia_drm,ttm

Looks OK. Now just need to figure out why Plex is not using HW transcoding (but that is a different issue) :)

 

[zubo100]

Same with me, the GPU can be added for passthrough again. Allthough I had to disable the GPU isolation. (When the card was still set as isolated in the setting it could not be used for GPU passthrough in the virtual machine). After disabling the isolation, I tried to set the GPU passthrough, which worked, and also set the isolation for the GPU.

 

[godfather007]

Just updated to 22.12.4. Unfortunately these are my results:

>lspci
>02:00.0 VGA compatible controller: NVIDIA Corporation GP107GL [Quadro P400] (rev ff)
>02:00.1 Audio device: NVIDIA Corporation GP107GL High Definition Audio Controller (rev ff)

>nvidia-smi
>Failed to initialize NVML: Unknown Error

While passing through the device to a VM it gets gets enumerated as
> 0000:02:00.0: Not Available by 'Not Available'

Playing with the idea to move the card to another (capable) slot as a "might-fix-it" solution...
Perhaps version 23:10 end of this month?