None GPU Passthrough

bigjme

Dabbler
Joined
May 16, 2021
Messages
19
Hi All,

Sorry if this has been covered already somewhere. I have had a look through the forums with with virsh now masked i wanted to see if anyone has a more up to date option for getting none gpu devices to show up in the passthrough list

I am currently trialling TureNas Scale 21.04 ALPHA.1 on a spare machine that i am planning to turn into my NAS unit to move away from Moosefs
From the ZFS side all is good but i do plan to run a virtualised pfSense (i am aware its ill advised, I have a physical already setup as a backup) on this host as its a little over powered for just a NAS and therefore wish to pass through a quad NIC i have in the system that truenas can currently see

I've been using KVM on ubuntu with passthrough for years now so i'm aware of the stubbing process and checking IOMMU groups etc.
I found the following in the Developer Notes for the latest alpha for the GPU Passthrough: https://www.truenas.com/docs/scale/devnotes/#gpu-passthrough

Is anyone aware of the variable we need to update to stub a none gpu device? i.e. the replacement for
midclt call system.advanced.update '{"isolated_gpu_pci_ids": ["0000:af:00.0"]}'

I did just to be sure check that would not work on none gpu devices but get an error that the gpu slot is not available or the gpu is not configured so it seems to be comparing against the gpu list generated by
midclt call device.get_gpus | jq .

Again, very sorry if this has been covered already. It may well not be implemented yet but thought it better to ask

Regards,
Jamie
 

sampah

Cadet
Joined
May 29, 2021
Messages
4
A better option would be if TrueNAS scale supported SR-IOV (google it), which basically turns the quad-port NIC you have into 4 "virtual NICs" at the hardware level (i.e., without the traditional overhead of software defined NICs). It is not clear if Scale supports this right now.
 

ornias

Wizard
Joined
Mar 6, 2020
Messages
1,458
A better option would be if TrueNAS scale supported SR-IOV (google it), which basically turns the quad-port NIC you have into 4 "virtual NICs" at the hardware level (i.e., without the traditional overhead of software defined NICs). It is not clear if Scale supports this right now.
Don't hijack threads by other people with different issues to push your own issue please.
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,176
Don't hijack threads by other people with different issues to push your own issue please.
<Moderator hat>
The matter is similar enough for the specific case of a NIC.
</Moderator hat>

For the benefit of those who might end up confused reading the thread, the tl;dr is as follows:
  • Middleware support for GPU passthrough exists (to some extent at least)
  • Support for generic passthrough of PCIe devices that are not GPUs is not clear
  • For devices that can benefit from SR-IOV (such as NICs and GPUs), it would also be nice to know if SR-IOV is supported and how to use it.
 

ornias

Wizard
Joined
Mar 6, 2020
Messages
1,458
  • For devices that can benefit from SR-IOV (such as NICs and GPUs), it would also be nice to know if SR-IOV is supported and how to use it.
Why need to say that it's nice to know?
There is no support for it either in the middleware or GUI. That's quite obvious actually.
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,176
Why need to say that it's nice to know?
There is no support for it either in the middleware or GUI. That's quite obvious actually.
Well, at the risk of getting philosophical, more knowledge is always good.

The good part is the answer is simple, clear, and straightforward.
 
Top