Nvidia Quadro K620 not Resetting After VM Powered DOwn

paulrbeers

Cadet
Joined
Jun 29, 2022
Messages
1
System:
AMD Threadripper 2970WX
96GB of RAM
Mellanox Connectx3 10GB Network Card
Two VDevs:
5 x 3TB SATA Hard Drives in ZRAID1
2 x 500TB SATA SSD's in Mirror RAID
500GB SATA SSD for OS Drive
Truenas Scale 22.02.1
GPU's: Nvidia GT 710, and Nvidia Quadro K620

I have the Quadro K620 set to be an isolated GPU in the settings. I have validated that virtualization is properly turned on in my bios. I have the Quadro K620 set as a device passthru into the Vm. I can start the VM automatically with a reboot/startup of my Truenas box, but if I stop the VM and try to restart I get a 127 error from the PCIE device that is my passed thru Quadro K620. I know that any AMD gpu prior to the 6000 series had a reset bug that could cause the 127 error, but I've never seen it with an Nvidia device. Am I doing something wrong? I can't get the VM to start without throwing the 127 error without me restarting the whole server.

Any help would be greatly appreciated.

Background, I've used Unraid for years, but with Truenas Scale, I'm thinking about switching to Truenas and have this setup on my test server to make sure it fits my needs before converting my main servers.
 
Top