Windows VM boot issue: Divide Error exception

BirdBare

Cadet
Joined
Nov 6, 2021
Messages
7
System
  • Motherboard: Asus Prime x570-p
  • CPU: Ryzen 2700x
  • GPU: AMD RX 580 8gb dual OC
  • GPU: Nvidia GeForce 1030
  • RAM: 64GB
  • Truenas Scale version: TrueNAS-SCALE-22.02-RC.1-1
VM setup:
  • Windows10 latest .iso download
  • UEFI
  • CPU-passthrough 1vcpu, 8 core, 2 thread
  • 16GB ram
  • 100gb ZVol
  • VirtIO NIC
  • GPU: AMD RX 580 8gb dual OC
  • VNC Display
I hope I got everything above!
I am trying to get a Windows VM working on Truenas Scale.

I have done the following (if this is wrong please let me know):
  1. Reinstall Scale: did not import config yet as I want a clean system to get the VM figured out.
  2. blacklist amdgpu and radeon
  3. modprobe vendor-reset: to help with amd reset bug
When I try to boot the VM I get this output code from the serial console:

Code:
Connected to domain '1_Windows'
Escape character is ^] (Ctrl + ])
!!!! X64 Exception Type - 00(#DE - Divide Error)  CPU Apic ID - 00000000 !!!!
RIP  - 00000000BE84C2E0, CS  - 0000000000000038, RFLAGS - 0000000000010246
RAX  - 000000000000EA60, RCX - 0000000000000000, RDX - 0000000000000000
RBX  - 0000000000000006, RSP - 00000000BFE265B8, RBP - 00000000BEA32CD4
RSI  - 0000000000000000, RDI - 00000000BEA32D48
R8   - 0000000000000000, R9  - 0000000000000000, R10 - 0000000000000001
R11  - 0000000000000000, R12 - 00000000BEA32C00, R13 - 0000000000000100
R14  - 00000000BEA32B8C, R15 - 0000000000000000
DS   - 0000000000000030, ES  - 0000000000000030, FS  - 0000000000000030
GS   - 0000000000000030, SS  - 0000000000000030
CR0  - 0000000080010033, CR2 - 0000000000000000, CR3 - 00000000BFC01000
CR4  - 0000000000000668, CR8 - 0000000000000000
DR0  - 0000000000000000, DR1 - 0000000000000000, DR2 - 0000000000000000
DR3  - 0000000000000000, DR6 - 00000000FFFF0FF0, DR7 - 0000000000000400
GDTR - 00000000BF9EE698 0000000000000047, LDTR - 0000000000000000
IDTR - 00000000BF4AD018 0000000000000FFF,   TR - 0000000000000000
FXSAVE_STATE - 00000000BFE26210
!!!! Find image based on IP(0xBE84C2E0) (No PDB)  (ImageBase=00000000BE842000, EntryPoint=00000000BE8469E4) !!!!


Now I have found that if I remove the GPU from the VM then it boots normally so something is going on with the GPU (i think). I wanted to try to pass the rom and see if that fixed the issue but I cannot seem to do so.

Has anyone seen this before with a VM? I am at my wits end. I love Truenas and was excited for Scale but this is killing me.

Please let me know if I can provide more context or information.
 

BirdBare

Cadet
Joined
Nov 6, 2021
Messages
7
I should also add:

I have tried to install a Ubuntu VM to test if it is isolated to windows. It is not.

I can successfully boot Ubuntu and do the install, but I have no graphics output. If I power-off and reboot the ubuntu VM a couple times I can reproduce the above exception.

The GPU I am passing is in it's own IOMMU group.
 

BirdBare

Cadet
Joined
Nov 6, 2021
Messages
7
Hello,

I want to ask if there are other logs I can look at to figure out the issue. I tried dmesg but it did not seem helpful. Any KVM logs available?
 
Top