I am trying to set up gpu passthrough on qubes running on my framework 16. I followed the guide here: Create a Gaming HVM. I am pretty sure that my gpu is dom0:03_00.0 and have hidden it in the grub config as instructed in the forum post. I am able to attach it it a vm without any issues or errors however when I start the vm, it throws this error:
Start failed: internal error: Unable to reset PCI device 0000:03:00.0: internal error: Active 0000:03:00.1 devices on bus with 0000:03:00.0, not doing bus reset, see /var/log/libvirt/libxl/libxl-driver.log for details
This is the contents of /var/log/libvirt/libxl/libxl-driver.log
2024-06-25 22:31:05.142+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 12:unable to remove device with path /local/domain/10/backend/vbd/12/51760
2024-06-25 22:31:05.171+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 12:libxl__devices_destroy failed
2024-06-26 00:45:46.119+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 16:unable to remove device with path /local/domain/10/backend/vbd/16/51760
2024-06-26 00:45:46.160+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 16:libxl__devices_destroy failed
2024-06-26 00:51:31.037+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 21:unable to remove device with path /local/domain/10/backend/vbd/21/51760
2024-06-26 00:51:31.080+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 21:libxl__devices_destroy failed
2024-06-26 01:06:27.890+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 25:unable to remove device with path /local/domain/10/backend/vbd/25/51760
2024-06-26 01:06:27.932+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 25:libxl__devices_destroy failed
2024-06-26 02:59:27.312+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 10:unable to remove device with path /local/domain/7/backend/vbd/10/51760
2024-06-26 02:59:27.387+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 10:libxl__devices_destroy failed
2024-06-26 17:02:21.022+0000: libxl: libxl_domain.c:889:pvcontrol_cb: guest didn’t acknowledge control request: -9
2024-06-26 17:03:29.064+0000: libxl: libxl_domain.c:889:pvcontrol_cb: guest didn’t acknowledge control request: -9
2024-06-26 17:33:05.293+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 11:unable to remove device with path /local/domain/9/backend/vbd/11/51760
2024-06-26 17:33:05.351+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 11:libxl__devices_destroy failed
2024-06-27 02:52:45.890+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 13:unable to remove device with path /local/domain/11/backend/vbd/13/51760
2024-06-27 02:52:45.919+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 13:libxl__devices_destroy failed
2024-06-27 02:59:41.203+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 17:unable to remove device with path /local/domain/11/backend/vbd/17/51760
2024-06-27 02:59:41.232+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 17:libxl__devices_destroy failed
2024-06-27 15:00:11.578+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 15:unable to remove device with path /local/domain/9/backend/vbd/15/51760
2024-06-27 15:00:11.609+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 15:libxl__devices_destroy failed
2024-06-27 15:01:34.513+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 17:unable to remove device with path /local/domain/9/backend/vbd/17/51760
2024-06-27 15:01:34.585+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 17:libxl__devices_destroy failed
2024-06-30 17:56:03.503+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 16:unable to remove device with path /local/domain/9/backend/vbd/16/51760
2024-06-30 17:56:03.569+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 16:libxl__devices_destroy failed
2024-06-30 18:19:32.008+0000: libxl: libxl_domain.c:889:pvcontrol_cb: guest didn’t acknowledge control request: -9
2024-07-01 23:22:57.552+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 9:unable to remove device with path /local/domain/7/backend/vbd/9/51760
2024-07-01 23:22:57.586+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 9:libxl__devices_destroy failed
2024-07-01 23:37:26.684+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 9:unable to remove device with path /local/domain/7/backend/vbd/9/51760
2024-07-01 23:37:26.752+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 9:libxl__devices_destroy failed
2024-07-01 23:59:10.371+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 13:unable to remove device with path /local/domain/7/backend/vbd/13/51760
2024-07-01 23:59:10.419+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 13:libxl__devices_destroy failed
2024-07-02 00:06:52.615+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 15:unable to remove device with path /local/domain/7/backend/vbd/15/51760
2024-07-02 00:06:52.673+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 15:libxl__devices_destroy failed
2024-07-02 00:26:55.486+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 31:unable to remove device with path /local/domain/7/backend/vbd/31/51760
2024-07-02 00:26:55.537+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 31:libxl__devices_destroy failed
2024-07-02 00:40:23.146+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 40:unable to remove device with path /local/domain/7/backend/vbd/40/51760
2024-07-02 00:40:23.201+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 40:libxl__devices_destroy failed
2024-07-02 00:43:19.217+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 42:unable to remove device with path /local/domain/7/backend/vbd/42/51760
2024-07-02 00:43:19.282+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 42:libxl__devices_destroy failed
2024-07-02 14:57:33.426+0000: libxl: libxl_domain.c:889:pvcontrol_cb: guest didn’t acknowledge control request: -9
2024-07-02 23:11:47.523+0000: libxl: libxl_domain.c:889:pvcontrol_cb: guest didn’t acknowledge control request: -9
2024-07-02 23:12:59.795+0000: libxl: libxl_domain.c:889:pvcontrol_cb: guest didn’t acknowledge control request: -9
2024-07-02 23:13:59.970+0000: libxl: libxl_domain.c:889:pvcontrol_cb: guest didn’t acknowledge control request: -9
2024-07-02 23:15:10.339+0000: libxl: libxl_domain.c:889:pvcontrol_cb: guest didn’t acknowledge control request: -9
2024-07-04 15:34:02.168+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 15:unable to remove device with path /local/domain/9/backend/vbd/15/51760
2024-07-04 15:34:02.227+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 15:libxl__devices_destroy failed
2024-07-08 19:29:27.670+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 9:unable to remove device with path /local/domain/7/backend/vbd/9/51760
2024-07-08 19:29:27.720+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 9:libxl__devices_destroy failed
2024-07-08 19:36:39.124+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 11:unable to remove device with path /local/domain/7/backend/vbd/11/51760
2024-07-08 19:36:39.151+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 11:libxl__devices_destroy failed
2024-07-08 19:59:33.617+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 13:unable to remove device with path /local/domain/7/backend/vbd/13/51760
2024-07-08 19:59:33.653+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 13:libxl__devices_destroy failed
2024-07-08 16:05:26.967+0000: libxl: libxl_device.c:1200:device_backend_callback: Domain 15:unable to remove device with path /local/domain/7/backend/vbd/15/51760
2024-07-08 16:05:26.996+0000: libxl: libxl_domain.c:1589:devices_destroy_cb: Domain 15:libxl__devices_destroy failed
I think that the issue is that the gpu is not being properly hidden from dom0, but i am not sure. If anyone has seen something similar or has an idea how to fix it, that would be great. Thanks