GPU passthrough again

User Support
1

Hello!
I’m trying to hide second GPU but without luck.

  1. Hardware & IOMMU Group:
mint@mint:~$ lspci
00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex
00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD] Starship/Matisse IOMMU
00:01.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:01.2 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge
00:02.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:03.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:03.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse GPP Bridge
00:04.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:05.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:07.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:07.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
00:08.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Host Bridge
00:08.1 PCI bridge: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Internal PCIe GPP Bridge 0 to bus[E:B]
00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD] FCH SMBus Controller (rev 61)
00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD] FCH LPC Bridge (rev 51)
00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 0
00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 1
00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 2
00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 3
00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 4
00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 5
00:18.6 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 6
00:18.7 Host bridge: Advanced Micro Devices, Inc. [AMD] Matisse/Vermeer Data Fabric: Device 18h; Function 7
01:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse Switch Upstream
02:01.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
02:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
02:04.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
02:05.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
02:08.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
02:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
02:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD] Matisse PCIe GPP Bridge
03:00.0 Non-Volatile memory controller: Sandisk Corp WD PC SN810 / Black SN850 NVMe SSD (rev 01)
04:00.0 VGA compatible controller: NVIDIA Corporation GF116 [GeForce GTX 550 Ti] (rev a1)
04:00.1 Audio device: NVIDIA Corporation GF116 High Definition Audio Controller (rev a1)
05:00.0 Network controller: Intel Corporation Wireless-AC 9260 (rev 29)
06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 26)
07:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
07:00.1 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
07:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
08:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
09:00.0 SATA controller: Advanced Micro Devices, Inc. [AMD] FCH SATA Controller [AHCI mode] (rev 51)
0a:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Upstream Port of PCI Express Switch (rev c1)
0b:00.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] Navi 10 XL Downstream Port of PCI Express Switch
0c:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 23 [Radeon RX 6600/6600 XT/6600M] (rev c1)
0c:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21 HDMI Audio [Radeon RX 6800/6800 XT / 6900 XT]
0d:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse PCIe Dummy Function
0e:00.0 Non-Essential Instrumentation [1300]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Reserved SPP
0e:00.1 Encryption controller: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Cryptographic Coprocessor PSPCPP
0e:00.3 USB controller: Advanced Micro Devices, Inc. [AMD] Matisse USB 3.0 Host Controller
0e:00.4 Audio device: Advanced Micro Devices, Inc. [AMD] Starship/Matisse HD Audio Controller
mint@mint:~$ lspci | grep Radeon
0c:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Navi 23 [Radeon RX 6600/6600 XT/6600M] (rev c1)
0c:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Navi 21 HDMI Audio [Radeon RX 6800/6800 XT / 6900 XT]
mint@mint:~$ tree /sys/kernel/iommu_groups/
/sys/kernel/iommu_groups/
├── 0
│   ├── devices
│   │   └── 0000:00:01.0 -> ../../../../devices/pci0000:00/0000:00:01.0
│   ├── reserved_regions
│   └── type
├── 1
│   ├── devices
│   │   └── 0000:00:01.2 -> ../../../../devices/pci0000:00/0000:00:01.2
│   ├── reserved_regions
│   └── type
├── 10
│   ├── devices
│   │   └── 0000:00:08.1 -> ../../../../devices/pci0000:00/0000:00:08.1
│   ├── reserved_regions
│   └── type
├── 11
│   ├── devices
│   │   ├── 0000:00:14.0 -> ../../../../devices/pci0000:00/0000:00:14.0
│   │   └── 0000:00:14.3 -> ../../../../devices/pci0000:00/0000:00:14.3
│   ├── reserved_regions
│   └── type
├── 12
│   ├── devices
│   │   ├── 0000:00:18.0 -> ../../../../devices/pci0000:00/0000:00:18.0
│   │   ├── 0000:00:18.1 -> ../../../../devices/pci0000:00/0000:00:18.1
│   │   ├── 0000:00:18.2 -> ../../../../devices/pci0000:00/0000:00:18.2
│   │   ├── 0000:00:18.3 -> ../../../../devices/pci0000:00/0000:00:18.3
│   │   ├── 0000:00:18.4 -> ../../../../devices/pci0000:00/0000:00:18.4
│   │   ├── 0000:00:18.5 -> ../../../../devices/pci0000:00/0000:00:18.5
│   │   ├── 0000:00:18.6 -> ../../../../devices/pci0000:00/0000:00:18.6
│   │   └── 0000:00:18.7 -> ../../../../devices/pci0000:00/0000:00:18.7
│   ├── reserved_regions
│   └── type
├── 13
│   ├── devices
│   │   └── 0000:01:00.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0
│   ├── reserved_regions
│   └── type
├── 14
│   ├── devices
│   │   └── 0000:02:01.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:01.0
│   ├── reserved_regions
│   └── type
├── 15
│   ├── devices
│   │   └── 0000:02:02.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:02.0
│   ├── reserved_regions
│   └── type
├── 16
│   ├── devices
│   │   └── 0000:02:04.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:04.0
│   ├── reserved_regions
│   └── type
├── 17
│   ├── devices
│   │   └── 0000:02:05.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:05.0
│   ├── reserved_regions
│   └── type
├── 18
│   ├── devices
│   │   ├── 0000:02:08.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:08.0
│   │   ├── 0000:07:00.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:08.0/0000:07:00.0
│   │   ├── 0000:07:00.1 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:08.0/0000:07:00.1
│   │   └── 0000:07:00.3 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:08.0/0000:07:00.3
│   ├── reserved_regions
│   └── type
├── 19
│   ├── devices
│   │   ├── 0000:02:09.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:09.0
│   │   └── 0000:08:00.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:09.0/0000:08:00.0
│   ├── reserved_regions
│   └── type
├── 2
│   ├── devices
│   │   └── 0000:00:02.0 -> ../../../../devices/pci0000:00/0000:00:02.0
│   ├── reserved_regions
│   └── type
├── 20
│   ├── devices
│   │   ├── 0000:02:0a.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:0a.0
│   │   └── 0000:09:00.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:0a.0/0000:09:00.0
│   ├── reserved_regions
│   └── type
├── 21
│   ├── devices
│   │   └── 0000:03:00.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:01.0/0000:03:00.0
│   ├── reserved_regions
│   └── type
├── 22
│   ├── devices
│   │   ├── 0000:04:00.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:02.0/0000:04:00.0
│   │   └── 0000:04:00.1 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:02.0/0000:04:00.1
│   ├── reserved_regions
│   └── type
├── 23
│   ├── devices
│   │   └── 0000:05:00.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:04.0/0000:05:00.0
│   ├── reserved_regions
│   └── type
├── 24
│   ├── devices
│   │   └── 0000:06:00.0 -> ../../../../devices/pci0000:00/0000:00:01.2/0000:01:00.0/0000:02:05.0/0000:06:00.0
│   ├── reserved_regions
│   └── type
├── 25
│   ├── devices
│   │   └── 0000:0a:00.0 -> ../../../../devices/pci0000:00/0000:00:03.1/0000:0a:00.0
│   ├── reserved_regions
│   └── type
├── 26
│   ├── devices
│   │   └── 0000:0b:00.0 -> ../../../../devices/pci0000:00/0000:00:03.1/0000:0a:00.0/0000:0b:00.0
│   ├── reserved_regions
│   └── type
├── 27
│   ├── devices
│   │   └── 0000:0c:00.0 -> ../../../../devices/pci0000:00/0000:00:03.1/0000:0a:00.0/0000:0b:00.0/0000:0c:00.0
│   ├── reserved_regions
│   └── type
├── 28
│   ├── devices
│   │   └── 0000:0c:00.1 -> ../../../../devices/pci0000:00/0000:00:03.1/0000:0a:00.0/0000:0b:00.0/0000:0c:00.1
│   ├── reserved_regions
│   └── type
├── 29
│   ├── devices
│   │   └── 0000:0d:00.0 -> ../../../../devices/pci0000:00/0000:00:07.1/0000:0d:00.0
│   ├── reserved_regions
│   └── type
├── 3
│   ├── devices
│   │   └── 0000:00:03.0 -> ../../../../devices/pci0000:00/0000:00:03.0
│   ├── reserved_regions
│   └── type
├── 30
│   ├── devices
│   │   └── 0000:0e:00.0 -> ../../../../devices/pci0000:00/0000:00:08.1/0000:0e:00.0
│   ├── reserved_regions
│   └── type
├── 31
│   ├── devices
│   │   └── 0000:0e:00.1 -> ../../../../devices/pci0000:00/0000:00:08.1/0000:0e:00.1
│   ├── reserved_regions
│   └── type
├── 32
│   ├── devices
│   │   └── 0000:0e:00.3 -> ../../../../devices/pci0000:00/0000:00:08.1/0000:0e:00.3
│   ├── reserved_regions
│   └── type
├── 33
│   ├── devices
│   │   └── 0000:0e:00.4 -> ../../../../devices/pci0000:00/0000:00:08.1/0000:0e:00.4
│   ├── reserved_regions
│   └── type
├── 4
│   ├── devices
│   │   └── 0000:00:03.1 -> ../../../../devices/pci0000:00/0000:00:03.1
│   ├── reserved_regions
│   └── type
├── 5
│   ├── devices
│   │   └── 0000:00:04.0 -> ../../../../devices/pci0000:00/0000:00:04.0
│   ├── reserved_regions
│   └── type
├── 6
│   ├── devices
│   │   └── 0000:00:05.0 -> ../../../../devices/pci0000:00/0000:00:05.0
│   ├── reserved_regions
│   └── type
├── 7
│   ├── devices
│   │   └── 0000:00:07.0 -> ../../../../devices/pci0000:00/0000:00:07.0
│   ├── reserved_regions
│   └── type
├── 8
│   ├── devices
│   │   └── 0000:00:07.1 -> ../../../../devices/pci0000:00/0000:00:07.1
│   ├── reserved_regions
│   └── type
└── 9
    ├── devices
    │   └── 0000:00:08.0 -> ../../../../devices/pci0000:00/0000:00:08.0
    ├── reserved_regions
    └── type
  1. How I tried to hide PCI device:
rd.qubes.hide_pci=0c:00.0,0c:00.1 xen-pciback.hide=(0c:00.0)(0c:00.1) xen-pciback.passthrough=1 xen-pciback.permissive
  1. Result:
[OK] Started Command Scheduler.
     Starting Light Display Manger...
     Starting Hold until boot process finishes up...

It’s same situation like the one described in this thread: Boot hold after hiding AMD GPU,
but due to nature of hardware-related problems I decided to create new one.
I’m also not sure how to debug system in way that was mentioned there.

1 Like
2

Only need rd.qubes.hide_pci=0c:00.0,0c:00.1. I already had the issue you mention in “3”, it was because I was trying to use same GPU I hide as the primary gpu. Check your cables and bios to be sure it cannot be the case.