Cannot boot to native fedora-37-minimal kernel

enmus · January 2, 2023, 12:43am

I am struggling to boot to native kernel in fedora-37-minimal and I have no previous experience in doing this on any distro template. The goal is related to this.

I have followed this, this and this, regardless of inaccuracy in the latter regarding package names related to fedora, and I’ve installed kernel, -devel and -headers packages.

$ rpm -qa kernel
kernel-6.0.15-300.fc37.x86_64

I have tried this:

PVH virt_mode with grub2-xen-pvh kernel pref.
PV virt_mode with grub2-xen
HVM virt_mode with “provided by qube”

In all cases I’m getting “cannot connect to qrexec agent for 240 seconds…” error.

Here’s the error log for all three cases, from /var/lib/xen/console/fedora-37-minimal.log

Summary

[2023-01-01 18:16:13] [ 1410.176119] audit: type=1101 audit(1672614973.610:285): pid=1240 uid=1000 auid=4294967295 ses=4294967295 msg=‘op=PAM:accounting grantors=pam_unix,pam_localuser acct=“user” exe=“/usr/bin/sudo” hostname=? addr=? terminal=/dev/pts/0 res=success’
[2023-01-01 18:16:13] [ 1410.176498] audit: type=1123 audit(1672614973.610:286): pid=1240 uid=1000 auid=4294967295 ses=4294967295 msg=‘cwd=“/home/user” cmd=646E6620636C65616E20616C6C exe=“/usr/bin/sudo” terminal=pts/0 res=success’
[2023-01-01 18:16:13] [ 1410.177117] audit: type=1110 audit(1672614973.611:287): pid=1240 uid=1000 auid=4294967295 ses=4294967295 msg=‘op=PAM:setcred grantors=pam_env,pam_localuser,pam_unix acct=“root” exe=“/usr/bin/sudo” hostname=? addr=? terminal=/dev/pts/0 res=success’
[2023-01-01 18:16:13] [ 1410.181960] audit: type=1105 audit(1672614973.615:288): pid=1240 uid=1000 auid=4294967295 ses=4294967295 msg=‘op=PAM:session_open grantors=pam_keyinit,pam_limits,pam_keyinit,pam_limits,pam_systemd,pam_unix acct=“root” exe=“/usr/bin/sudo” hostname=? addr=? terminal=/dev/pts/0 res=success’
[2023-01-01 18:16:14] [ 1410.779194] audit: type=1106 audit(1672614974.213:289): pid=1240 uid=1000 auid=4294967295 ses=4294967295 msg=‘op=PAM:session_close grantors=pam_keyinit,pam_limits,pam_keyinit,pam_limits,pam_systemd,pam_unix acct=“root” exe=“/usr/bin/sudo” hostname=? addr=? terminal=/dev/pts/0 res=success’
[2023-01-01 18:16:14] [ 1410.780268] audit: type=1104 audit(1672614974.214:290): pid=1240 uid=1000 auid=4294967295 ses=4294967295 msg=‘op=PAM:setcred grantors=pam_env,pam_localuser,pam_unix acct=“root” exe=“/usr/bin/sudo” hostname=? addr=? terminal=/dev/pts/0 res=success’
[2023-01-01 18:16:36] Stopping .[0;1;39msession-c1.scope.[0m - Session c1 of User user…
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Removed slice .[0;1;39msystem-modpr…lice.[0m - Slice /system/modprobe.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Removed slice .[0;1;39msystem-qubes…tem/qubes-updates-proxy-forwarder.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped target .[0;1;39mmulti-user.target.[0m - Multi-User System.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped target .[0;1;39mgetty.target.[0m - Login Prompts.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped target .[0;1;39mnss-lookup.…m - Host and Network Name Lookups.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped target .[0;1;39mtimers.target.[0m - Timer Units.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mfstrim.timer.[0m - Discard unused blocks once a week.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mlogrotate.timer.[0m - Daily rotation of log files.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mplocate-updatedb.t…Update the plocate database daily.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mqubes-sync-time.ti….[0m - Update system time each 6h.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mqubes-update-check… - Periodically check for updates.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mraid-check.timer.[… - Weekly RAID setup health check.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-tmpfiles-c… Cleanup of Temporary Directories.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39munbound-anchor.tim… the root trust anchor for DNSSEC.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped target .[0;1;39mtime-set.target.[0m - System Time Set.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Closed .[0;1;39msystemd-coredump.so…et.[0m - Process Core Dump Socket.
[2023-01-01 18:16:36] Stopping .[0;1;39mdracut-shutdown.s…tore /run/initramfs on shutdown…
[2023-01-01 18:16:36] Stopping .[0;1;39mgetty@tty1.service.[0m - Getty on tty1…
[2023-01-01 18:16:36] Stopping .[0;1;39mpolkit.service.[0m - Authorization Manager…
[2023-01-01 18:16:36] Stopping .[0;1;39mqubes-gui-agent.service.[0m - Qubes GUI Agent…
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mqubes-iptables.ser…0m - Qubes base firewall settings.
[2023-01-01 18:16:36] [ 1432.705025] audit: type=1131 audit(1672614996.135:291): pid=1 uid=0 auid=4294967295 ses=4294967295 msg=‘unit=qubes-iptables comm=“systemd” exe=“/usr/lib/systemd/systemd” hostname=? addr=? terminal=? res=success’
[2023-01-01 18:16:36] Stopping .[0;1;39mqubes-misc-post.s… - Qubes misc post-boot actions…
[2023-01-01 18:16:36] Stopping .[0;1;39mqubes-qrexec-agen…e.[0m - Qubes remote exec agent…
[2023-01-01 18:16:36] Stopping .[0;1;39mserial-getty@hvc0…vice.[0m - Serial Getty on hvc0…
[2023-01-01 18:16:36] Stopping .[0;1;39msystemd-oomd.serv…pace Out-Of-Memory (OOM) Killer…
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mqubes-qrexec-agent…ice.[0m - Qubes remote exec agent.
[2023-01-01 18:16:36] [ 1432.744482] audit: type=1131 audit(1672614996.178:292): pid=1 uid=0 auid=4294967295 ses=4294967295 msg=‘unit=qubes-qrexec-agent comm=“systemd” exe=“/usr/lib/systemd/systemd” hostname=? addr=? terminal=? res=success’
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mdracut-shutdown.se…estore /run/initramfs on shutdown.
[2023-01-01 18:16:36] [ 1432.748749] audit: type=1131 audit(1672614996.182:293): pid=1 uid=0 auid=4294967295 ses=4294967295 msg=‘unit=dracut-shutdown comm=“systemd” exe=“/usr/lib/systemd/systemd” hostname=? addr=? terminal=? res=success’
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mqubes-misc-post.se…0m - Qubes misc post-boot actions.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-oomd.servi…rspace Out-Of-Memory (OOM) Killer.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mserial-getty@hvc0.service.[0m - Serial Getty on hvc0.
[2023-01-01 18:16:36] [ 1432.762846] audit: type=1131 audit(1672614996.189:294): pid=1 uid=0 auid=4294967295 ses=4294967295 msg=‘unit=qubes-misc-post comm=“systemd” exe=“/usr/lib/systemd/systemd” hostname=? addr=? terminal=? res=success’
[2023-01-01 18:16:36] [ 1432.762906] audit: type=1131 audit(1672614996.192:295): pid=1 uid=0 auid=4294967295 ses=4294967295 msg=‘unit=systemd-oomd comm=“systemd” exe=“/usr/lib/systemd/systemd” hostname=? addr=? terminal=? res=success’
[2023-01-01 18:16:36] [ 1432.767646] audit: type=1131 audit(1672614996.199:296): pid=1 uid=0 auid=4294967295 ses=4294967295 msg=‘unit=serial-getty@hvc0 comm=“systemd” exe=“/usr/lib/systemd/systemd” hostname=? addr=? terminal=? res=success’
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mgetty@tty1.service.[0m - Getty on tty1.
[2023-01-01 18:16:36] [ 1432.770381] audit: type=1131 audit(1672614996.202:297): pid=1 uid=0 auid=4294967295 ses=4294967295 msg=‘unit=getty@tty1 comm=“systemd” exe=“/usr/lib/systemd/systemd” hostname=? addr=? terminal=? res=success’
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Removed slice .[0;1;39msystem-getty.slice.[0m - Slice /system/getty.
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Removed slice .[0;1;39msystem-seria….[0m - Slice /system/serial-getty.
[2023-01-01 18:16:36] Stopping .[0;1;39mxendriverdomain.s…Xen driver domain device daemon…
[2023-01-01 18:16:36] [ 1432.787070] audit: type=1334 audit(1672614996.217:298): prog-id=0 op=UNLOAD
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mxendriverdomain.se…- Xen driver domain device daemon.
[2023-01-01 18:16:36] [ 1432.791129] audit: type=1131 audit(1672614996.223:299): pid=1 uid=0 auid=4294967295 ses=4294967295 msg=‘unit=xendriverdomain comm=“systemd” exe=“/usr/lib/systemd/systemd” hostname=? addr=? terminal=? res=success’
[2023-01-01 18:16:36] [.[0;32m OK .[0m] Stopped .[0;1;39mpolkit.service.[0m - Authorization Manager.
[2023-01-01 18:16:36] [ 1432.793125] audit: type=1131 audit(1672614996.225:300): pid=1 uid=0 auid=4294967295 ses=4294967295 msg=‘unit=polkit comm=“systemd” exe=“/usr/lib/systemd/systemd” hostname=? addr=? terminal=? res=success’
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msession-c1.scope.[0m - Session c1 of User user.
[2023-01-01 18:16:37] Stopping .[0;1;39msystemd-logind.se…ice.[0m - User Login Management…
[2023-01-01 18:16:37] Stopping .[0;1;39muser@1000.service.[0m - User Manager for UID 1000…
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39mqubes-gui-agent.service.[0m - Qubes GUI Agent.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-logind.service.[0m - User Login Management.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39muser@1000.service.[0m - User Manager for UID 1000.
[2023-01-01 18:16:37] Stopping .[0;1;39muser-runtime-dir@…untime Directory /run/user/1000…
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Unmounted .[0;1;39mrun-user-1000.mount.[0m - /run/user/1000.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39muser-runtime-dir@1… Runtime Directory /run/user/1000.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Removed slice .[0;1;39muser-1000.slice.[0m - User Slice of UID 1000.
[2023-01-01 18:16:37] Stopping .[0;1;39msystemd-user-sess…vice.[0m - Permit User Sessions…
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-user-sessi…ervice.[0m - Permit User Sessions.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mnetwork.target.[0m - Network.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mnetwork-pre…get.[0m - Preparation for Network.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mremote-fs.target.[0m - Remote File Systems.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39mqubes-network-upli…e.[0m - Qubes network uplink wait.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mbasic.target.[0m - Basic System.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mpaths.target.[0m - Path Units.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mslices.target.[0m - Slice Units.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Removed slice .[0;1;39muser.slice.[0m - User and Session Slice.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39msockets.target.[0m - Socket Units.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Closed .[0;1;39mpcscd.socket.[0m - …art Card Daemon Activation Socket.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Closed .[0;1;39mqubes-updates-proxy…n to updates proxy over Qubes RPC.
[2023-01-01 18:16:37] Stopping .[0;1;39mdbus-broker.servi….[0m - D-Bus System Message Bus…
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-network-ge…rk units from Kernel command line.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39mdbus-broker.service.[0m - D-Bus System Message Bus.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Closed .[0;1;39mdbus.socket.[0m - D-Bus System Message Bus Socket.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39msysinit.target.[0m - System Initialization.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Unset automount .[0;1;39mproc-sys-f…rmats File System Automount Point.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mcryptsetup.…get.[0m - Local Encrypted Volumes.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-ask-passwo…quests to Console Directory Watch.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-ask-passwo… Requests to Wall Directory Watch.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mintegrityse…Local Integrity Protected Volumes.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mveritysetup… - Local Verity Protected Volumes.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-boot-updat…0m - Automatic Boot Loader Update.
[2023-01-01 18:16:37] Stopping .[0;1;39msystemd-random-se…ice.[0m - Load/Save Random Seed…
[2023-01-01 18:16:37] Stopping .[0;1;39msystemd-resolved.…e.[0m - Network Name Resolution…
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-sysctl.service.[0m - Apply Kernel Variables.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-modules-lo…service.[0m - Load Kernel Modules.
[2023-01-01 18:16:37] Stopping .[0;1;39msystemd-update-ut…rd System Boot/Shutdown in UTMP…
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-resolved.s…ice.[0m - Network Name Resolution.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-update-utm…cord System Boot/Shutdown in UTMP.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-tmpfiles-s…te Volatile Files and Directories.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mlocal-fs.target.[0m - Local File Systems.
[2023-01-01 18:16:37] Unmounting .[0;1;39mhome.mount.[0m - /home…
[2023-01-01 18:16:37] Unmounting .[0;1;39mtmp.mount.[0m - Temporary Directory /tmp…
[2023-01-01 18:16:37] Unmounting .[0;1;39musr-lib-modules.mount.[0m - /usr/lib/modules…
[2023-01-01 18:16:37] Unmounting .[0;1;39musr-local.mount.[0m - /usr/local…
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-random-see…rvice.[0m - Load/Save Random Seed.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Unmounted .[0;1;39mhome.mount.[0m - /home.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Unmounted .[0;1;39mtmp.mount.[0m - Temporary Directory /tmp.
[2023-01-01 18:16:37] [.[0;1;31mFAILED.[0m] Failed unmounting .[0;1;39musr-lib-…ules.mount.[0m - /usr/lib/modules.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Unmounted .[0;1;39musr-local.mount.[0m - /usr/local.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mswap.target.[0m - Swaps.
[2023-01-01 18:16:37] Deactivating swap .[0;1;39mdev-disk…ev/disk/by-partuuid/7408cc88-01…
[2023-01-01 18:16:37] Deactivating swap .[0;1;39mdev-zram…- Compressed Swap on /dev/zram0…
[2023-01-01 18:16:37] Unmounting .[0;1;39mrw.mount.[0m - /rw…
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Deactivated swap .[0;1;39mdev-disk-…/dev/disk/by-partuuid/7408cc88-01.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Deactivated swap .[0;1;39mdev-disk-…9d427-65cd-4dc7-a1f8-a24f9b91c375.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Deactivated swap .[0;1;39mdev-zram0…m - Compressed Swap on /dev/zram0.
[2023-01-01 18:16:37] Stopping .[0;1;39msystemd-zram-setu…[0m - Create swap on /dev/zram0…
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Deactivated swap .[0;1;39mdev-xvdc1.swap.[0m - /dev/xvdc1.
[2023-01-01 18:16:37] [ 1434.025930] zram0: detected capacity change from 4036608 to 0
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-zram-setup…e.[0m - Create swap on /dev/zram0.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Removed slice .[0;1;39msystem-syste… Slice /system/systemd-zram-setup.
[2023-01-01 18:16:37] [ 1434.038413] EXT4-fs (xvdb): unmounting filesystem.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Unmounted .[0;1;39mrw.mount.[0m - /rw.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped target .[0;1;39mlocal-fs-pr…reparation for Local File Systems.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Reached target .[0;1;39mumount.target.[0m - Unmount All Filesystems.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-remount-fs…ount Root and Kernel File Systems.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-fsck-root.… File System Check on Root Device.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Stopped .[0;1;39msystemd-tmpfiles-s…reate Static Device Nodes in /dev.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Reached target .[0;1;39mshutdown.target.[0m - System Shutdown.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Reached target .[0;1;39mfinal.target.[0m - Late Shutdown Services.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Finished .[0;1;39msystemd-poweroff.service.[0m - System Power Off.
[2023-01-01 18:16:37] [.[0;32m OK .[0m] Reached target .[0;1;39mpoweroff.target.[0m - System Power Off.
[2023-01-01 18:16:37] [ 1434.154628] systemd-shutdown[1]: Syncing filesystems and block devices.
[2023-01-01 18:16:38] [ 1434.369814] systemd-shutdown[1]: Sending SIGTERM to remaining processes…
[2023-01-01 18:16:38] [ 1434.377238] systemd-journald[276]: Received SIGTERM from PID 1 (systemd-shutdow).
[2023-01-01 18:16:38] [ 1434.427483] systemd-shutdown[1]: Sending SIGKILL to remaining processes…
[2023-01-01 18:16:38] [ 1434.429447] systemd-shutdown[1]: Unmounting file systems.
[2023-01-01 18:16:38] [ 1434.430203] [1285]: Remounting ‘/usr/lib/modules’ read-only with options ‘lowerdir=/tmp/modules,upperdir=/sysroot/lib/modules,workdir=/sysroot/lib/.modules_work’.
[2023-01-01 18:16:38] [ 1434.453314] [1286]: Unmounting ‘/usr/lib/modules’.
[2023-01-01 18:16:38] [ 1434.463304] EXT4-fs (xvdd): unmounting filesystem.
[2023-01-01 18:16:38] [ 1434.474592] [1287]: Remounting ‘/’ read-only with options ‘discard’.
[2023-01-01 18:16:38] [ 1434.490545] EXT4-fs (xvda3): re-mounted. Quota mode: none.
[2023-01-01 18:16:38] [ 1434.502964] systemd-shutdown[1]: All filesystems unmounted.
[2023-01-01 18:16:38] [ 1434.502991] systemd-shutdown[1]: Deactivating swaps.
[2023-01-01 18:16:38] [ 1434.503029] systemd-shutdown[1]: All swaps deactivated.
[2023-01-01 18:16:38] [ 1434.503048] systemd-shutdown[1]: Detaching loop devices.
[2023-01-01 18:16:38] [ 1434.503166] systemd-shutdown[1]: All loop devices detached.
[2023-01-01 18:16:38] [ 1434.503185] systemd-shutdown[1]: Stopping MD devices.
[2023-01-01 18:16:38] [ 1434.503248] systemd-shutdown[1]: All MD devices stopped.
[2023-01-01 18:16:38] [ 1434.503267] systemd-shutdown[1]: Detaching DM devices.
[2023-01-01 18:16:38] [ 1434.503326] systemd-shutdown[1]: All DM devices detached.
[2023-01-01 18:16:38] [ 1434.503345] systemd-shutdown[1]: All filesystems, swaps, loop devices, MD devices and DM devices detached.
[2023-01-01 18:16:38] [ 1434.560085] systemd-shutdown[1]: Syncing filesystems and block devices.
[2023-01-01 18:16:38] [ 1434.560988] systemd-shutdown[1]: Powering off.
[2023-01-01 18:16:38] [ 1434.650246] reboot: System halted
[2023-01-01 18:18:34] Logfile Opened
[2023-01-01 18:18:36] .[30m.[47mWelcome to GRUB!
[2023-01-01 18:18:36]
[2023-01-01 18:18:36] .[37m.[40m.[37m.[40m.[37m.[40m.[3;37H [ grub-xen.cfg 424B 100% 2.60B/s ].[3;1Herror: no such device: /boot/xen/pvboot-x86_64.elf.
[2023-01-01 18:18:37] error: no such device: /boot/grub/grub.cfg.
[2023-01-01 18:18:37] Reading (xen/xvda,gpt3/boot/grub2/grub.cfg
[2023-01-01 18:18:37] .[H.[J.[1;1H.[1;37H [ grubenv 1.00KiB 100% 347.35B/s ].[1;1Herror: file /boot/grub/fonts/unicode.pf2' not found. [2023-01-01 18:18:37] error: no suitable video mode found. [2023-01-01 18:18:37] error: file /boot/grub/x86_64-xen/increment.mod’ not found.
[2023-01-01 18:18:37] error: file /boot/grub/x86_64-xen/blscfg.mod' not found. [2023-01-01 18:18:37] error: can't find command blscfg’.
[2023-01-01 18:18:37] error: file /boot/grub/grubenv' not found. [2023-01-01 18:18:37] .[7;36H [ grub.cfg 9.76KiB 100% 3.30KiB/s ].[7;1H.[H.[J.[1;1H Booting Fedora, with Xen hypervisor’
[2023-01-01 18:18:37]
[2023-01-01 18:18:37] Loading Xen 4.16.3 …
[2023-01-01 18:18:37] error: file /boot/grub/x86_64-xen/multiboot2.mod' not found. [2023-01-01 18:18:37] error: can't find command multiboot2’.
[2023-01-01 18:18:37] Loading Linux 6.0.15-300.fc37.x86_64 …
[2023-01-01 18:18:37] error: can’t find command module2'. [2023-01-01 18:18:37] Loading initial ramdisk ... [2023-01-01 18:18:37] error: file /boot/grub/x86_64-xen/multiboot2.mod’ not found.
[2023-01-01 18:18:37] error: can’t find command module2'. [2023-01-01 18:18:37] [2023-01-01 18:18:37] Press any key to continue... [2023-01-01 18:18:47] [2023-01-01 18:18:47] Failed to boot both default and fallback entries. [2023-01-01 18:18:47] [2023-01-01 18:18:47] Press any key to continue... [2023-01-01 18:18:57] .[?25l.[37m.[40m.[H.[J.[1;1H.[2;30HGNU GRUB version 2.04 [2023-01-01 18:18:57] [2023-01-01 18:18:57] .[37m.[40m.[4;2H+----------------------------------------------------------------------------+.[5;2H|.[5;79H|.[6;2H|.[6;79H|.[7;2H|.[7;79H|.[8;2H|.[8;79H|.[9;2H|.[9;79H|.[10;2H|.[10;79H|.[11;2H|.[11;79H|.[12;2H|.[12;79H|.[13;2H|.[13;79H|.[14;2H|.[14;79H|.[15;2H|.[15;79H|.[16;2H+----------------------------------------------------------------------------+.[37m.[40m.[17;2H.[18;2H.[37m.[40m Use the ^ and v keys to select which entry is highlighted. [2023-01-01 18:18:57] Press enter to boot the selected OS, e’ to edit the commands
[2023-01-01 18:18:57] before booting or c' for a command-line. ESC to return [2023-01-01 18:18:57] previous menu. .[5;80H .[30m.[47m.[5;3H*Fedora, with Xen hypervisor .[37m.[40m.[5;78H.[37m.[40m.[37m.[40m.[6;3H Advanced options for Fedora (with Xen hypervisor) .[37m.[40m.[6;78H.[37m.[40m.[37m.[40m.[7;3H .[37m.[40m.[7;78H.[37m.[40m.[37m.[40m.[8;3H .[37m.[40m.[8;78H.[37m.[40m.[37m.[40m.[9;3H .[37m.[40m.[9;78H.[37m.[40m.[37m.[40m.[10;3H .[37m.[40m.[10;78H.[37m.[40m.[37m.[40m.[11;3H .[37m.[40m.[11;78H.[37m.[40m.[37m.[40m.[12;3H .[37m.[40m.[12;78H.[37m.[40m.[37m.[40m.[13;3H .[37m.[40m.[13;78H.[37m.[40m.[37m.[40m.[14;3H .[37m.[40m.[14;78H.[37m.[40m.[37m.[40m.[15;3H .[37m.[40m.[15;78H.[37m.[40m.[15;80H .[5;78H.[22;1H .[23;1H .[5;78HLogfile Opened [2023-01-01 18:23:17] .[30m.[47mWelcome to GRUB! [2023-01-01 18:23:17] [2023-01-01 18:23:17] .[37m.[40m.[37m.[40m.[37m.[40m.[3;37H [ grub-xen.cfg 424B 100% 1.88B/s ].[3;1Herror: no such device: /boot/xen/pvboot-x86_64.elf. [2023-01-01 18:23:17] error: no such device: /boot/grub/grub.cfg. [2023-01-01 18:23:17] Reading (xen/xvda,gpt3/boot/grub2/grub.cfg [2023-01-01 18:23:18] .[H.[J.[1;1H.[1;39H [ grubenv 1.00KiB 100% 1.16B/s ].[1;1Herror: file /boot/grub/fonts/unicode.pf2’ not found.
[2023-01-01 18:23:18] error: no suitable video mode found.
[2023-01-01 18:23:18] error: file /boot/grub/x86_64-xen/increment.mod' not found. [2023-01-01 18:23:18] error: file /boot/grub/x86_64-xen/blscfg.mod’ not found.
[2023-01-01 18:23:18] error: can’t find command blscfg'. [2023-01-01 18:23:18] error: file /boot/grub/grubenv’ not found.
[2023-01-01 18:23:18] .[7;36H [ grub.cfg 9.76KiB 100% 2.27KiB/s ].[7;1H.[H.[J.[1;1H Booting Fedora, with Xen hypervisor' [2023-01-01 18:23:18] [2023-01-01 18:23:18] Loading Xen 4.16.3 ... [2023-01-01 18:23:18] error: file /boot/grub/x86_64-xen/multiboot2.mod’ not found.
[2023-01-01 18:23:18] error: can’t find command multiboot2'. [2023-01-01 18:23:18] Loading Linux 6.0.15-300.fc37.x86_64 ... [2023-01-01 18:23:18] error: can't find command module2’.
[2023-01-01 18:23:18] Loading initial ramdisk …
[2023-01-01 18:23:18] error: file /boot/grub/x86_64-xen/multiboot2.mod' not found. [2023-01-01 18:23:18] error: can't find command module2’.
[2023-01-01 18:23:18]
[2023-01-01 18:23:18] Press any key to continue…
[2023-01-01 18:23:28]
[2023-01-01 18:23:28] Failed to boot both default and fallback entries.
[2023-01-01 18:23:28]
[2023-01-01 18:23:28] Press any key to continue…
[2023-01-01 18:23:38] .[?25l.[37m.[40m.[H.[J.[1;1H.[2;30HGNU GRUB version 2.04
[2023-01-01 18:23:38]
[2023-01-01 18:23:38] .[37m.[40m.[4;2H±---------------------------------------------------------------------------+.[5;2H|.[5;79H|.[6;2H|.[6;79H|.[7;2H|.[7;79H|.[8;2H|.[8;79H|.[9;2H|.[9;79H|.[10;2H|.[10;79H|.[11;2H|.[11;79H|.[12;2H|.[12;79H|.[13;2H|.[13;79H|.[14;2H|.[14;79H|.[15;2H|.[15;79H|.[16;2H±---------------------------------------------------------------------------+.[37m.[40m.[17;2H.[18;2H.[37m.[40m Use the ^ and v keys to select which entry is highlighted.
[2023-01-01 18:23:38] Press enter to boot the selected OS, e' to edit the commands [2023-01-01 18:23:38] before booting or c’ for a command-line. ESC to return
[2023-01-01 18:23:38] previous menu. .[5;80H .[30m.[47m.[5;3H*Fedora, with Xen hypervisor .[37m.[40m.[5;78H.[37m.[40m.[37m.[40m.[6;3H Advanced options for Fedora (with Xen hypervisor) .[37m.[40m.[6;78H.[37m.[40m.[37m.[40m.[7;3H .[37m.[40m.[7;78H.[37m.[40m.[37m.[40m.[8;3H .[37m.[40m.[8;78H.[37m.[40m.[37m.[40m.[9;3H .[37m.[40m.[9;78H.[37m.[40m.[37m.[40m.[10;3H .[37m.[40m.[10;78H.[37m.[40m.[37m.[40m.[11;3H .[37m.[40m.[11;78H.[37m.[40m.[37m.[40m.[12;3H .[37m.[40m.[12;78H.[37m.[40m.[37m.[40m.[13;3H .[37m.[40m.[13;78H.[37m.[40m.[37m.[40m.[14;3H .[37m.[40m.[14;78H.[37m.[40m.[37m.[40m.[15;3H .[37m.[40m.[15;78H.[37m.[40m.[15;80H .[5;78H.[22;1H .[23;1H .[5;78H[2023-01-01 18:59:22] Logfile Opened
[2023-01-01 19:11:24] Logfile Opened
[2023-01-01 19:11:27] .[30m.[47mWelcome to GRUB!
[2023-01-01 19:11:27]
[2023-01-01 19:11:27] .[37m.[40m.[37m.[40m.[37m.[40m.[3;37H [ grub-xen.cfg 424B 100% 1.73B/s ].[3;1Herror: no such device: /boot/xen/pvboot-x86_64.elf.
[2023-01-01 19:11:28] error: no such device: /boot/grub/grub.cfg.
[2023-01-01 19:11:28] Reading (xen/xvda,gpt3/boot/grub2/grub.cfg
[2023-01-01 19:11:28] .[H.[J.[1;1H.[1;37H [ grubenv 1.00KiB 100% 253.59B/s ].[1;1Herror: file /boot/grub/fonts/unicode.pf2' not found. [2023-01-01 19:11:28] error: no suitable video mode found. [2023-01-01 19:11:28] error: file /boot/grub/i386-xen_pvh/increment.mod’ not found.
[2023-01-01 19:11:28] error: file /boot/grub/i386-xen_pvh/blscfg.mod' not found. [2023-01-01 19:11:28] error: can't find command blscfg’.
[2023-01-01 19:11:28] error: file /boot/grub/grubenv' not found. [2023-01-01 19:11:28] .[7;36H [ grub.cfg 9.76KiB 100% 2.40KiB/s ].[7;1H.[H.[J.[1;1H Booting Fedora, with Xen hypervisor’
[2023-01-01 19:11:28]
[2023-01-01 19:11:28] Loading Xen 4.16.3 …
[2023-01-01 19:11:28] .[4;29H [ xen-4.16.3.gz 1.23MiB 100% 305.93KiB/s ].[4;1H.[4;29H [ xen-4.16.3.gz 1.23MiB 100% 152.97KiB/s ].[4;1HLoading Linux 6.0.15-300.fc37.x86_64 …
[2023-01-01 19:11:29] .[5;23H [ vmlinuz-6.0.15-300.f 12.16MiB 100% 2.10MiB/s ].[5;1HLoading initial ramdisk …
[2023-01-01 19:11:30] .[6;24H [ initramfs-6.0.15-300 27.22MiB 75% 9.67MiB/s ].[6;1H.[6;22H [ initramfs-6.0.15-300 35.93MiB 100% 13.36MiB/s ].[6;1H[2023-01-01 19:21:46] Logfile Opened
[2023-01-01 19:21:48] .[30m.[47mWelcome to GRUB!
[2023-01-01 19:21:48]
[2023-01-01 19:21:48] .[37m.[40m.[37m.[40m.[37m.[40m.[3;37H [ grub-xen.cfg 424B 100% 2.24B/s ].[3;1Herror: no such device: /boot/xen/pvboot-x86_64.elf.
[2023-01-01 19:21:49] error: no such device: /boot/grub/grub.cfg.
[2023-01-01 19:21:49] Reading (xen/xvda,gpt3/boot/grub2/grub.cfg
[2023-01-01 19:21:49] .[H.[J.[1;1H.[1;37H [ grubenv 1.00KiB 100% 290.41B/s ].[1;1Herror: file /boot/grub/fonts/unicode.pf2' not found. [2023-01-01 19:21:49] error: no suitable video mode found. [2023-01-01 19:21:49] error: file /boot/grub/i386-xen_pvh/increment.mod’ not found.
[2023-01-01 19:21:49] error: file /boot/grub/i386-xen_pvh/blscfg.mod' not found. [2023-01-01 19:21:49] error: can't find command blscfg’.
[2023-01-01 19:21:49] error: file /boot/grub/grubenv' not found. [2023-01-01 19:21:49] .[7;36H [ grub.cfg 9.76KiB 100% 2.74KiB/s ].[7;1H.[H.[J.[1;1H Booting Fedora, with Xen hypervisor’
[2023-01-01 19:21:49]
[2023-01-01 19:21:49] Loading Xen 4.16.3 …
[2023-01-01 19:21:49] .[4;29H [ xen-4.16.3.gz 1.23MiB 100% 347.12KiB/s ].[4;1H.[4;29H [ xen-4.16.3.gz 1.23MiB 100% 173.56KiB/s ].[4;1HLoading Linux 6.0.15-300.fc37.x86_64 …
[2023-01-01 19:21:50] .[5;23H [ vmlinuz-6.0.15-300.f 12.16MiB 100% 9.31MiB/s ].[5;1HLoading initial ramdisk …
[2023-01-01 19:21:52] .[6;24H [ initramfs-6.0.15-300 21.79MiB 60% 7.46MiB/s ].[6;1H.[6;23H [ initramfs-6.0.15-300 35.93MiB 100% 9.44MiB/s ].[6;1H

The only thing that looks illogical is

Installed Packages
grub2-xen-pvh.x86_64                     2.04-1.fc32                     @System

yet, in /var/lib/qubes/vm-kernels/pvgrub2-pvh/ I see grub-i386-xen_pvh.bin

Does anyone have an idea, or anyone having experience with booting fedora into native kernel?

enmus · January 2, 2023, 1:01pm

For the reference, I succeeded to install and boot into debian-11-minimal native kernel following the same docs and steps I used to with fedora, so what am I doing wrong with fedora?

rustybird · January 3, 2023, 4:15pm

Maybe try it with a non-minimal Fedora 37 too for good measure. And if it still doesn’t work, that seems suitable for a bug report?

enmus · January 3, 2023, 10:23pm

And… it boots into native kernel on fedora-37.

Thanks for the tip. Now to trace what’s wrong with minimal…

enmus · January 5, 2023, 12:05am

I have cloned another “clean” fedora-minimal template (the one from the OP was cloned from -minimal too, but heavily customized before trying to boot into native kernel), and tried to boot into native kernel.
No luck.

I will try to download clean fedora-37-minimal and to try to boot to native kernel…

enmus · January 6, 2023, 8:11pm

With a stock fedora-37-minimal I was able to boot native kernel, too.
So I went back to my previous minimal template and wanted to be sure that vmlinuz files aren’t missing in the /boot, that all other needed packages are there and did this:


$ sudo dnf reinstall kernel*
$ sudo dnf install grub2 qubes-kernel-vm-support
$ sudo  grub2-install /dev/xvda
$ sudo grub2-mkconfig -o /boot/grub2/grub.cfg

Then, in dom0 I set kernel to pvgrub2-pvh and virt_mode PVH for the minimal template, and miraculously, this time I was able to boot to my customized minimal template’s native kernel.

Thanks for the tips. I will mark this post as a solution so it could serve better to the users having similar problems.