Why is my 5.12.10-1 kernel failing to boot?

Doria · June 24, 2021, 9:45pm

I have installed kernel-latest, which is version 5.12.10-1, because I want to install NVIDIA drivers (not done yet). When I installed the kernel, Qubes put my usual kernel options on this newly installed kernel. Note, I need to disable nouveau to get my regular kernel (5.4.125-1) to boot.

rd.lvm.lv=qubes_dom0/root rd.lvm.lv=qubes_dom0/swap i915.alpha_support=1 rhgb quiet nouveau.modeset=0 rd.driver.blacklist=nouveau video=vesa:off plymouth.ignore-serial-consoles

I haven’t installed NVIDIA modules yet, as I haven’t been able to boot this kernel at all. It stalls on the login screen.

Can you see what the actual error here is? This is the output from journal -b 1

Jun 22 15:57:15 dom0 kernel:  nvkm_vmm_put+0x30/0x50 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nv50_instobj_dtor+0xb6/0xf0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_memory_unref+0x42/0x60 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_mmu_ptc_put+0x52/0x1c0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  ? _raw_spin_unlock_irqrestore+0x14/0x20
Jun 22 15:57:15 dom0 kernel:  ? drm_connector_list_iter_next+0x7b/0xa0 [drm]
Jun 22 15:57:15 dom0 kernel:  nvkm_vmm_unref+0x173/0x1d0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_uvmm_dtor+0x12/0x20 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_object_dtor+0xbc/0x190 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_object_del+0x20/0x90 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_ioctl_del+0x86/0xa0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_ioctl+0x112/0x230 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvif_object_fini+0x59/0x80 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nouveau_vmm_fini+0x12/0x20 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nouveau_cli_fini+0x48/0x90 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nouveau_drm_postclose+0xbb/0xf0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  drm_file_free+0x1ec/0x2b0 [drm]
Jun 22 15:57:15 dom0 kernel:  drm_release+0xa8/0xe0 [drm]
Jun 22 15:57:15 dom0 kernel:  __fput+0xbe/0x250
Jun 22 15:57:15 dom0 kernel:  task_work_run+0x8a/0xb0
Jun 22 15:57:15 dom0 kernel:  exit_to_usermode_loop+0x100/0x130
Jun 22 15:57:15 dom0 kernel:  do_syscall_64+0x199/0x1c0
Jun 22 15:57:15 dom0 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jun 22 15:57:15 dom0 kernel: RIP: 0033:0x771b9953b690
Jun 22 15:57:15 dom0 kernel: Code: 73 01 c3 48 8b 0d 18 89 20 00 f7 d8 64 89 01 48 83 c8 ff c3 66 0f 1f 44 00 00 83 3d 39 cd 20 00 00 75 10 b8 03 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ee fb ff ff 48 89 04 24
Jun 22 15:57:15 dom0 kernel: RSP: 002b:00007fff5ccad328 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
Jun 22 15:57:15 dom0 kernel: RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000771b9953b690
Jun 22 15:57:15 dom0 kernel: RDX: 0000000000000000 RSI: 0000771b99525b08 RDI: 000000000000000e
Jun 22 15:57:15 dom0 kernel: RBP: 0000000002089540 R08: 000000000209a610 R09: 0000771b992b9500
Jun 22 15:57:15 dom0 kernel: R10: 0000000002093160 R11: 0000000000000246 R12: 0000000000000004
Jun 22 15:57:15 dom0 kernel: R13: 0000000002097600 R14: 000000000000000e R15: 0000000000000001
Jun 22 15:57:15 dom0 kernel: ---[ end trace 75706b54ed3db43d ]---
Jun 22 15:57:15 dom0 kernel: nouveau 0000:01:00.0: tmr: stalled at ffffffffffffffff
Jun 22 15:57:15 dom0 kernel: ------------[ cut here ]------------
Jun 22 15:57:15 dom0 kernel: nouveau 0000:01:00.0: timeout
Jun 22 15:57:15 dom0 kernel: WARNING: CPU: 3 PID: 5435 at /home/user/rpmbuild/BUILD/kernel-5.4.98/linux-5.4.98/drivers/gpu/drm/nouveau/nvkm/subdev/mmu/vmmtu102.c:47 tu102_vmm_flush+0x151/0x160 [nouveau]
Jun 22 15:57:15 dom0 kernel: Modules linked in: ebtable_filter ebtables ip6table_filter ip6_tables iptable_filter vfat fat snd_hda_codec_hdmi ucsi_ccg hid_multitouch snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio edac_mce_amd pcspkr btusb btrtl btbcm btintel wmi_bmof bluetooth joydev ecdh_generic ecc sp5100_tco k10temp i2c_piix4 snd_pci_acp3x snd_hda_intel snd_intel_nhlt snd_hda_codec amdgpu iwlwifi snd_hda_core snd_hwdep snd_seq snd_seq_device amd_iommu_v2 cfg80211 gpu_sched snd_pcm snd_timer r8169 ucsi_acpi snd typec_ucsi i2c_nvidia_gpu soundcore typec ideapad_laptop sparse_keymap rfkill pinctrl_amd xen_acpi_processor xenfs uinput ip_tables dm_thin_pool dm_persistent_data dm_bio_prison libcrc32c dm_crypt nouveau crct10dif_pclmul crc32_pclmul crc32c_intel mxm_wmi i2c_algo_bit drm_kms_helper ghash_clmulni_intel ttm nvme serio_raw xhci_pci drm xhci_hcd nvme_core wmi video i2c_hid xen_privcmd xen_pciback xen_blkback xen_gntalloc xen_gntdev xen_evtchn
Jun 22 15:57:15 dom0 kernel: CPU: 3 PID: 5435 Comm: Xorg Tainted: G        W         5.4.98-1.fc25.qubes.x86_64 #1
Jun 22 15:57:15 dom0 kernel: Hardware name: LENOVO 82GU/LNVNB161216, BIOS FSCN11WW 07/23/2020
Jun 22 15:57:15 dom0 kernel: RIP: e030:tu102_vmm_flush+0x151/0x160 [nouveau]
Jun 22 15:57:15 dom0 kernel: Code: 04 24 48 8b 40 10 48 8b 78 10 48 8b 5f 50 48 85 db 74 1b e8 81 c2 38 c1 48 89 da 48 89 c6 48 c7 c7 e0 15 48 c0 e8 1f 53 dc c0 <0f> 0b eb ad 48 8b 1f eb e0 e8 11 56 dc c0 90 0f 1f 44 00 00 ff 74
Jun 22 15:57:15 dom0 kernel: RSP: e02b:ffffc9000175f9f8 EFLAGS: 00010282
Jun 22 15:57:15 dom0 kernel: RAX: 0000000000000000 RBX: ffff8881714b51c0 RCX: 0000000000000006
Jun 22 15:57:15 dom0 kernel: RDX: 0000000000000007 RSI: 0000000000000001 RDI: ffff8881772d7900
Jun 22 15:57:15 dom0 kernel: RBP: ffff88816c86d420 R08: 0000000000000001 R09: 000000000014f922
Jun 22 15:57:15 dom0 kernel: R10: ffff88816a409600 R11: 0000000000000000 R12: 0000000080000005
Jun 22 15:57:15 dom0 kernel: R13: ffff88816c86e400 R14: 0000000000000004 R15: 0003ffffffffffff
Jun 22 15:57:15 dom0 kernel: FS:  0000771b9bbcea40(0000) GS:ffff8881772c0000(0000) knlGS:0000000000000000
Jun 22 15:57:15 dom0 kernel: CS:  e030 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 22 15:57:15 dom0 kernel: CR2: 0000771b9a9711c0 CR3: 000000016e4d2000 CR4: 0000000000040660
Jun 22 15:57:15 dom0 kernel: Call Trace:
Jun 22 15:57:15 dom0 kernel:  nvkm_vmm_iter.constprop.10+0x327/0x880 [nouveau]
Jun 22 15:57:15 dom0 kernel:  ? nvkm_vmm_map_choose+0xb0/0xb0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  ? gf100_vmm_invalidate_pdb+0x30/0x30 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_vmm_ptes_unmap_put+0x30/0x50 [nouveau]
Jun 22 15:57:15 dom0 kernel:  ? nvkm_vmm_map_choose+0xb0/0xb0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  ? gf100_vmm_invalidate_pdb+0x30/0x30 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_vmm_put_locked+0x1d9/0x230 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_vmm_put+0x30/0x50 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nv50_instobj_dtor+0xb6/0xf0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_memory_unref+0x42/0x60 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_mmu_ptc_put+0x52/0x1c0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  ? _raw_spin_unlock_irqrestore+0x14/0x20
Jun 22 15:57:15 dom0 kernel:  ? drm_connector_list_iter_next+0x7b/0xa0 [drm]
Jun 22 15:57:15 dom0 kernel:  nvkm_vmm_unref+0x173/0x1d0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_uvmm_dtor+0x12/0x20 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_object_dtor+0xbc/0x190 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_object_del+0x20/0x90 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_ioctl_del+0x86/0xa0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvkm_ioctl+0x112/0x230 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nvif_object_fini+0x59/0x80 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nouveau_vmm_fini+0x12/0x20 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nouveau_cli_fini+0x48/0x90 [nouveau]
Jun 22 15:57:15 dom0 kernel:  nouveau_drm_postclose+0xbb/0xf0 [nouveau]
Jun 22 15:57:15 dom0 kernel:  drm_file_free+0x1ec/0x2b0 [drm]
Jun 22 15:57:15 dom0 kernel:  drm_release+0xa8/0xe0 [drm]
Jun 22 15:57:15 dom0 kernel:  __fput+0xbe/0x250
Jun 22 15:57:15 dom0 kernel:  task_work_run+0x8a/0xb0
Jun 22 15:57:15 dom0 kernel:  exit_to_usermode_loop+0x100/0x130
Jun 22 15:57:15 dom0 kernel:  do_syscall_64+0x199/0x1c0
Jun 22 15:57:15 dom0 kernel:  entry_SYSCALL_64_after_hwframe+0x44/0xa9
Jun 22 15:57:15 dom0 kernel: RIP: 0033:0x771b9953b690
Jun 22 15:57:15 dom0 kernel: Code: 73 01 c3 48 8b 0d 18 89 20 00 f7 d8 64 89 01 48 83 c8 ff c3 66 0f 1f 44 00 00 83 3d 39 cd 20 00 00 75 10 b8 03 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 31 c3 48 83 ec 08 e8 ee fb ff ff 48 89 04 24
Jun 22 15:57:15 dom0 kernel: RSP: 002b:00007fff5ccad328 EFLAGS: 00000246 ORIG_RAX: 0000000000000003
Jun 22 15:57:15 dom0 kernel: RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000771b9953b690
Jun 22 15:57:15 dom0 kernel: RDX: 0000000000000000 RSI: 0000771b99525b08 RDI: 000000000000000e
Jun 22 15:57:15 dom0 kernel: RBP: 0000000002089540 R08: 000000000209a610 R09: 0000771b992b9500
Jun 22 15:57:15 dom0 kernel: R10: 0000000002093160 R11: 0000000000000246 R12: 0000000000000004
Jun 22 15:57:15 dom0 kernel: R13: 0000000002097600 R14: 000000000000000e R15: 0000000000000001
Jun 22 15:57:15 dom0 kernel: ---[ end trace 75706b54ed3db43e ]---
Jun 22 15:57:15 dom0 audit[5435]: ANOM_ABEND auid=4294967295 uid=0 gid=0 ses=4294967295 pid=5435 comm="Xorg" exe="/usr/libexec/Xorg" sig=6 res=1
Jun 22 15:57:15 dom0 systemd[1]: Started Process Core Dump (PID 5471/UID 0).
Jun 22 15:57:15 dom0 audit[1]: SERVICE_START pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=systemd-coredump@6-5471-0 comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=success'
Jun 22 15:57:15 dom0 systemd[1]: lightdm.service: Main process exited, code=exited, status=1/FAILURE
Jun 22 15:57:15 dom0 systemd[1]: lightdm.service: Unit entered failed state.
Jun 22 15:57:15 dom0 systemd[1]: lightdm.service: Triggering OnFailure= dependencies.
Jun 22 15:57:15 dom0 systemd[1]: lightdm.service: Failed with result 'exit-code'.
Jun 22 15:57:15 dom0 audit[1]: SERVICE_STOP pid=1 uid=0 auid=4294967295 ses=4294967295 msg='unit=lightdm comm="systemd" exe="/usr/lib/systemd/systemd" hostname=? addr=? terminal=? res=failed'
Jun 22 15:57:15 dom0 systemd[1]: plymouth-quit.service: Start request repeated too quickly.
Jun 22 15:57:15 dom0 systemd[1]: Failed to start Terminate Plymouth Boot Screen.
Jun 22 15:57:15 dom0 systemd[1]: plymouth-quit.service: Failed with result 'start-limit-hit'.
Jun 22 15:57:15 dom0 systemd-coredump[5472]: Process 5435 (Xorg) of user 0 dumped core.

                                             Stack trace of thread 5435:
                                             #0  0x0000771b9919a8df raise (libc.so.6)
                                             #1  0x0000771b9919c4da abort (libc.so.6)
                                             #2  0x00000000005a16be OsAbort (Xorg)
                                             #3  0x00000000005a7243 AbortServer (Xorg)
                                             #4  0x00000000005a802d FatalError (Xorg)
                                             #5  0x000000000046f5d0 xf86PostProbe (Xorg)
                                             #6  0x000000000047d6a6 InitOutput (Xorg)
                                             #7  0x000000000043ae66 dix_main (Xorg)
                                             #8  0x0000771b99185431 __libc_start_main (libc.so.6)
                                             #9  0x0000000000424d5a _start (Xorg)

51lieal · June 25, 2021, 12:37pm

Remove this from 5.12.10-1 kernel option.

nouveau.modeset=0 rd.driver.blacklist=nouveau video=vesa:off plymouth.ignore-serial-consoles

Boot, if success. uninstall nvidia first.

then rebuild dkms nvidia for newer kernel.

Doria · June 27, 2021, 11:21pm

Thanks for the suggestion. I removed those flags from xen.cfg 5.12.10-1 kernel line. But that kernel didn’t boot with this modification (or before the change).

I had to change back to an earlier kernel.

Can I get 5.12.9-1 somewhere?

51lieal · June 28, 2021, 2:16am

Hmm i’m sure that the problem is related to your nvidia driver, if you can access dom0, you can try install with

qubes-dom0-update kernel-latest-5.12.9* (in current testing repo)

How about fresh install latest qubes if you want, here’s link.

https://qubes.notset.fr/iso/Qubes-20210626-kernel-latest-x86_64.iso
https://qubes.notset.fr/iso/Qubes-20210626-kernel-latest-x86_64.iso.asc 
https://qubes.notset.fr/iso/Qubes-20210626-kernel-latest-x86_64.iso.DIGESTS

Doria · June 29, 2021, 10:04am

I tried

" ```
qubes-dom0-update kernel-latest-5.12.9* --enablerepo=qubes-dom0-current-testing

which gives "No package kernel-latest-5.12.9* available."

I have not installed the nvidia driver because I never got the 5.12.10-1 kernel to work. I was going to try the nvidia driver once the kernel worked but it hasn't.

51lieal · June 29, 2021, 10:49am

qubes-dom0-update --enablerepo=qubes-dom0-current-testing kernel-latest-5.12.9-1*

please try again with this command.

Doria · June 29, 2021, 8:03pm

I was mistaken. It did download 5.12.9-1. But it didn’t install it for some reason. The RPM was placed here:

/var/lib/qubes/updates/rpm/kernel-latest-5.12.9-1.fc25.qubes.x86_64.rpm

I had to delete an old kernel to make space, but it installed. Booted up and I got the same problem as with 5.12.10-1.

I am going to look at making a custom kernel which incorporates the NVIDIA driver.