QubesOS freeze, crash and reboots

[ChrisA]

Have you tried/tested kernel-latest? - if no, would you be willing to test it?

sudo qubes-dom0-update --disablerepo=* --enablerepo=qubes-dom0-current-testing kernel-latest

(in Dom0)

If you have issues booting, could you try temporally adding:

qubes.skip_autostart

to the kernel line at boot (hit e to edit the GRUB config, use the arrow keys to locate where it says quiet and replace it with qubes.skip_autostart)?

[tripleh]

Maybe relevant for some coreboot users: Bug #121: T520: Hangs in OS - coreboot - Issue Tracker

[tanky0u]

I would like to report that my intel i7-3520M CPU (on Thinkpad X230) has been rock-solid stable since a month. I am on Qubes 4.1 with the latest updates installed. I have been using my setup for video encoding day and night and never had a freeze so far.

[kenosen]

Ditto. On a Librem 14. Used to be that I had to have power-adapted plugged in for updates, but rock solid now.

[oh_no]

The Qubes OS stability has increased significantly since last dom0 update. No single crash and reboot since then.
I’m even nervous about that

user@dom0 ~ % cat /var/log/dnf.log
...
2023-07-14T13:54:33+0100 DEBUG --> Starting dependency resolution
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel.x86_64 1000:6.1.35-1.qubes.fc32 will be installed
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-devel.x86_64 1000:6.1.35-1.qubes.fc32 will be installed
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-latest.x86_64 1000:6.3.9-1.qubes.fc32 will be installed
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-latest-modules.x86_64 1000:6.3.9-1.qubes.fc32 will be installed
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-modules.x86_64 1000:6.1.35-1.qubes.fc32 will be installed
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-qubes-vm.x86_64 1000:6.1.35-1.qubes.fc32 will be installed
2023-07-14T13:54:33+0100 DEBUG ---> Package python3-qubesadmin.noarch 4.1.27-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package python3-qubesadmin.noarch 4.1.31-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-admin-client.noarch 4.1.27-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-admin-client.noarch 4.1.31-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-dom0.noarch 4.1.30-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-dom0.noarch 4.1.32-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-qrexec.x86_64 4.1.21-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-qrexec.x86_64 4.1.22-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-qrexec-dom0.x86_64 4.1.21-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-qrexec-dom0.x86_64 4.1.22-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-qrexec-libs.x86_64 4.1.21-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-core-qrexec-libs.x86_64 4.1.22-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-gpg-split-dom0.x86_64 2.0.67-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-gpg-split-dom0.x86_64 2.0.68-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-manager.noarch 4.1.28-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-manager.noarch 4.1.30-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-mgmt-salt-dom0-update.noarch 4.1.10-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-mgmt-salt-dom0-update.noarch 4.1.11-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-pdf-converter-dom0.x86_64 2.1.16-1.fc32 will be upgraded
2023-07-14T13:54:33+0100 DEBUG ---> Package qubes-pdf-converter-dom0.x86_64 2.1.18-1.fc32 will be an upgrade
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel.x86_64 1000:5.15.89-1.fc32.qubes will be erased
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-devel.x86_64 1000:5.15.89-1.fc32.qubes will be erased
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-latest.x86_64 1000:6.2.6-1.qubes.fc32 will be erased
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-latest-modules.x86_64 1000:6.2.6-1.qubes.fc32 will be erased
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-modules.x86_64 1000:5.15.89-1.fc32.qubes will be erased
2023-07-14T13:54:33+0100 DEBUG ---> Package kernel-qubes-vm.x86_64 1000:5.15.89-1.fc32.qubes will be erased
2023-07-14T13:54:33+0100 DEBUG --> Finished dependency resolution
2023-07-14T13:54:33+0100 DDEBUG timer: depsolve: 16 ms
2023-07-14T13:54:33+0100 INFO Dependencies resolved.
2023-07-14T13:54:33+0100 INFO ==============================================================================================================
 Package                          Arch        Version                           Repository               Size
==============================================================================================================
Installing:
 kernel                           x86_64      1000:6.1.35-1.qubes.fc32          qubes-dom0-cached        11 M
 kernel-devel                     x86_64      1000:6.1.35-1.qubes.fc32          qubes-dom0-cached        14 M
 kernel-latest                    x86_64      1000:6.3.9-1.qubes.fc32           qubes-dom0-cached        12 M
 kernel-latest-modules            x86_64      1000:6.3.9-1.qubes.fc32           qubes-dom0-cached        72 M
 kernel-modules                   x86_64      1000:6.1.35-1.qubes.fc32          qubes-dom0-cached        65 M
 kernel-qubes-vm                  x86_64      1000:6.1.35-1.qubes.fc32          qubes-dom0-cached        16 M
Upgrading:
 python3-qubesadmin               noarch      4.1.31-1.fc32                     qubes-dom0-cached       446 k
 qubes-core-admin-client          noarch      4.1.31-1.fc32                     qubes-dom0-cached        67 k
 qubes-core-dom0                  noarch      4.1.32-1.fc32                     qubes-dom0-cached       703 k
 qubes-core-qrexec                x86_64      4.1.22-1.fc32                     qubes-dom0-cached       170 k
 qubes-core-qrexec-dom0           x86_64      4.1.22-1.fc32                     qubes-dom0-cached        37 k
 qubes-core-qrexec-libs           x86_64      4.1.22-1.fc32                     qubes-dom0-cached        25 k
 qubes-gpg-split-dom0             x86_64      2.0.68-1.fc32                     qubes-dom0-cached        23 k
 qubes-manager                    noarch      4.1.30-1.fc32                     qubes-dom0-cached       1.8 M
 qubes-mgmt-salt-dom0-update      noarch      4.1.11-1.fc32                     qubes-dom0-cached        32 k
 qubes-pdf-converter-dom0         x86_64      2.1.18-1.fc32                     qubes-dom0-cached        27 k
Removing:
 kernel                           x86_64      1000:5.15.89-1.fc32.qubes         @qubes-dom0-cached       35 M
 kernel-devel                     x86_64      1000:5.15.89-1.fc32.qubes         @qubes-dom0-cached       60 M
 kernel-latest                    x86_64      1000:6.2.6-1.qubes.fc32           @qubes-dom0-cached       39 M
 kernel-latest-modules            x86_64      1000:6.2.6-1.qubes.fc32           @qubes-dom0-cached      411 M
 kernel-modules                   x86_64      1000:5.15.89-1.fc32.qubes         @qubes-dom0-cached      309 M
 kernel-qubes-vm                  x86_64      1000:5.15.89-1.fc32.qubes         @qubes-dom0-cached      515 M

Transaction Summary
==============================================================================================================
Install   6 Packages
Upgrade  10 Packages
Remove    6 Packages

2023-07-14T13:54:33+0100 INFO Total size: 193 M
...

user@dom0 ~ % uname -a
Linux dom0 6.3.9-1.qubes.fc32.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Jun 23 19:49:58 CEST 2023 x86_64 x86_64 x86_64 GNU/Linux

[trounces]

Since the week of July 29th, 2022 Update, QubesOS freeze, crash and reboots.
And I created this topic on the forum.

Today, August 18, 2023 and many updates later the same still occurs. I have never been able to find what caused the crash since July 2022. Before that period I never had QubesOS crash.

It happens when I move or drag a windows over the screen. Sometimes it happens. Sometimes it does not. Can it be related to a refresh rate, or a lag or something?

My solution is to avoid moving or dragging screens, but in the case a window opens partially outside the screen and you need to drag it to see it. And then it often crashes. But I have no choice.

As an update during July 2022 caused the issue, I was hoping for it to be resolved by now. But a year later and it still happens.

[fsflover]

@trounces

My solution is to avoid moving or dragging screens

Does it crash if you right click on the window, choose “Move” and then press arrows on the keyboard?
(It never crashes on my Librem 15.)

[qub411]

Are you on i3 by any chance? Your post was a long way back in this thread and a number of useful “fixes” have been posted for this since then.

[keksicus]

It happens when I move or drag a windows over the screen. Sometimes it happens. Sometimes it does not. Can it be related to a refresh rate, or a lag or something?

I seemed to have eliminated this by changing:
Window Manager → Focus → Focus model → Delay before window receives focus:
move it all the way left, then tap the right keyboard arrow 25-50 times to make it 25-50 ms.

I use focus follows arrow, but I’ve noticed it gets buggy when mouse focus hops back and forth very quickly between two windows (which occurs during resize).

My main problem right now is gntdev.c:406 errors are filling journalctl.

[neoniobium]

I was haunted by kernel freezes when using salt for about an half year. A few mount ago the issue disappeared, probably because of an kernel update.

I use i3wm on a Lenovo T430 with Heads.

[Sven]

For me they disappeared when switching from a self-build HEADS version to one from the Nitrokey repository.

[neoniobium]

Interesting, I was on the Nitrokey version all the time.

[trounces]

15 month’s after QubesOS started crashing randomly and created this post so far I have not been able to resolve it.

Today I took another look at it and entered sudo journalctl and the last two lines in red before reboot show:

dom0 xscreensaver[17577]: pam_unix(xscreensaver:auth): conversation failed
dom0 xscreensaver[17577]: pam_unix(xscreensaver:auth): auth could not identify password for [system76]
--reboot--

[tempmail]

My Qubes 4.1 is not happy with kernel 6.5.(x up to 8-1). It freezes, crashes, getting shutdown due to uncontrolled hotness… It works with 6.4.13, though.

[tanky0u]

I updated to QubesOS 4.2-RC4. I selected use latest kernel install. I am using QubesOS and all the templates with the kernel 6.5.

From time to time, during once every couple of start-up, shutdown, qubesOS freezes and I have to push down to the power button to shut it down.

[trounces]

Today it crashed twice.

I saw this as the last message:

dom0 anacron[28220]: Can't find sendmail at /usr/sbin/sendmail, not mailing output

I also saw this message a few lines before:

Xen free = 251622285 too small for satisfy assignments! assigned_but_unused=23471681968, domdict={'0': {'memor

I saw others see these errors too when they have crashes:

Memory allocation problem (remains in low allocation, for minutes)

As expected I reproduced the issue with a multiboot unikernel. As I currently understand the issue: the system is under memory pressure (some AppVM won’t be able to get their highmem value) mirage-fw is excluded from the memory balancing process (but still seems to be implied at some point, didn’t checked without it, but @rrn has done that) starting a new VM is slow because that VM have to use swap due to being at its lowmem value shutting down an AppVM release some memory and permits to incre…

and

Need help reading error log messages

cont… May 03 01:31:30 dom0 kernel: ACPI Error: Aborting method \_SB.PCI0.SPI1.FPNT._CRS due to previous error (AE_AML_INVALID_RESOURCE_TYPE) (20210730/psparse-529) May 03 01:31:30 dom0 kernel: ACPI Error: Method execution failed \_SB.PCI0.SPI1.FPNT._CRS due to previous error (AE_AML_INVALID_RESOURCE_TYPE) (20210730/uteval-68) May 03 01:31:30 dom0 kernel: ACPI Error: Aborting method \_SB.PCI0.SPI2.FPNT._CRS due to previous error (AE_AML_INVALID_RESOURCE_TYPE) (20210730/psparse-529) May 03 01:31:…

However so far I have not found the cause or a solution for QubesOS crashing.

[trounces]

I did a memory test using https://memtest.org/ and no hardware problems where found. Memory is working fine. Crashes must be caused by something else so far unknown to me.