I don’t believe this is a duplicate of my previous post here:
I’ve had qubes randomly shutting down on me lately. So far it’s been just qubes based on whonix templates and usually it is a whonix gateway. Usually the whonix workstation will not run without the gateway booting first, but what has been happening is a service goes offline,the workstation is still running but the gateway has crashed.
I had to make a change to my Xen configuration to get my machine to work with recent versions: No Qubes/VMs boot after latest updates - #32 by scallyob
It’s poss…
This has a very clear cause, happens when sending print jobs to USB printer. Doesn’t happen every time. But has started happening much more regularly. I have many examples of the below if helpful to post more examples.
from /var/log/xen/console/guest-sys-usb.log
[2024-06-08 19:56:06] [114115.500799] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:07] [114116.511893] usbip-host 2-1: usb_set_interface done: inf 0 alt 0^M
[2024-06-08 19:56:28] [114137.676786] usbip-host 2-1: usb_set_interface done: inf 0 alt 1^M
[2024-06-08 19:56:28] [114137.697300] usbip-host 2-1: usb_set_interface done: inf 0 alt 0^M
[2024-06-08 19:56:28] [114137.717116] usbip-host 2-1: usb_set_interface done: inf 0 alt 1^M
[2024-06-08 19:56:28] [114137.758366] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:30] [114139.830236] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:31] [114140.886311] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:32] [114141.916918] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:33] [114142.937803] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:34] [114143.967149] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:35] [114144.993924] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:36] [114146.013400] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:37] [114147.037783] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:38] [114148.073627] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:40] [114149.105408] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:41] [114150.129504] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:42] [114151.153467] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:43] [114152.178916] usbip-host 2-1: unlinked by a call to usb_unlink_urb()^M
[2024-06-08 19:56:44] [114153.203288] general protection fault, probably for non-canonical address 0xf4ec3d094082861: 0000 [#1] PREEMPT SMP NOPTI^M
[2024-06-08 19:56:44] [114153.205198] CPU: 1 PID: 2647 Comm: stub_rx Not tainted 6.6.25-1.qubes.fc37.x86_64 #1^M
[2024-06-08 19:56:44] [114153.207221] Hardware name: Xen HVM domU, BIOS 4.17.4 04/26/2024^M
[2024-06-08 19:56:44] [114153.209229] RIP: 0010:stub_rx_pdu+0x22c/0x270 [usbip_host]^M
[2024-06-08 19:56:44] [114153.211095] Code: c3 01 48 8b 3c e8 e8 03 59 d8 c5 41 89 c1 83 f8 8d 74 2b 49 8b 44 24 20 41 8b 4c 24 30 89 da 48 c7 c6 40 16 87 c0 4d 8b 04 24 <48> 8b 04 e8 48 8b 78 40 48 81 c7 a8 00 00 00 e8 10 20 ca c5 41 39^M
[2024-06-08 19:56:44] [114153.214201] RSP: 0018:ffffbad3007f7e80 EFLAGS: 00010216^M
[2024-06-08 19:56:44] [114153.214893] RAX: 0f4ec3d094082861 RBX: 0000000000000001 RCX: 0000000000000000^M
[2024-06-08 19:56:44] [114153.215927] RDX: 0000000000000001 RSI: ffffffffc0871640 RDI: ffffffff885f2670^M
[2024-06-08 19:56:44] [114153.216969] RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffd5^M
[2024-06-08 19:56:44] [114153.217993] R10: 0000000000000000 R11: 0000000000000038 R12: ffff97a04c17cf00^M
[2024-06-08 19:56:44] [114153.219018] R13: ffff97a06edb3f00 R14: ffff97a06edb3f94 R15: ffffffffc0868450^M
[2024-06-08 19:56:44] [114153.220364] FS: 0000000000000000(0000) GS:ffff97a0b9700000(0000) knlGS:0000000000000000^M
[2024-06-08 19:56:44] [114153.221390] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033^M
[2024-06-08 19:56:44] [114153.222255] CR2: 000076adf7589100 CR3: 000000003deb6000 CR4: 00000000000406e0^M
[2024-06-08 19:56:44] [114153.223442] Call Trace:^M
[2024-06-08 19:56:44] [114153.223791] <TASK>^M
[2024-06-08 19:56:44] [114153.224141] ? die_addr+0x36/0x90^M
[2024-06-08 19:56:44] [114153.224669] ? exc_general_protection+0x1c5/0x430^M
[2024-06-08 19:56:44] [114153.225369] ? asm_exc_general_protection+0x26/0x30^M
[2024-06-08 19:56:44] [114153.226080] ? __pfx_stub_rx_loop+0x10/0x10 [usbip_host]^M
[2024-06-08 19:56:44] [114153.226785] ? stub_rx_pdu+0x22c/0x270 [usbip_host]^M
[2024-06-08 19:56:44] [114153.227489] stub_rx_loop+0x23/0x40 [usbip_host]^M
[2024-06-08 19:56:44] [114153.228190] kthread+0xe8/0x120^M
[2024-06-08 19:56:44] [114153.228716] ? __pfx_kthread+0x10/0x10^M
[2024-06-08 19:56:44] [114153.229239] ret_from_fork+0x34/0x50^M
[2024-06-08 19:56:44] [114153.229761] ? __pfx_kthread+0x10/0x10^M
[2024-06-08 19:56:44] [114153.230284] ret_from_fork_asm+0x1b/0x30^M
[2024-06-08 19:56:44] [114153.230809] </TASK>^M
[2024-06-08 19:56:44] [114153.231156] Modules linked in: usbip_host usbip_core usblp uas usb_storage nft_ct ipt_REJECT nf_reject_ipv4 xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_compat nf_tables nfnetlink joydev crct10dif_pclmul crc32_pclmul crc32c_intel polyval_clmulni polyval_generic ghash_clmulni_intel sha512_ssse3 sha256_ssse3 xhci_pci sha1_ssse3 pcspkr ohci_pci floppy xhci_pci_renesas drm_vram_helper ata_generic drm_ttm_helper xhci_hcd ttm ohci_hcd pata_acpi i2c_piix4 ehci_pci ehci_hcd serio_raw xen_scsiback target_core_mod xen_netback xen_privcmd xen_gntdev xen_gntalloc xen_blkback xen_evtchn fuse loop overlay xen_blkfront^M
[2024-06-08 19:56:44] [114153.237460] ---[ end trace 0000000000000000 ]---^M
[2024-06-08 19:56:44] [114153.237817] RIP: 0010:stub_rx_pdu+0x22c/0x270 [usbip_host]^M
[2024-06-08 19:56:44] [114153.407101] Code: c3 01 48 8b 3c e8 e8 03 59 d8 c5 41 89 c1 83 f8 8d 74 2b 49 8b 44 24 20 41 8b 4c 24 30 89 da 48 c7 c6 40 16 87 c0 4d 8b 04 24 <48> 8b 04 e8 48 8b 78 40 48 81 c7 a8 00 00 00 e8 10 20 ca c5 41 39^M
[2024-06-08 19:56:44] [114153.408760] RSP: 0018:ffffbad3007f7e80 EFLAGS: 00010216^M
[2024-06-08 19:56:44] [114153.409118] RAX: 0f4ec3d094082861 RBX: 0000000000000001 RCX: 0000000000000000^M
[2024-06-08 19:56:44] [114153.410086] RDX: 0000000000000001 RSI: ffffffffc0871640 RDI: ffffffff885f2670^M
[2024-06-08 19:56:44] [114153.411227] RBP: 0000000000000000 R08: 0000000000000000 R09: 00000000ffffffd5^M
[2024-06-08 19:56:44] [114153.412163] R10: 0000000000000000 R11: 0000000000000038 R12: ffff97a04c17cf00^M
[2024-06-08 19:56:44] [114153.413061] R13: ffff97a06edb3f00 R14: ffff97a06edb3f94 R15: ffffffffc0868450^M
[2024-06-08 19:56:44] [114153.414034] FS: 0000000000000000(0000) GS:ffff97a0b9700000(0000) knlGS:0000000000000000^M
[2024-06-08 19:56:44] [114153.414937] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033^M
[2024-06-08 19:56:44] [114153.415943] CR2: 000076adf7589100 CR3: 000000003deb6000 CR4: 00000000000406e0^M
[2024-06-08 19:56:44] [114153.416871] Kernel panic - not syncing: Fatal exception^M
[2024-06-08 19:56:44] [114153.423006] Kernel Offset: 0x5800000 from 0xffffffff80200000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)^M
Did you try increasing amount of memory assigned to your sys-usb?
sudo qubes-dom0-update --enablerepo=qubes-dom0-current-testing kernel-latest-qubes-vm
I think I only increased the initial memory. Max was at 2GB, so increased to 4GB and will report back. Though I never saw memory use go high, I have seen CPU usage go high in sys-usb before a crash sometimes. (i have 2 VCPUS)
re: Kernel
I noticed I had it set to 6.6.25 for sys-usb, rather than default of 6.6.31. Changed that as well. Will report back.
4GB Max memory and default kernel of 6.6.31 did not help, still crashing regularly on print
You can try kernel-latest-qubes-vm from stable dom0 repository, the kernel there is 6.9.2.
6.9.2 kernel still getting regular crashing now (though at first it seemed to not be crashing, today i’m having to restart sys-usb and reconnect everything after most print jobs)
6.9.10 kernel
After a lot of testing, I’ve found that copying all my files to sys-usb and printing from there does not cause crashing. This is slightly more convenient than having to relaunch sys-usb and reconnect usb devices every time I print something.
Note: sys-usb is a disposable fedora-39
I had to install additional software in order to do my printing from it
Printing direct from sys-usb continues to be crash free. However it is real slow when printing multiple PDF. top shows it is gs that is using 100% cpu for a minute or two before printing begins (and continues slowly). I’m seeing what this person explains here: Why does printing a large number of copies take so long for CUPS to process? - Unix & Linux Stack Exchange
When I print from whonix I do not get the same delays, printing begins before gs kicks in and uses 70% cpu. In both cases I’m printing from evince.
The other thing I’m seeing in sys-usb that is regularly using 45% CPU is
/usr/libexec/packagekitd
I have not correlated either of these to crashes in sys-usb. So not sure if they might be causing the kernel panic error in my first post above.
Good news. Since installing libreoffice and system-config-printer into fedora-39 (the template for sys-usb) I have stopped getting crashes when printing from my whonix workstation. Seems likely the latter was what helped? Unless there was some other package update around the same time that fixed it. But happy to report I haven’t had a crash since then, after many many print jobs.
Note, i useddnf history listqubes-vm-update. I ran:dnf history info 93
Packages Altered:
Install kernel-6.10.4-100.fc39.x86_64 @updates
Install kernel-core-6.10.4-100.fc39.x86_64 @updates
Install kernel-modules-6.10.4-100.fc39.x86_64 @updates
Install kernel-modules-core-6.10.4-100.fc39.x86_64 @updates
Upgrade cups-browsed-1:2.0.0-6.fc39.x86_64 @updates
Upgraded cups-browsed-1:2.0.0-4.fc39.x86_64 @@System
Upgrade eog-45.4-1.fc39.x86_64 @updates
Upgraded eog-45.3-1.fc39.x86_64 @@System
Upgrade hwdata-0.385-1.fc39.noarch @updates
Upgraded hwdata-0.384-1.fc39.noarch @@System
Upgrade libedit-3.1-53.20240808cvs.fc39.x86_64 @updates
Upgraded libedit-3.1-51.20240517cvs.fc39.x86_64 @@System
Upgrade libppd-1:2.0.0-6.fc39.x86_64 @updates
Upgraded libppd-1:2.0.0-4.fc39.x86_64 @@System
Upgrade thunderbird-115.14.0-1.fc39.x86_64 @updates
Upgraded thunderbird-115.13.0-1.fc39.x86_64 @@System
Upgrade thunderbird-librnp-rnp-115.14.0-1.fc39.x86_64 @updates
Upgraded thunderbird-librnp-rnp-115.13.0-1.fc39.x86_64 @@System
Upgrade vim-common-2:9.1.672-1.fc39.x86_64 @updates
Upgraded vim-common-2:9.1.660-1.fc39.x86_64 @@System
Upgrade vim-data-2:9.1.672-1.fc39.noarch @updates
Upgraded vim-data-2:9.1.660-1.fc39.noarch @@System
Upgrade vim-enhanced-2:9.1.672-1.fc39.x86_64 @updates
Upgraded vim-enhanced-2:9.1.660-1.fc39.x86_64 @@System
Upgrade vim-filesystem-2:9.1.672-1.fc39.noarch @updates
Upgraded vim-filesystem-2:9.1.660-1.fc39.noarch @@System
Upgrade xxd-2:9.1.672-1.fc39.x86_64 @updates
Upgraded xxd-2:9.1.660-1.fc39.x86_64 @@System
Reason Change kernel-6.9.12-100.fc39.x86_64 @updates
Removed kernel-6.9.11-100.fc39.x86_64 @@System
Reason Change kernel-core-6.9.12-100.fc39.x86_64 @updates
Removed kernel-core-6.9.11-100.fc39.x86_64 @@System
Reason Change kernel-modules-6.9.12-100.fc39.x86_64 @updates
Removed kernel-modules-6.9.11-100.fc39.x86_64 @@System
Reason Change kernel-modules-core-6.9.12-100.fc39.x86_64 @updates
Removed kernel-modules-core-6.9.11-100.fc39.x86_64 @@System
Aside from kernel upgrades, cups-browsed and libppd are also notable and possibly related to this problem being fixed?
Well, the above didn’t last too long. I’m now getting a slow death of sys-usb when I print. USB devices freeze. qvm-ls shows status of sys-usb as “Dying” for a minute or two until it finally shuts down and all usb devices disconnect.
/var/log/xen/console/guest-sys-usb.log:
[2024-10-01 11:40:44] [ 2656.706341] usbip-host 4-2.1: usb_set_interface done: inf 0 alt 0^M
[2024-10-01 11:40:54] [ 2666.473244] usbip-host 4-2.1: usb_set_interface done: inf 0 alt 1^M
[2024-10-01 11:40:54] [ 2666.489494] usbip-host 4-2.1: usb_set_interface done: inf 0 alt 0^M
[2024-10-01 11:40:54] [ 2666.503460] usbip-host 4-2.1: usb_set_interface done: inf 0 alt 1^M
[2024-10-01 11:40:54] [ 2666.529773] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:40:55] [ 2667.774248] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:40:56] [ 2668.786345] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:40:57] [ 2669.800598] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:40:58] [ 2670.817735] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:40:59] [ 2671.825512] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:41:00] [ 2672.840761] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:41:01] [ 2673.874053] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:41:02] [ 2674.883430] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:41:03] [ 2675.904574] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:41:04] [ 2676.950308] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:41:05] [ 2677.963189] usbip-host 4-2.1: unlinked by a call to usb_unlink_urb()^M
[2024-10-01 11:41:06] [ 2678.978194] BUG: kernel NULL pointer dereference, address: 0000000000000050^M
[2024-10-01 11:41:06] [ 2678.978564] #PF: supervisor read access in kernel mode^M
[2024-10-01 11:41:06] [ 2678.978585] #PF: error_code(0x0000) - not-present page^M
[2024-10-01 11:41:06] [ 2678.978857] PGD 0 P4D 0 ^M
[2024-10-01 11:41:06] [ 2678.978884] Oops: 0000 [#1] PREEMPT SMP NOPTI^M
[2024-10-01 11:41:06] [ 2678.979068] CPU: 2 PID: 1218 Comm: stub_rx Not tainted 6.9.10-1.qubes.fc37.x86_64 #1^M
[2024-10-01 11:41:06] [ 2678.979099] RIP: e030:usb_hcd_unlink_urb+0x71/0xd0^M
[2024-10-01 11:41:06] [ 2678.979463] Code: 41 5c 41 5d e9 e0 29 48 00 4c 89 e7 e8 d8 1b ff ff 48 89 ee 48 c7 c7 b0 45 19 83 e8 39 11 48 00 48 8b 43 40 44 89 ea 48 89 de <48> 8b 78 50 e8 b6 f6 ff ff 89 c5 85 c0 74 0e 83 f8 d5 74 0e 83 f8^M
[2024-10-01 11:41:06] [ 2678.979681] RSP: e02b:ffffc9004058fe58 EFLAGS: 00010286^M
[2024-10-01 11:41:06] [ 2678.979704] RAX: 0000000000000000 RBX: ffff888103f9a0c0 RCX: 0000000000000000^M
[2024-10-01 11:41:06] [ 2678.979727] RDX: 00000000ffffff98 RSI: ffff888103f9a0c0 RDI: ffffffff831945b0^M
[2024-10-01 11:41:06] [ 2678.979746] RBP: ffff888100f802c0 R08: 0000000000000c93 R09: 0000000000000002^M
[2024-10-01 11:41:06] [ 2678.979766] R10: 0000000000000000 R11: ffff888102e53300 R12: ffff88810de2f800^M
[2024-10-01 11:41:06] [ 2678.979785] R13: 00000000ffffff98 R14: ffff888100931294 R15: ffffffffc0604800^M
[2024-10-01 11:41:06] [ 2678.979825] FS: 0000000000000000(0000) GS:ffff888142100000(0000) knlGS:0000000000000000^M
[2024-10-01 11:41:06] [ 2678.979852] CS: e030 DS: 0000 ES: 0000 CR0: 0000000080050033^M
[2024-10-01 11:41:06] [ 2678.979870] CR2: 0000000000000050 CR3: 0000000100b60000 CR4: 0000000000040660^M
[2024-10-01 11:41:06] [ 2678.979893] Call Trace:^M
[2024-10-01 11:41:06] [ 2678.979909] <TASK>^M
[2024-10-01 11:41:06] [ 2678.979927] ? __die+0x23/0x70^M
[2024-10-01 11:41:06] [ 2678.979955] ? page_fault_oops+0x95/0x190^M
[2024-10-01 11:41:06] [ 2678.979978] ? exc_page_fault+0x76/0x170^M
[2024-10-01 11:41:06] [ 2678.980000] ? asm_exc_page_fault+0x26/0x30^M
[2024-10-01 11:41:06] [ 2678.980022] ? __pfx_stub_rx_loop+0x10/0x10 [usbip_host]^M
[2024-10-01 11:41:06] [ 2678.980057] ? usb_hcd_unlink_urb+0x71/0xd0^M
[2024-10-01 11:41:06] [ 2678.980077] ? usb_hcd_unlink_urb+0x67/0xd0^M
[2024-10-01 11:41:06] [ 2678.980096] stub_rx_pdu+0x20d/0x270 [usbip_host]^M
[2024-10-01 11:41:06] [ 2678.980132] stub_rx_loop+0x23/0x40 [usbip_host]^M
[2024-10-01 11:41:06] [ 2678.980343] kthread+0xd2/0x100^M
[2024-10-01 11:41:06] [ 2678.980366] ? __pfx_kthread+0x10/0x10^M
[2024-10-01 11:41:06] [ 2678.980383] ret_from_fork+0x34/0x50^M
[2024-10-01 11:41:06] [ 2678.980404] ? __pfx_kthread+0x10/0x10^M
[2024-10-01 11:41:06] [ 2678.980420] ret_from_fork_asm+0x1a/0x30^M
[2024-10-01 11:41:06] [ 2678.980442] </TASK>^M
[2024-10-01 11:41:06] [ 2678.980452] Modules linked in: usbip_host usbip_core usblp ipt_REJECT nf_reject_ipv4 xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_compat nf_tables nfnetlink joydev crct10dif_pclmul crc32_pclmul crc32c_intel polyval_clmulni xhci_pci polyval_generic ohci_pci xhci_pci_renesas ehci_pci xhci_hcd ehci_hcd ghash_clmulni_intel sha512_ssse3 ohci_hcd sha256_ssse3 sha1_ssse3 pcspkr xen_pcifront xen_scsiback target_core_mod xen_netback xen_privcmd xen_gntdev xen_gntalloc xen_blkback xen_evtchn fuse loop overlay xen_blkfront^M
[2024-10-01 11:41:06] [ 2678.980831] CR2: 0000000000000050^M
[2024-10-01 11:41:06] [ 2678.980849] ---[ end trace 0000000000000000 ]---^M
[2024-10-01 11:41:06] [ 2678.980870] RIP: e030:usb_hcd_unlink_urb+0x71/0xd0^M
[2024-10-01 11:41:06] [ 2678.981060] Code: 41 5c 41 5d e9 e0 29 48 00 4c 89 e7 e8 d8 1b ff ff 48 89 ee 48 c7 c7 b0 45 19 83 e8 39 11 48 00 48 8b 43 40 44 89 ea 48 89 de <48> 8b 78 50 e8 b6 f6 ff ff 89 c5 85 c0 74 0e 83 f8 d5 74 0e 83 f8^M
[2024-10-01 11:41:06] [ 2678.981437] RSP: e02b:ffffc9004058fe58 EFLAGS: 00010286^M
[2024-10-01 11:41:06] [ 2678.981630] RAX: 0000000000000000 RBX: ffff888103f9a0c0 RCX: 0000000000000000^M
[2024-10-01 11:41:06] [ 2678.981653] RDX: 00000000ffffff98 RSI: ffff888103f9a0c0 RDI: ffffffff831945b0^M
[2024-10-01 11:41:06] [ 2678.981673] RBP: ffff888100f802c0 R08: 0000000000000c93 R09: 0000000000000002^M
[2024-10-01 11:41:06] [ 2678.981694] R10: 0000000000000000 R11: ffff888102e53300 R12: ffff88810de2f800^M
[2024-10-01 11:41:06] [ 2678.981877] R13: 00000000ffffff98 R14: ffff888100931294 R15: ffffffffc0604800^M
[2024-10-01 11:41:06] [ 2678.982081] FS: 0000000000000000(0000) GS:ffff888142100000(0000) knlGS:0000000000000000^M
[2024-10-01 11:41:06] [ 2678.982101] CS: e030 DS: 0000 ES: 0000 CR0: 0000000080050033^M
[2024-10-01 11:41:06] [ 2678.982116] CR2: 0000000000000050 CR3: 0000000100b60000 CR4: 0000000000040660^M
[2024-10-01 11:41:06] [ 2678.982136] Kernel panic - not syncing: Fatal exception^M
[2024-10-01 11:41:06] [ 2678.982173] Kernel Offset: disabled^M