S3 Suspend works on stock Fedora 37 but not Qubes 4.1 or 4.2 (fc37)

Tested a LiveUSB of Fedora 37 on my X1 Carbon 10th gen, S3 suspend works.

On Qubes 4.1.1 (Fedora 32 dom0), the machine suspends but does not resume and needs to be power cycled.

Also reproduced issue on Qubes 4.2 weekly builds which run Fedora 37 in Dom0.

Speculating this is a Qubes issue not a Fedora issue as Qubes 4.2 weekly signed build also fails to suspend to S3.

On Fedora 37, cat /sys/power/state shows mem freeze disk
On Qubes 4.2 shows freeze mem

This Ubuntu debugging guide seems too low level, doubt its a kernel issue,more likely driver / firmwarer? DebuggingKernelSuspend - Ubuntu Wiki

Appreciate any help with finding the correct process to find the issue.

Fedora 37 Live

cat /proc/cmdline
BOOT_IMAGE=/images/pxeboot/vmlinuz root=live:CDLABEL=Fedora-WS-Live-37-1-7 rd.live.image rd.live.check quiet
uname -a
Linux localhost-live 6.0.7-301.fc37.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Nov 4 18:35:48 UTC 2022 x86_64 x86_64 x86_64 GNU/Linux
lsmod

Module                  Size  Used by
uinput                 20480  0
rfcomm                 94208  4
snd_seq_dummy          16384  0
snd_hrtimer            16384  1
nft_objref             16384  1
nf_conntrack_netbios_ns    16384  1
nf_conntrack_broadcast    16384  1 nf_conntrack_netbios_ns
nft_fib_inet           16384  1
nft_fib_ipv4           16384  1 nft_fib_inet
nft_fib_ipv6           16384  1 nft_fib_inet
nft_fib                16384  3 nft_fib_ipv6,nft_fib_ipv4,nft_fib_inet
nft_reject_inet        16384  6
nf_reject_ipv4         16384  1 nft_reject_inet
nf_reject_ipv6         20480  1 nft_reject_inet
nft_reject             16384  1 nft_reject_inet
nft_ct                 20480  16
nft_chain_nat          16384  3
nf_nat                 57344  1 nft_chain_nat
nf_conntrack          167936  4 nf_nat,nft_ct,nf_conntrack_netbios_ns,nf_conntrack_broadcast
nf_defrag_ipv6         24576  1 nf_conntrack
nf_defrag_ipv4         16384  1 nf_conntrack
ip_set                 61440  0
nf_tables             286720  237 nft_ct,nft_reject_inet,nft_fib_ipv6,nft_objref,nft_fib_ipv4,nft_chain_nat,nft_reject,nft_fib,nft_fib_inet
nfnetlink              20480  3 nf_tables,ip_set
qrtr                   53248  4
bnep                   28672  2
snd_ctl_led            24576  0
snd_soc_skl_hda_dsp    24576  5
snd_soc_intel_hda_dsp_common    20480  1 snd_soc_skl_hda_dsp
snd_soc_hdac_hdmi      45056  1 snd_soc_skl_hda_dsp
snd_sof_probes         24576  0
mei_pxp                20480  0
snd_soc_dmic           16384  1
mei_hdcp               24576  0
mei_wdt                16384  0
iTCO_wdt               16384  0
pmt_telemetry          16384  0
intel_rapl_msr         20480  0
intel_pmc_bxt          16384  1 iTCO_wdt
pmt_class              16384  1 pmt_telemetry
iTCO_vendor_support    16384  1 iTCO_wdt
intel_tcc_cooling      16384  0
x86_pkg_temp_thermal    20480  0
intel_powerclamp       20480  0
coretemp               20480  0
kvm_intel             389120  0
kvm                  1118208  1 kvm_intel
irqbypass              16384  1 kvm
rapl                   20480  0
intel_cstate           20480  0
intel_uncore          217088  0
snd_hda_codec_hdmi     86016  1
snd_hda_codec_realtek   172032  1
pcspkr                 16384  0
think_lmi              36864  0
snd_hda_codec_generic    98304  1 snd_hda_codec_realtek
firmware_attributes_class    16384  1 think_lmi
wmi_bmof               16384  0
uvcvideo              163840  0
videobuf2_vmalloc      20480  1 uvcvideo
btusb                  65536  0
videobuf2_memops       20480  1 videobuf2_vmalloc
videobuf2_v4l2         40960  1 uvcvideo
btrtl                  28672  1 btusb
videobuf2_common       86016  4 videobuf2_vmalloc,videobuf2_v4l2,uvcvideo,videobuf2_memops
btbcm                  24576  1 btusb
btintel                49152  1 btusb
videodev              311296  3 videobuf2_v4l2,uvcvideo,videobuf2_common
btmtk                  16384  1 btusb
idma64                 20480  0
joydev                 28672  0
mc                     69632  4 videodev,videobuf2_v4l2,uvcvideo,videobuf2_common
bluetooth             880640  36 btrtl,btmtk,btintel,btbcm,bnep,btusb,rfcomm
thinkpad_acpi         180224  0
ledtrig_audio          16384  3 snd_ctl_led,snd_hda_codec_generic,thinkpad_acpi
platform_profile       16384  1 thinkpad_acpi
int3403_thermal        20480  0
soc_button_array       20480  0
intel_hid              28672  0
int3400_thermal        20480  0
sparse_keymap          16384  1 intel_hid
acpi_thermal_rel       16384  1 int3400_thermal
acpi_tad               16384  0
snd_sof_pci_intel_tgl    16384  0
acpi_pad              184320  0
snd_sof_intel_hda_common   176128  1 snd_sof_pci_intel_tgl
soundwire_intel        53248  1 snd_sof_intel_hda_common
soundwire_generic_allocation    16384  1 soundwire_intel
soundwire_cadence      45056  1 soundwire_intel
snd_sof_intel_hda      20480  1 snd_sof_intel_hda_common
snd_sof_pci            24576  2 snd_sof_intel_hda_common,snd_sof_pci_intel_tgl
snd_sof_xtensa_dsp     20480  1 snd_sof_intel_hda_common
snd_sof               311296  3 snd_sof_pci,snd_sof_intel_hda_common,snd_sof_probes
snd_sof_utils          20480  1 snd_sof
snd_soc_hdac_hda       28672  1 snd_sof_intel_hda_common
snd_hda_ext_core       36864  4 snd_sof_intel_hda_common,snd_soc_hdac_hdmi,snd_soc_hdac_hda,snd_sof_intel_hda
snd_soc_acpi_intel_match    73728  2 snd_sof_intel_hda_common,snd_sof_pci_intel_tgl
snd_soc_acpi           16384  2 snd_soc_acpi_intel_match,snd_sof_intel_hda_common
soundwire_bus         126976  3 soundwire_intel,soundwire_generic_allocation,soundwire_cadence
iwlmvm                520192  0
snd_soc_core          389120  8 soundwire_intel,snd_sof,snd_sof_intel_hda_common,snd_soc_hdac_hdmi,snd_soc_hdac_hda,snd_sof_probes,snd_soc_dmic,snd_soc_skl_hda_dsp
snd_compress           28672  2 snd_soc_core,snd_sof_probes
ac97_bus               16384  1 snd_soc_core
snd_pcm_dmaengine      16384  1 snd_soc_core
snd_hda_intel          61440  0
mac80211             1282048  1 iwlmvm
snd_intel_dspcfg       36864  3 snd_hda_intel,snd_sof,snd_sof_intel_hda_common
snd_intel_sdw_acpi     20480  2 snd_sof_intel_hda_common,snd_intel_dspcfg
snd_hda_codec         184320  7 snd_hda_codec_generic,snd_hda_codec_hdmi,snd_hda_intel,snd_hda_codec_realtek,snd_soc_intel_hda_dsp_common,snd_soc_hdac_hda,snd_soc_skl_hda_dsp
libarc4                16384  1 mac80211
i915                 3112960  4
snd_hda_core          114688  11 snd_hda_codec_generic,snd_hda_codec_hdmi,snd_hda_intel,snd_hda_ext_core,snd_hda_codec,snd_hda_codec_realtek,snd_soc_intel_hda_dsp_common,snd_sof_intel_hda_common,snd_soc_hdac_hdmi,snd_soc_hdac_hda,snd_sof_intel_hda
snd_hwdep              16384  1 snd_hda_codec
snd_seq                94208  7 snd_seq_dummy
snd_seq_device         16384  1 snd_seq
drm_buddy              20480  1 i915
iwlwifi               413696  1 iwlmvm
ttm                    94208  1 i915
snd_pcm               151552  12 snd_hda_codec_hdmi,snd_hda_intel,snd_hda_codec,soundwire_intel,snd_sof,snd_sof_intel_hda_common,snd_soc_hdac_hdmi,snd_compress,snd_soc_core,snd_sof_utils,snd_hda_core,snd_pcm_dmaengine
processor_thermal_device_pci    16384  0
drm_display_helper    180224  1 i915
snd_timer              49152  3 snd_seq,snd_hrtimer,snd_pcm
processor_thermal_device    20480  1 processor_thermal_device_pci
processor_thermal_rfim    16384  1 processor_thermal_device
snd                   126976  28 snd_ctl_led,snd_hda_codec_generic,snd_seq,snd_seq_device,snd_hda_codec_hdmi,snd_hwdep,snd_hda_intel,snd_hda_codec,snd_hda_codec_realtek,snd_sof,snd_timer,snd_soc_hdac_hdmi,snd_compress,thinkpad_acpi,snd_soc_core,snd_pcm
processor_thermal_mbox    16384  2 processor_thermal_rfim,processor_thermal_device
cec                    81920  2 drm_display_helper,i915
processor_thermal_rapl    20480  1 processor_thermal_device
soundcore              16384  2 snd_ctl_led,snd
cfg80211             1097728  3 iwlmvm,iwlwifi,mac80211
intel_rapl_common      32768  2 intel_rapl_msr,processor_thermal_rapl
mei_me                 53248  3
int340x_thermal_zone    20480  2 int3403_thermal,processor_thermal_device
intel_vsec             20480  0
i2c_i801               40960  0
mei                   167936  7 mei_wdt,mei_hdcp,mei_pxp,mei_me
rfkill                 36864  10 iwlmvm,bluetooth,thinkpad_acpi,cfg80211
i2c_smbus              20480  1 i2c_i801
igen6_edac             32768  0
zram                   36864  2
isofs                  61440  1
squashfs               86016  1
nvme                   61440  0
nvme_core             192512  1 nvme
uas                    32768  0
hid_multitouch         32768  0
ucsi_acpi              16384  0
crct10dif_pclmul       16384  1
crc32_pclmul           16384  0
crc32c_intel           24576  2
polyval_clmulni        16384  0
thunderbolt           393216  0
polyval_generic        16384  1 polyval_clmulni
typec_ucsi             53248  1 ucsi_acpi
usb_storage            81920  2 uas
ghash_clmulni_intel    16384  0
serio_raw              20480  0
typec                  90112  1 typec_ucsi
nvme_common            24576  1 nvme_core
wmi                    45056  2 wmi_bmof,think_lmi
i2c_hid_acpi           16384  0
i2c_hid                40960  1 i2c_hid_acpi
video                  65536  2 thinkpad_acpi,i915
pinctrl_tigerlake      32768  0
sunrpc                692224  1
be2iscsi              180224  0
bnx2i                  69632  0
cnic                   73728  1 bnx2i
uio                    32768  1 cnic
cxgb4i                 69632  0
cxgb4                 602112  1 cxgb4i
tls                   126976  1 cxgb4
cxgb3i                 49152  0
cxgb3                 208896  1 cxgb3i
mdio                   16384  1 cxgb3
libcxgbi               98304  2 cxgb4i,cxgb3i
libcxgb                32768  2 libcxgbi,cxgb3i
qla4xxx               438272  0
iscsi_boot_sysfs       20480  2 be2iscsi,qla4xxx
iscsi_tcp              32768  0
libiscsi_tcp           36864  4 libcxgbi,iscsi_tcp,cxgb4i,cxgb3i
libiscsi               86016  8 be2iscsi,libiscsi_tcp,bnx2i,libcxgbi,iscsi_tcp,qla4xxx,cxgb4i,cxgb3i
scsi_transport_iscsi   155648  7 be2iscsi,libiscsi_tcp,bnx2i,libcxgbi,iscsi_tcp,qla4xxx,libiscsi
loop                   36864  7
ip6_tables             36864  0
ip_tables              36864  0
fuse                  176128  3

dmesg

[  396.162068] IPv6: ADDRCONF(NETDEV_CHANGE): wlp0s20f3: link becomes ready
[  409.992862] systemd-journald[1125]: Time jumped backwards, rotating.
[  966.693389] PM: suspend entry (deep)
[  966.694250] Filesystems sync: 0.000 seconds
[  966.726308] Freezing user space processes ... (elapsed 0.001 seconds) done.
[  966.727757] OOM killer disabled.
[  966.727758] Freezing remaining freezable tasks ... (elapsed 0.001 seconds) done.
[  966.728918] printk: Suspending console(s) (use no_console_suspend to debug)
[  967.153421] PM: suspend devices took 0.424 seconds
[  967.196241] ACPI: EC: interrupt blocked
[  967.221135] ACPI: PM: Preparing to enter system sleep state S3
[  967.236814] ACPI: EC: event blocked
[  967.236815] ACPI: EC: EC stopped
[  967.236816] ACPI: PM: Saving platform NVS memory
[  967.236942] Disabling non-boot CPUs ...
[  967.239339] smpboot: CPU 1 is now offline
[  967.243920] smpboot: CPU 2 is now offline
[  967.248066] smpboot: CPU 3 is now offline
[  967.250218] smpboot: CPU 4 is now offline
[  967.253361] smpboot: CPU 5 is now offline
[  967.255711] smpboot: CPU 6 is now offline
[  967.259073] smpboot: CPU 7 is now offline
[  967.261518] smpboot: CPU 8 is now offline
[  967.264921] smpboot: CPU 9 is now offline
[  967.267392] smpboot: CPU 10 is now offline
[  967.270219] smpboot: CPU 11 is now offline
[  967.272340] smpboot: CPU 12 is now offline
[  967.274564] smpboot: CPU 13 is now offline
[  967.276851] smpboot: CPU 14 is now offline
[  967.278918] smpboot: CPU 15 is now offline
[  967.285278] ACPI: PM: Low-level resume complete
[  967.285493] ACPI: EC: EC started
[  967.285494] ACPI: PM: Restoring platform NVS memory
[  967.287246] Enabling non-boot CPUs ...
[  967.287289] x86: Booting SMP configuration:
[  967.287289] smpboot: Booting Node 0 Processor 1 APIC 0x1
[  967.289517] CPU1 is up
[  967.289542] smpboot: Booting Node 0 Processor 2 APIC 0x8
[  967.291717] CPU2 is up
[  967.291764] smpboot: Booting Node 0 Processor 3 APIC 0x9
[  967.293688] CPU3 is up
[  967.293713] smpboot: Booting Node 0 Processor 4 APIC 0x10
[  967.296390] CPU4 is up
[  967.296458] smpboot: Booting Node 0 Processor 5 APIC 0x11
[  967.299090] CPU5 is up
[  967.299111] smpboot: Booting Node 0 Processor 6 APIC 0x18
[  967.301882] CPU6 is up
[  967.301922] smpboot: Booting Node 0 Processor 7 APIC 0x19
[  967.304216] CPU7 is up
[  967.304266] smpboot: Booting Node 0 Processor 8 APIC 0x20
[  967.306763] core: cpu_atom PMU driver: PEBS-via-PT 
[  967.306768] ... version:                5
[  967.306770] ... bit width:              48
[  967.306770] ... generic registers:      6
[  967.306771] ... value mask:             0000ffffffffffff
[  967.306772] ... max period:             00007fffffffffff
[  967.306773] ... fixed-purpose events:   3
[  967.306774] ... event mask:             000000070000003f
[  967.307700] CPU8 is up
[  967.307766] smpboot: Booting Node 0 Processor 9 APIC 0x22
[  967.311256] CPU9 is up
[  967.311308] smpboot: Booting Node 0 Processor 10 APIC 0x24
[  967.315156] CPU10 is up
[  967.315185] smpboot: Booting Node 0 Processor 11 APIC 0x26
[  967.319064] CPU11 is up
[  967.319114] smpboot: Booting Node 0 Processor 12 APIC 0x28
[  967.323169] CPU12 is up
[  967.323195] smpboot: Booting Node 0 Processor 13 APIC 0x2a
[  967.327102] CPU13 is up
[  967.327128] smpboot: Booting Node 0 Processor 14 APIC 0x2c
[  967.331140] CPU14 is up
[  967.331187] smpboot: Booting Node 0 Processor 15 APIC 0x2e
[  967.335245] CPU15 is up
[  967.338643] ACPI: PM: Waking up from system sleep state S3
[  967.388591] ACPI: EC: interrupt unblocked
[  967.545388] ACPI: EC: event unblocked
[  967.553127] i915 0000:00:02.0: [drm] GuC firmware i915/adlp_guc_70.1.1.bin version 70.1
[  967.553130] i915 0000:00:02.0: [drm] HuC firmware i915/tgl_huc_7.9.3.bin version 7.9
[  967.554172] xhci_hcd 0000:00:0d.0: xHC error in resume, USBSTS 0x401, Reinit
[  967.554176] usb usb1: root hub lost power or was reset
[  967.554177] usb usb2: root hub lost power or was reset
[  967.564677] nvme nvme0: 16/0/0 default/read/poll queues
[  967.566820] i915 0000:00:02.0: [drm] HuC authenticated
[  967.567197] i915 0000:00:02.0: [drm] GuC submission enabled
[  967.567200] i915 0000:00:02.0: [drm] GuC SLPC enabled
[  967.567880] i915 0000:00:02.0: [drm] GuC RC: enabled
[  967.841654] usb 3-8: reset high-speed USB device number 4 using xhci_hcd
[  968.091336] usb 3-7: reset high-speed USB device number 3 using xhci_hcd
[  968.221965] PM: resume devices took 0.677 seconds
[  968.222002] OOM killer enabled.
[  968.222003] Restarting tasks ... 
[  968.222187] usb 3-6: USB disconnect, device number 2
[  968.223396] done.
[  968.223406] random: crng reseeded on system resumption
[  968.227069] mei_hdcp 0000:00:16.0-b638ab7e-94e2-4ea2-a552-d1c54b627f04: bound 0000:00:02.0 (ops i915_hdcp_component_ops [i915])
[  968.230429] mei_pxp 0000:00:16.0-fbf6fcf1-96cf-4e2e-a6a6-1bab8cbe36b1: bound 0000:00:02.0 (ops i915_pxp_tee_component_ops [i915])
[  968.336116] usb 3-6: new full-speed USB device number 6 using xhci_hcd
[  968.411660] PM: suspend exit

rpm -qa|grep firmware

linux-firmware-whence-20220913-140.fc37.noarch
amd-gpu-firmware-20220913-140.fc37.noarch
intel-gpu-firmware-20220913-140.fc37.noarch
iwlax2xx-firmware-20220913-140.fc37.noarch
iwl7260-firmware-25.30.13.0-140.fc37.noarch
nvidia-gpu-firmware-20220913-140.fc37.noarch
linux-firmware-20220913-140.fc37.noarch
iwl100-firmware-39.31.5.1-140.fc37.noarch
iwl1000-firmware-39.31.5.1-140.fc37.noarch
iwl105-firmware-18.168.6.1-140.fc37.noarch
iwl135-firmware-18.168.6.1-140.fc37.noarch
iwl2000-firmware-18.168.6.1-140.fc37.noarch
iwl2030-firmware-18.168.6.1-140.fc37.noarch
iwl3160-firmware-25.30.13.0-140.fc37.noarch
iwl3945-firmware-15.32.2.9-140.fc37.noarch
iwl4965-firmware-228.61.2.24-140.fc37.noarch
iwl5000-firmware-8.83.5.1_1-140.fc37.noarch
iwl5150-firmware-8.24.2.2-140.fc37.noarch
iwl6000-firmware-9.221.4.1-140.fc37.noarch
iwl6000g2a-firmware-18.168.6.1-140.fc37.noarch
iwl6000g2b-firmware-18.168.6.1-140.fc37.noarch
iwl6050-firmware-41.28.5.1-140.fc37.noarch
libertas-usb8388-firmware-20220913-140.fc37.noarch
zd1211-firmware-1.5-11.fc37.noarch
atmel-firmware-1.3-27.fc37.noarch
alsa-sof-firmware-2.2.2-1.fc37.noarch

Strange. Kernel, firmware is newer on Qubes 4.2 than Fedora 37 Live yet Qubes fails to resume from suspend. Xen issue?

running dmesg > old ; echo mem | sudo tee /sys/power/state ; dmesg > new never creates a new, so I can’t see what goes wrong when it tries to resume.

Out of ideas.

This advice in the docs didn’t work Suspend/resume troubleshooting | Qubes OS

On some devices suspend-to-RAM does not work and a hard power-off is needed to recover, because the system does not go into deep sleep. To get suspend to work, you need to add mem_sleep_default=deep kernel option. For legacy boot, or UEFI/legacy in R4.1+, add it to the GRUB_CMDLINE_LINUX setting in /etc/default/grub, update the grub config, and reboot. In R4.0 with UEFI boot, you need to add it to every kernel= line in /boot/efi/EFI/qubes/xen.cfg and reboot.

Could it be this?

I’m trying to use S3, not S0ix / modern sleep. I wasn’t able to follow all the technical implications of the issue. How could I test whetherr this issue is relevant?

The BIOS option is set to Linux S3 Sleep.

qvm-shutdown --all before attempting suspend made no difference.
Have searched the forums and mailing lists and tried all the suggestions.

Does anyone know why 4.2 is so different to a stock FC37 that it would affect suspend? Anything I can check?

Diff the qubes kernel against vanilla fedora?

Interestingly, following the kernel power management debugging guide linked from here:
https://01.org/blogs/rzhang/2015/best-practice-debug-linux-suspend/hibernate-issues

https://www.kernel.org/doc/Documentation/power/basic-pm-debugging.txt

a) Test modes of hibernation

To find out why hibernation fails on your system, you can use a special testing
facility available if the kernel is compiled with CONFIG_PM_DEBUG set. Then,
there is the file /sys/power/pm_test that can be used to make the hibernation
core run in a test mode. There are 5 test modes available:

freezer

  • test the freezing of processes

devices

  • test the freezing of processes and suspending of devices

platform

  • test the freezing of processes, suspending of devices and platform
    global control methods(*)

processors

  • test the freezing of processes, suspending of devices, platform
    global control methods(*) and the disabling of nonboot CPUs

core

  • test the freezing of processes, suspending of devices, platform global
    control methods(*), the disabling of nonboot CPUs and suspending of
    platform/system devices

This resulted in successful test suspend / resume for echoing each of freezer devices platform processors and core .

1 Like

Next steps seem to be booting into runlevel 1 and suspending from there, if it works, then perform a binary search to see which of the loaded kernel modules could be causing an issue.

Not sure I follow…diff the whole kernel source?

Suspend 2 RAM from runlevel 1 fails in the same way as when Qubes fully loaded

1 Like

Only as a last resort. In patches, there’s more often than not developer comments

// leaving this here because enabling this flag causes a kernel panic
program HelloWorld;
{$APPTYPE CONSOLE}

begin
    WriteLn('Hello World');
end.

which might “jump out” at you regarding power management.

Solution: Install Kernel 6.0.7 in Dom0 (works in both 4.1 and 4.2)

dom0$ qubes-dom0-update kernel-6.0.7 (in 4.2 /fc 37)

(note that qubes kernel-latest is newer and doesn’t work, so something in newer kernels breaks suspend)

For Qubes 4.1 (fc32)

The package exists
https://ftp.qubes-os.org/repo/yum/r4.1/current-testing/dom0/fc32/rpm/kernel-latest-6.0.7-1.fc32.qubes.x86_64.rpm

but won’t install when I run

sudo qubes-dom-update --releasever=4.1 --enablerepo=qubes-dom0-currrent-testing kernel-latest-6.0.7

“unable to find a match”

I pulled it manually, moved to dom0 and ran dnf install

Props to @cayce for suggesting the right answer

1 Like

Thanks ! I’m not (yet) an advanced user…

So on 4.1 + Fedora 37, got the error “unable to find a match: kernel-6.0.1” as you describe it.

I pulled it manually, moved to dom0 and ran dnf install

@BenT Can you just explain how to pull it manually ? And then install it via dnf install ? I uploaded it (thank to you post) but wasn’t able to move the .rpm file to Dom0 from an internet connected AppVM. I’m fearing doing wrong things there…

One way to move files between Qubes (from a shell in dom0) is:

… and if you want the file to stay in dom0, you should be able pipe it to a file there:

qvm-run --pass-io sourceVM 'cat file' > filename_in_dom0

:slight_smile:

Great. That works now. I can suspend and resume the session. Thanks also to @ChrisA for helping in pulling the package back to Dom0.

I now need to fix a new issue as I cannot enter the session password in ScreenSaver when resuming. Will do some search on the forum.

2 Likes