Crashing qubes virtual machines and "input/output error"

waliston · November 9, 2021, 4:27pm

Hi, this is the third time it happened.

I am using qubes and suddenly it close all or some of the initialized virtual qube virtual machines.

The symbols are than absent of the menu in which we can suspend or turn off qubes system.

Also, it can’t accept many command in virtual machines terminal or in qubes terminal: i don’t accept commands like ‘dmesg’, ‘fdisk -h’, ‘nano’. But accept command ‘ls’.

The error after issuing those commands is like:
‘bash: /usr/bin/dmesg: Input/output error’

And than, whin I shut down computer it issue the message “A start job is running for Hold until boot process fisishes up (2min 7s / no limit)” and stay like it (like forever), don’t turning off computer.

Also, It seems my HD is not out of space.

Hi, this is the third time it happened.

I am using qubes and suddenly it close all or some of the initialized virtual qube virtual machines.

The symbols are than absent of the menu in which we can suspend or turn off qubes system.

Also, it can’t accept many command in virtual machines terminal or in qubes terminal: i don’t accept commands like ‘dmesg’, ‘fdisk -h’, ‘nano’. But accept command ‘ls’.

The error after issuing those commands is like:
‘bash: /usr/bin/dmesg: Input/output error’

And than, when I shut down or logoff computer it issue the message “A start job is running for Hold until boot process fisishes up (2min 7s / no limit)” and stay like it (like forever), don’t turning off computer.

Disk usage:

[asdf@dom0 ~]$ qvm-pool -i lvm
name lvm
driver lvm_thin
revisions_to_keep 1
size 877892993024
thin_pool pool00
usage 406903402266
volume_group qubes_dom0

waliston · November 9, 2021, 4:29pm

journalctl (which I can’t understand anything. The error happened before november 08 of 2021 at 20:29. I remember it was around at most 10 minutes before this time:

See output log

[user@disp7438 dom0]$ cat around_20_29_of_09_nov_2021_see_cell_photos_withsudo.txt
-- Logs begin at Sun 2021-05-30 21:13:11 -03, end at Tue 2021-11-09 12:59:18 -02. --
...

Nov 08 20:19:34 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=28230868, total_mem_pref=6353701350.400001, total_available_memory=17256188479.6)
Nov 08 20:19:34 dom0 qmemman.daemon.algo[3719]: left_memory=5446005668 acceptors_count=3
Nov 08 20:19:34 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=28230868, total_mem_pref=6412471168.0, total_available_memory=17197418662.0)
Nov 08 20:19:34 dom0 qmemman.daemon.algo[3719]: left_memory=5496015905 acceptors_count=3
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: stat: dom '9' act=8388608000 pref=3091861094.4 last_target=8388608000
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: stat: dom '0' act=4294967296 pref=1850677734.4 last_target=4294967296
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: stat: dom '6' act=3378313415 pref=430318387.2 last_target=3378313415
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: stat: dom '7' act=4127993072 pref=606137958.4 last_target=4127993072
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: stat: dom '5' act=3391777179 pref=433475993.6 last_target=3391777179
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: stat: xenfree=80659668 memset_reqs=[('7', 4059663175), ('9', 8388608000), ('5', 3424579861), ('0', 4294967296), ('6', 3412965589)]
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: mem-set domain 7 to 4059663175
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: mem-set domain 9 to 8388608000
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: mem-set domain 5 to 3424579861
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: mem-set domain 0 to 4294967296
Nov 08 20:19:34 dom0 qmemman.systemstate[3719]: mem-set domain 6 to 3412965589
Nov 08 20:19:34 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6459153689.599999, total_available_memory=17150729379.400002)
Nov 08 20:19:34 dom0 qmemman.daemon.algo[3719]: left_memory=5535086685 acceptors_count=3
Nov 08 20:19:35 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6505538022.400001, total_available_memory=17104345046.599998)
Nov 08 20:19:35 dom0 qmemman.daemon.algo[3719]: left_memory=5573357625 acceptors_count=3
Nov 08 20:19:35 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6567353625.599999, total_available_memory=17042529443.400002)
Nov 08 20:19:35 dom0 qmemman.daemon.algo[3719]: left_memory=5623520355 acceptors_count=3
Nov 08 20:19:35 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6613764582.400001, total_available_memory=16996118486.599998)
Nov 08 20:19:35 dom0 qmemman.daemon.algo[3719]: left_memory=5660566077 acceptors_count=3
Nov 08 20:19:35 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6682220211.2, total_available_memory=16927662857.8)
Nov 08 20:19:35 dom0 qmemman.daemon.algo[3719]: left_memory=5714268801 acceptors_count=3
Nov 08 20:19:36 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6735090150.400001, total_available_memory=16874792918.599998)
Nov 08 20:19:36 dom0 qmemman.daemon.algo[3719]: left_memory=5754997570 acceptors_count=3
Nov 08 20:19:36 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6776107084.8, total_available_memory=16833775984.2)
Nov 08 20:19:36 dom0 qmemman.daemon.algo[3719]: left_memory=5786157479 acceptors_count=3
Nov 08 20:19:36 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6832145280.0, total_available_memory=16777737789.0)
Nov 08 20:19:36 dom0 qmemman.daemon.algo[3719]: left_memory=5828124047 acceptors_count=3
Nov 08 20:19:36 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6893550873.599999, total_available_memory=16716332195.400002)
Nov 08 20:19:36 dom0 qmemman.daemon.algo[3719]: left_memory=5873326763 acceptors_count=3
Nov 08 20:19:37 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=6958076800.0, total_available_memory=16651806269.0)
Nov 08 20:19:37 dom0 qmemman.daemon.algo[3719]: left_memory=5919966781 acceptors_count=3
Nov 08 20:19:37 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7000728448.0, total_available_memory=16609154621.0)
Nov 08 20:19:37 dom0 qmemman.daemon.algo[3719]: left_memory=5950323864 acceptors_count=3
Nov 08 20:19:37 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7054205414.400001, total_available_memory=16555677654.599998)
Nov 08 20:19:37 dom0 qmemman.daemon.algo[3719]: left_memory=5987867134 acceptors_count=3
Nov 08 20:19:38 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7097091353.599999, total_available_memory=16512791715.400002)
Nov 08 20:19:38 dom0 qmemman.daemon.algo[3719]: left_memory=6017566222 acceptors_count=3
Nov 08 20:19:38 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7141281868.8, total_available_memory=16468601200.2)
Nov 08 20:19:38 dom0 qmemman.daemon.algo[3719]: left_memory=6047795596 acceptors_count=3
Nov 08 20:19:39 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7189694950.400001, total_available_memory=16420188118.599998)
Nov 08 20:19:39 dom0 qmemman.daemon.algo[3719]: left_memory=6080486939 acceptors_count=3
Nov 08 20:19:40 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7230647987.2, total_available_memory=16379235081.8)
Nov 08 20:19:40 dom0 qmemman.daemon.algo[3719]: left_memory=6107799039 acceptors_count=3
Nov 08 20:19:41 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7173241318.400001, total_available_memory=16436641750.599998)
Nov 08 20:19:41 dom0 qmemman.daemon.algo[3719]: left_memory=6069425986 acceptors_count=3
Nov 08 20:19:41 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7217666124.8, total_available_memory=16392216944.2)
Nov 08 20:19:41 dom0 qmemman.daemon.algo[3719]: left_memory=6099174822 acceptors_count=3
Nov 08 20:19:42 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7259226188.8, total_available_memory=16350656880.2)
Nov 08 20:19:42 dom0 qmemman.daemon.algo[3719]: left_memory=6126675649 acceptors_count=3
Nov 08 20:19:43 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7303603072.0, total_available_memory=16306279997.0)
Nov 08 20:19:43 dom0 qmemman.daemon.algo[3719]: left_memory=6155694885 acceptors_count=3
Nov 08 20:19:44 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7348219571.2, total_available_memory=16261663497.8)
Nov 08 20:19:44 dom0 qmemman.daemon.algo[3719]: left_memory=6184517467 acceptors_count=3
Nov 08 20:19:45 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7280599936.0, total_available_memory=16329283133.0)
Nov 08 20:19:45 dom0 qmemman.daemon.algo[3719]: left_memory=6140696677 acceptors_count=3
Nov 08 20:19:46 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7324156800.0, total_available_memory=16285726269.0)
Nov 08 20:19:46 dom0 qmemman.daemon.algo[3719]: left_memory=6169016366 acceptors_count=3
Nov 08 20:19:46 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7365892582.400001, total_available_memory=16243990486.599998)
Nov 08 20:19:46 dom0 qmemman.daemon.algo[3719]: left_memory=6195837813 acceptors_count=3
Nov 08 20:19:48 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7298768153.599999, total_available_memory=16311114915.400002)
Nov 08 20:19:48 dom0 qmemman.daemon.algo[3719]: left_memory=6152550332 acceptors_count=3
Nov 08 20:19:49 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7239151692.8, total_available_memory=16370731376.2)
Nov 08 20:19:49 dom0 qmemman.daemon.algo[3719]: left_memory=6113431523 acceptors_count=3
Nov 08 20:19:50 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7279588224.0, total_available_memory=16330294845.0)
Nov 08 20:19:50 dom0 qmemman.daemon.algo[3719]: left_memory=6140034857 acceptors_count=3
Nov 08 20:19:51 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7320557235.2, total_available_memory=16289325833.8)
Nov 08 20:19:51 dom0 qmemman.daemon.algo[3719]: left_memory=6166688784 acceptors_count=3
Nov 08 20:19:52 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7362335616.0, total_available_memory=16247547453.0)
Nov 08 20:19:52 dom0 qmemman.daemon.algo[3719]: left_memory=6193563787 acceptors_count=3
Nov 08 20:19:55 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7407292902.400001, total_available_memory=16202590166.599998)
Nov 08 20:19:55 dom0 qmemman.daemon.algo[3719]: left_memory=6222145064 acceptors_count=3
Nov 08 20:19:56 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7452628249.599999, total_available_memory=16157254819.400002)
Nov 08 20:19:56 dom0 qmemman.daemon.algo[3719]: left_memory=6250617501 acceptors_count=3
Nov 08 20:19:58 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7492761267.2, total_available_memory=16117121801.8)
Nov 08 20:19:58 dom0 qmemman.daemon.algo[3719]: left_memory=6275535154 acceptors_count=3
Nov 08 20:19:59 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7537388416.0, total_available_memory=16072494653.0)
Nov 08 20:19:59 dom0 qmemman.daemon.algo[3719]: left_memory=6302931524 acceptors_count=3
Nov 08 20:19:59 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7491728256.0, total_available_memory=16118154813.0)
Nov 08 20:19:59 dom0 qmemman.daemon.algo[3719]: left_memory=6274897129 acceptors_count=3
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7450727296.0, total_available_memory=16159155773.0)
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: left_memory=6249430585 acceptors_count=3
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7380871244.8, total_available_memory=16229011824.2)
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: left_memory=6205389866 acceptors_count=3
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7424012774.400001, total_available_memory=16185870294.599998)
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: left_memory=6232686297 acceptors_count=3
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7367814835.2, total_available_memory=16242068233.8)
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: left_memory=6197065827 acceptors_count=3
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7312266521.599999, total_available_memory=16297616547.400002)
Nov 08 20:20:00 dom0 qmemman.daemon.algo[3719]: left_memory=6161319055 acceptors_count=3
Nov 08 20:20:04 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7245227289.599999, total_available_memory=16364655779.400002)
Nov 08 20:20:04 dom0 qmemman.daemon.algo[3719]: left_memory=6117447637 acceptors_count=3
Nov 08 20:20:07 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7204338150.400001, total_available_memory=16405544918.599998)
Nov 08 20:20:07 dom0 qmemman.daemon.algo[3719]: left_memory=6090288339 acceptors_count=3
Nov 08 20:20:10 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7259801267.2, total_available_memory=16350081801.8)
Nov 08 20:20:10 dom0 qmemman.daemon.algo[3719]: left_memory=6127053978 acceptors_count=3
Nov 08 20:20:11 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7301143014.4, total_available_memory=16308740054.599998)
Nov 08 20:20:11 dom0 qmemman.daemon.algo[3719]: left_memory=6154095424 acceptors_count=3
Nov 08 20:20:11 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7232186854.4, total_available_memory=16377696214.599998)
Nov 08 20:20:11 dom0 qmemman.daemon.algo[3719]: left_memory=6108819299 acceptors_count=3
Nov 08 20:20:12 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7179897318.4, total_available_memory=16429985750.599998)
Nov 08 20:20:12 dom0 qmemman.daemon.algo[3719]: left_memory=6073906587 acceptors_count=3
Nov 08 20:20:13 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7232346598.4, total_available_memory=16377536470.599998)
Nov 08 20:20:13 dom0 qmemman.daemon.algo[3719]: left_memory=6108925184 acceptors_count=3
Nov 08 20:20:13 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7273651072.0, total_available_memory=16336231997.0)
Nov 08 20:20:13 dom0 qmemman.daemon.algo[3719]: left_memory=6136147311 acceptors_count=3
Nov 08 20:20:13 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7328885222.4, total_available_memory=16280997846.599998)
Nov 08 20:20:13 dom0 qmemman.daemon.algo[3719]: left_memory=6172070425 acceptors_count=3
Nov 08 20:20:15 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7419209804.8, total_available_memory=16190673264.2)
Nov 08 20:20:15 dom0 qmemman.daemon.algo[3719]: left_memory=6229663074 acceptors_count=3
Nov 08 20:20:15 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7477638835.2, total_available_memory=16132244233.8)
Nov 08 20:20:15 dom0 qmemman.daemon.algo[3719]: left_memory=6266177394 acceptors_count=3
Nov 08 20:20:16 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7524145638.4, total_available_memory=16085737430.599998)
Nov 08 20:20:16 dom0 qmemman.daemon.algo[3719]: left_memory=6294835763 acceptors_count=3
Nov 08 20:20:17 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29099148, total_mem_pref=7564970880.0, total_available_memory=16044912189.0)
Nov 08 20:20:17 dom0 qmemman.daemon.algo[3719]: left_memory=6319702625 acceptors_count=3
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: stat: dom '9' act=8388608000 pref=4203019059.2000003 last_target=8388608000
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: stat: dom '0' act=4294967296 pref=1892019481.6000001 last_target=4294967296
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: stat: dom '6' act=3412965589 pref=430318387.2 last_target=3412965589
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: stat: dom '7' act=4059663175 pref=606137958.4 last_target=4059663175
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: stat: dom '5' act=3424579861 pref=433475993.6 last_target=3424579861
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: stat: xenfree=81527948 memset_reqs=[('7', 3994294484), ('9', 8388608000), ('5', 3455964286), ('0', 4294967296), ('6', 3446119415)]
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: mem-set domain 7 to 3994294484
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: mem-set domain 9 to 8388608000
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: mem-set domain 5 to 3455964286
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: mem-set domain 0 to 4294967296
Nov 08 20:20:17 dom0 qmemman.systemstate[3719]: mem-set domain 6 to 3446119415
Nov 08 20:20:19 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29923144, total_mem_pref=7605705600.0, total_available_memory=16004171025.0)
Nov 08 20:20:19 dom0 qmemman.daemon.algo[3719]: left_memory=6344243086 acceptors_count=3
Nov 08 20:20:19 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29923144, total_mem_pref=7543586483.2, total_available_memory=16066290141.8)
Nov 08 20:20:19 dom0 qmemman.daemon.algo[3719]: left_memory=6306705665 acceptors_count=3
Nov 08 20:20:21 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29923144, total_mem_pref=7485397068.8, total_available_memory=16124479556.2)
Nov 08 20:20:21 dom0 qmemman.daemon.algo[3719]: left_memory=6270977738 acceptors_count=3
Nov 08 20:20:22 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29923144, total_mem_pref=7526009318.4, total_available_memory=16083867306.599998)
Nov 08 20:20:22 dom0 qmemman.daemon.algo[3719]: left_memory=6295971637 acceptors_count=3
Nov 08 20:20:23 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29923144, total_mem_pref=7576349977.6, total_available_memory=16033526647.4)
Nov 08 20:20:23 dom0 qmemman.daemon.algo[3719]: left_memory=6326580744 acceptors_count=3
Nov 08 20:20:24 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29923144, total_mem_pref=7509736729.6, total_available_memory=16100139895.4)
Nov 08 20:20:24 dom0 qmemman.daemon.algo[3719]: left_memory=6285989495 acceptors_count=3
Nov 08 20:20:25 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29923144, total_mem_pref=7553911270.400001, total_available_memory=16055965354.599998)
Nov 08 20:20:25 dom0 qmemman.daemon.algo[3719]: left_memory=6312987520 acceptors_count=3
Nov 08 20:20:26 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29922065, total_mem_pref=7595860044.8, total_available_memory=16014015501.2)
Nov 08 20:20:26 dom0 qmemman.daemon.algo[3719]: left_memory=6338333675 acceptors_count=3
Nov 08 20:20:26 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29922065, total_mem_pref=7510024268.8, total_available_memory=16099851277.2)
Nov 08 20:20:26 dom0 qmemman.daemon.algo[3719]: left_memory=6286165389 acceptors_count=3
Nov 08 20:20:26 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29922065, total_mem_pref=7439119232.0, total_available_memory=16170756314.0)
Nov 08 20:20:26 dom0 qmemman.daemon.algo[3719]: left_memory=6242163557 acceptors_count=3
Nov 08 20:20:29 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29922065, total_mem_pref=7481478016.0, total_available_memory=16128397530.0)
Nov 08 20:20:29 dom0 qmemman.daemon.algo[3719]: left_memory=6268550623 acceptors_count=3
Nov 08 20:20:29 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29922065, total_mem_pref=7413863705.6, total_available_memory=16196011840.4)
Nov 08 20:20:29 dom0 qmemman.daemon.algo[3719]: left_memory=6226287347 acceptors_count=3
Nov 08 20:20:30 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29922065, total_mem_pref=7344508185.6, total_available_memory=16265367360.4)
Nov 08 20:20:30 dom0 qmemman.daemon.algo[3719]: left_memory=6182127226 acceptors_count=3
Nov 08 20:20:30 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29922065, total_mem_pref=7293075942.4, total_available_memory=16316799603.599998)
Nov 08 20:20:30 dom0 qmemman.daemon.algo[3719]: left_memory=6148836863 acceptors_count=3
Nov 08 20:20:35 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29922065, total_mem_pref=7200669363.2, total_available_memory=16409206182.8)
Nov 08 20:20:35 dom0 qmemman.daemon.algo[3719]: left_memory=6087830404 acceptors_count=3
Nov 08 20:20:40 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7248118656.0, total_available_memory=16361754858.0)
Nov 08 20:20:40 dom0 qmemman.daemon.algo[3719]: left_memory=6119348924 acceptors_count=3
Nov 08 20:20:46 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7179322240.0, total_available_memory=16430551274.0)
Nov 08 20:20:46 dom0 qmemman.daemon.algo[3719]: left_memory=6073512200 acceptors_count=3
Nov 08 20:21:06 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7136649292.8, total_available_memory=16473224221.2)
Nov 08 20:21:06 dom0 qmemman.daemon.algo[3719]: left_memory=6044636579 acceptors_count=3
Nov 08 20:21:25 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7190893030.4, total_available_memory=16418980483.599998)
Nov 08 20:21:25 dom0 qmemman.daemon.algo[3719]: left_memory=6081282777 acceptors_count=3
Nov 08 20:21:29 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7253752294.4, total_available_memory=16356121219.599998)
Nov 08 20:21:29 dom0 qmemman.daemon.algo[3719]: left_memory=6123063912 acceptors_count=3
Nov 08 20:21:30 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7207463808.0, total_available_memory=16402409706.0)
Nov 08 20:21:30 dom0 qmemman.daemon.algo[3719]: left_memory=6092367736 acceptors_count=3
Nov 08 20:21:33 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7254428544.0, total_available_memory=16355444970.0)
Nov 08 20:21:33 dom0 qmemman.daemon.algo[3719]: left_memory=6123509464 acceptors_count=3
Nov 08 20:21:33 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7339497548.8, total_available_memory=16270375965.2)
Nov 08 20:21:33 dom0 qmemman.daemon.algo[3719]: left_memory=6178902900 acceptors_count=3
Nov 08 20:21:34 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7383001164.8, total_available_memory=16226872349.2)
Nov 08 20:21:34 dom0 qmemman.daemon.algo[3719]: left_memory=6206737346 acceptors_count=3
Nov 08 20:21:37 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7430338636.8, total_available_memory=16179534877.2)
Nov 08 20:21:37 dom0 qmemman.daemon.algo[3719]: left_memory=6236654482 acceptors_count=3
Nov 08 20:21:37 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7475413068.8, total_available_memory=16134460445.2)
Nov 08 20:21:37 dom0 qmemman.daemon.algo[3719]: left_memory=6264789224 acceptors_count=3
Nov 08 20:21:37 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7520258534.4, total_available_memory=16089614979.599998)
Nov 08 20:21:37 dom0 qmemman.daemon.algo[3719]: left_memory=6292446351 acceptors_count=3
Nov 08 20:21:38 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7564928281.6, total_available_memory=16044945232.4)
Nov 08 20:21:38 dom0 qmemman.daemon.algo[3719]: left_memory=6319669127 acceptors_count=3
Nov 08 20:21:39 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7604992076.8, total_available_memory=16004881437.2)
Nov 08 20:21:39 dom0 qmemman.daemon.algo[3719]: left_memory=6343812892 acceptors_count=3
Nov 08 20:21:39 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7650859904.0, total_available_memory=15959013610.0)
Nov 08 20:21:39 dom0 qmemman.daemon.algo[3719]: left_memory=6371143900 acceptors_count=3
Nov 08 20:21:42 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7706221849.6, total_available_memory=15903651664.4)
Nov 08 20:21:42 dom0 qmemman.daemon.algo[3719]: left_memory=6403698778 acceptors_count=3
Nov 08 20:21:42 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7752419814.400001, total_available_memory=15857453699.599998)
Nov 08 20:21:42 dom0 qmemman.daemon.algo[3719]: left_memory=6430509009 acceptors_count=3
Nov 08 20:21:44 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7797440998.400001, total_available_memory=15812432515.599998)
Nov 08 20:21:44 dom0 qmemman.daemon.algo[3719]: left_memory=6456330661 acceptors_count=3
Nov 08 20:21:47 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7734427315.200001, total_available_memory=15875446198.8)
Nov 08 20:21:47 dom0 qmemman.daemon.algo[3719]: left_memory=6420105436 acceptors_count=3
Nov 08 20:21:51 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7693011020.8, total_available_memory=15916862493.2)
Nov 08 20:21:51 dom0 qmemman.daemon.algo[3719]: left_memory=6395972886 acceptors_count=3
Nov 08 20:21:56 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7757323955.200001, total_available_memory=15852549558.8)
Nov 08 20:21:56 dom0 qmemman.daemon.algo[3719]: left_memory=6433336298 acceptors_count=3
Nov 08 20:22:01 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7715827788.8, total_available_memory=15894045725.2)
Nov 08 20:22:01 dom0 qmemman.daemon.algo[3719]: left_memory=6409299865 acceptors_count=3
Nov 08 20:22:10 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7674954624.0, total_available_memory=15934918890.0)
Nov 08 20:22:10 dom0 qmemman.daemon.algo[3719]: left_memory=6385370211 acceptors_count=3
Nov 08 20:22:20 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7749704166.400001, total_available_memory=15860169347.599998)
Nov 08 20:22:20 dom0 qmemman.daemon.algo[3719]: left_memory=6428941870 acceptors_count=3
Nov 08 20:22:26 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7679651097.6, total_available_memory=15930222416.4)
Nov 08 20:22:26 dom0 qmemman.daemon.algo[3719]: left_memory=6388132767 acceptors_count=3
Nov 08 20:22:37 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7636663987.2, total_available_memory=15973209526.8)
Nov 08 20:22:37 dom0 qmemman.daemon.algo[3719]: left_memory=6362720140 acceptors_count=3
Nov 08 20:22:47 dom0 qmemman.daemon.algo[3719]: balance_when_enough_memory(xen_free_memory=29920033, total_mem_pref=7676621286.400001, total_available_memory=15933252227.599998)
-- Reboot --
Nov 09 09:54:29 dom0 systemd-journald[246]: Runtime journal (/run/log/journal/) is 8.0M, max 195.4M, 187.4M free.
Nov 09 09:54:29 dom0 kernel: Linux version 5.4.143-1.fc25.qubes.x86_64 (mockbuild@) (gcc version 6.4.1 20170727 (Red Hat 6.4.1-1) (GCC)) #1 SMP Fri Aug 27 01:18:08 CEST 2021
Nov 09 09:54:29 dom0 kernel: Command line: placeholder root=/dev/mapper/qubes_dom0-root ro rd.luks.uuid=luks-2b88e3ed-0d04-40f8-

fsflover · November 9, 2021, 4:35pm

How about the space in the qubes and their templates?

waliston · November 9, 2021, 4:50pm

Thinks for help.

If df -h is sufficient to get the information:

df -h
Filesystem      Size  Used Avail Use% Mounted on
/dev/xvda3      9.6G  7.1G  2.1G  78% /
none            9.6G  7.1G  2.1G  78% /usr/lib/modules
devtmpfs        1.9G     0  1.9G   0% /dev
tmpfs           1.0G     0  1.0G   0% /dev/shm
tmpfs           151M  2.6M  149M   2% /run
tmpfs           5.0M     0  5.0M   0% /run/lock
tmpfs           151M     0  151M   0% /sys/fs/cgroup
/dev/xvdb        15G  6.6G  8.2G  45% /rw
tmpfs            31M   12K   31M   1% /run/user/1000

The other qubes has similar results to this. No line at colum Use% is higher than 90%.

I have journalctl that i issued today if it helps.

waliston · November 9, 2021, 5:35pm

It happened again right now. I am posting journalctl in case it helps:

See the journalctl log

Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 298, in print_stats
Nov 09 15:27:51 dom0 qmemmand[2979]: Message: "stat: dom '10' act=3673833109 pref=1189927731.2 last_target=3673833109"
Nov 09 15:27:51 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:51 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:51 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:51 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:51 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:51 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:51 dom0 qmemman.systemstate[2979]: stat: dom '7' act=8388608000 pref=1923110092.8 last_target=8388608000
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 316, in do_balance
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 298, in print_stats
Nov 09 15:27:51 dom0 qmemmand[2979]: Message: "stat: dom '5' act=1519476276 pref=426053222.40000004 last_target=1519476276"
Nov 09 15:27:51 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:51 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:51 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:51 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:51 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:51 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 316, in do_balance
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 298, in print_stats
Nov 09 15:27:51 dom0 qmemmand[2979]: Message: "stat: dom '6' act=1538533540 pref=432810393.6 last_target=1538533540"
Nov 09 15:27:51 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:51 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:51 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:51 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:51 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:51 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:51 dom0 qmemman.systemstate[2979]: stat: xenfree=75735214 memset_reqs=[('7', 6652421515), ('0', 4294967296), ('6', 1787835942), ('9', 1869578931), ('15', 2839892367), ('10', 4259192596), ('5', 1765779414)]
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 316, in do_balance
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 298, in print_stats
Nov 09 15:27:51 dom0 qmemmand[2979]: Message: "stat: dom '7' act=8388608000 pref=1923110092.8 last_target=8388608000"
Nov 09 15:27:51 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:51 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:51 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:51 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:51 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:51 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 316, in do_balance
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 300, in print_stats
Nov 09 15:27:51 dom0 qmemmand[2979]: Message: "stat: xenfree=75735214 memset_reqs=[('7', 6652421515), ('0', 4294967296), ('6', 1787835942), ('9', 1869578931), ('15', 2839892367), ('10', 4259192596), ('5', 1765779414)]"
Nov 09 15:27:51 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:51 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:51 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:51 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:51 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:51 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:51 dom0 qmemman.systemstate[2979]: mem-set domain 7 to 6652421515
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 364, in do_balance
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 164, in mem_set
Nov 09 15:27:51 dom0 qmemmand[2979]: Message: 'mem-set domain 7 to 6652421515'
Nov 09 15:27:51 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:51 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:51 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:51 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:51 dom0 qmemman.systemstate[2979]: mem-set domain 0 to 4294967296
Nov 09 15:27:51 dom0 qmemman.systemstate[2979]: mem-set domain 6 to 1787835942
Nov 09 15:27:51 dom0 qmemman.systemstate[2979]: mem-set domain 9 to 1869578931
Nov 09 15:27:51 dom0 qmemman.systemstate[2979]: mem-set domain 15 to 2839892367
Nov 09 15:27:52 dom0 qmemman.systemstate[2979]: mem-set domain 10 to 4259192596
Nov 09 15:27:52 dom0 qmemman.systemstate[2979]: mem-set domain 5 to 1765779414
Nov 09 15:27:52 dom0 qmemman.daemon.algo[2979]: balance_when_enough_memory(xen_free_memory=21794265, total_mem_pref=6300756864.0, total_available_memory=17190705462.0)
Nov 09 15:27:52 dom0 qmemman.daemon.algo[2979]: left_memory=3176325699 acceptors_count=6
Nov 09 15:27:52 dom0 qmemman.systemstate[2979]: stat: dom '0' act=4294967296 pref=2005916953.6000001 last_target=4294967296
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:52 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:52 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:52 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 364, in do_balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 164, in mem_set
Nov 09 15:27:52 dom0 qmemmand[2979]: Message: 'mem-set domain 0 to 4294967296'
Nov 09 15:27:52 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:52 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:52 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:52 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:52 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:52 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 364, in do_balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 164, in mem_set
Nov 09 15:27:52 dom0 qmemmand[2979]: Message: 'mem-set domain 6 to 1787835942'
Nov 09 15:27:52 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:52 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:52 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:52 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:52 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:52 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 364, in do_balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 164, in mem_set
Nov 09 15:27:52 dom0 qmemmand[2979]: Message: 'mem-set domain 9 to 1869578931'
Nov 09 15:27:52 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:52 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:52 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:52 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:52 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:52 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 364, in do_balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 164, in mem_set
Nov 09 15:27:52 dom0 qmemmand[2979]: Message: 'mem-set domain 15 to 2839892367'
Nov 09 15:27:52 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:52 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:52 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:52 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:52 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:52 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:52 dom0 qmemman.systemstate[2979]: stat: dom '15' act=2839892367 pref=755115212.8000001 last_target=2839892367
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 364, in do_balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 164, in mem_set
Nov 09 15:27:52 dom0 qmemmand[2979]: Message: 'mem-set domain 10 to 4259192596'
Nov 09 15:27:52 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:52 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:52 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:52 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:52 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:52 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 364, in do_balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 164, in mem_set
Nov 09 15:27:52 dom0 qmemmand[2979]: Message: 'mem-set domain 5 to 1765779414'
Nov 09 15:27:52 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:52 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:52 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:52 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:52 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:52 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:52 dom0 qmemman.systemstate[2979]: stat: dom '9' act=1869578931 pref=457852928.0 last_target=1869578931
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 312, in do_balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/algo.py", line 317, in balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/algo.py", line 175, in balance_when_enough_memory
Nov 09 15:27:52 dom0 qmemmand[2979]: Message: 'balance_when_enough_memory(xen_free_memory=21794265, total_mem_pref=6300756864.0, total_available_memory=17190705462.0)'
Nov 09 15:27:52 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:52 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:52 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:52 dom0 qmemmand[2979]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:52 dom0 qmemmand[2979]: Call stack:
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/bin/qmemmand", line 5, in <module>
Nov 09 15:27:52 dom0 qmemmand[2979]:     sys.exit(main())
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 310, in main
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 173, in watch_loop
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qmemmand.py", line 159, in meminfo_changed
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 252, in refresh_meminfo
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/__init__.py", line 312, in do_balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/algo.py", line 317, in balance
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib/python3.5/site-packages/qubes/qmemman/algo.py", line 203, in balance_when_enough_memory
Nov 09 15:27:52 dom0 qmemmand[2979]: Message: 'left_memory=3176325699 acceptors_count=6'
Nov 09 15:27:52 dom0 qmemmand[2979]: Arguments: ()
Nov 09 15:27:52 dom0 qmemmand[2979]: --- Logging error ---
Nov 09 15:27:52 dom0 qmemmand[2979]: Traceback (most recent call last):
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:52 dom0 qmemmand[2979]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:53 dom0 qmemman.systemstate[2979]: dom '7' still hold more memory than have assigned (4834349056 > 4376697745)
Nov 09 15:27:53 dom0 xenconsoled[3066]: Write to log failed on domain 7: 30 (Read-only file system)
Nov 09 15:27:53 dom0 xenconsoled[3066]: Write to log failed on domain 7: 30 (Read-only file system)
Nov 09 15:27:54 dom0 xenconsoled[3066]: Write to log failed on domain 5: 30 (Read-only file system)
Nov 09 15:27:54 dom0 xenconsoled[3066]: Write to log failed on domain 5: 30 (Read-only file system)
Nov 09 15:27:55 dom0 qubesd[3039]: --- Logging error ---
Nov 09 15:27:55 dom0 qubesd[3039]: Traceback (most recent call last):
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:55 dom0 qubesd[3039]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:55 dom0 qubesd[3039]: Call stack:
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/bin/qubesd", line 5, in <module>
Nov 09 15:27:55 dom0 qubesd[3039]:     sys.exit(main())
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qubesd.py", line 63, in main
Nov 09 15:27:55 dom0 qubesd[3039]:     loop.run_forever()
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/base_events.py", line 421, in run_forever
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/base_events.py", line 1425, in _run_once
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/events.py", line 127, in _run
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/tasks.py", line 240, in _step
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/coroutines.py", line 210, in coro
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/api/admin.py", line 629, in pool_info
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 189, in usage
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 820, in refresh_cache
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 809, in reset_cache
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 229, in init_cache
Nov 09 15:27:55 dom0 qubesd[3039]: Message: b'  Failed to parse thin params: Error.\n'
Nov 09 15:27:55 dom0 qubesd[3039]: Arguments: ()
Nov 09 15:27:55 dom0 qubesd[3039]: --- Logging error ---
Nov 09 15:27:55 dom0 qubesd[3039]: Traceback (most recent call last):
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/vm/qubesvm.py", line 1178, in on_domain_stopped
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/__init__.py", line 618, in stop
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/utils.py", line 206, in void_coros_maybe
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/futures.py", line 294, in result
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/tasks.py", line 240, in _step
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/__init__.py", line 175, in wrapper
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 661, in stop
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 406, in _commit
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 805, in qubes_lvm_coro
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 771, in _process_lvm_output
Nov 09 15:27:55 dom0 qubesd[3039]: qubes.storage.StoragePoolException:   Cannot archive volume group metadata for qubes_dom0 to read-only filesystem.
Nov 09 15:27:55 dom0 qubesd[3039]: During handling of the above exception, another exception occurred:
Nov 09 15:27:55 dom0 qubesd[3039]: Traceback (most recent call last):
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/logging/__init__.py", line 990, in emit
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/logging/__init__.py", line 970, in flush
Nov 09 15:27:55 dom0 qubesd[3039]: OSError: [Errno 30] Read-only file system
Nov 09 15:27:55 dom0 qubesd[3039]: Call stack:
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/bin/qubesd", line 5, in <module>
Nov 09 15:27:55 dom0 qubesd[3039]:     sys.exit(main())
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/tools/qubesd.py", line 63, in main
Nov 09 15:27:55 dom0 qubesd[3039]:     loop.run_forever()
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/base_events.py", line 421, in run_forever
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/base_events.py", line 1425, in _run_once
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/events.py", line 127, in _run
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/tasks.py", line 321, in _wakeup
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/tasks.py", line 240, in _step
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/vm/qubesvm.py", line 1181, in on_domain_stopped
Nov 09 15:27:55 dom0 qubesd[3039]: Message: 'Failed to stop storage for domain %s'
Nov 09 15:27:55 dom0 qubesd[3039]: Arguments: ('UFSJ',)
Nov 09 15:27:55 dom0 qubesd[3039]: Failed to stop storage for domain UFSJ
Nov 09 15:27:55 dom0 qubesd[3039]: Traceback (most recent call last):
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/vm/qubesvm.py", line 1178, in on_domain_stopped
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/__init__.py", line 618, in stop
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/utils.py", line 206, in void_coros_maybe
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/futures.py", line 294, in result
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib64/python3.5/asyncio/tasks.py", line 240, in _step
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/__init__.py", line 175, in wrapper
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 661, in stop
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 406, in _commit
Nov 09 15:27:55 dom0 dbus-daemon[5994]: [session uid=1000 pid=5994] Activating via systemd: service name='org.freedesktop.Notifications' unit='xfce4-notifyd.service' requested by ':1.29' (uid=1000 pid=6079 comm="/usr/bin/python3 /usr/bin/qui-domains ")
Nov 09 15:27:55 dom0 systemd[5973]: Starting XFCE notifications service...
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 805, in qubes_lvm_coro
Nov 09 15:27:55 dom0 qubesd[3039]:   File "/usr/lib/python3.5/site-packages/qubes/storage/lvm.py", line 771, in _process_lvm_output
Nov 09 15:27:55 dom0 qubesd[3039]: qubes.storage.StoragePoolException:   Cannot archive volume group metadata for qubes_dom0 to read-only filesystem.
Nov 09 15:27:55 dom0 dbus-daemon[5994]: [session uid=1000 pid=5994] Successfully activated service 'org.freedesktop.Notifications'
Nov 09 15:27:55 dom0 systemd[5973]: Started XFCE notifications service.
Nov 09 15:27:56 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
Nov 09 15:27:56 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
Nov 09 15:27:56 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
Nov 09 15:27:56 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)

.
.
.

Nov 09 15:28:02 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
Nov 09 15:28:03 dom0 qrexec[6644]: qubes.WindowIconUpdater: UFSJ -> dom0: denied: qrexec-client failed
Nov 09 15:28:03 dom0 systemd-journald[1170]: Suppressed 453 messages from /system.slice/qubes-qmemman.service
Nov 09 15:28:03 dom0 qmemman.daemon.algo[2979]: balance_when_enough_memory(xen_free_memory=30083720, total_mem_pref=6249031756.8, total_available_memory=17253706490.199997)
Nov 09 15:28:03 dom0 qmemman.daemon.algo[2979]: left_memory=3047439076 acceptors_count=6
Nov 09 15:28:11 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
Nov 09 15:28:11 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
Nov 09 15:28:11 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
Nov 09 15:28:11 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
Nov 09 15:28:11 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
Nov 09 15:28:11 dom0 xenconsoled[3066]: Write to log failed on domain 10: 30 (Read-only file system)
.
.
.

deeplow · November 10, 2021, 7:53am

@waliston I’ve added some formatting to your posts so they are more readable.

waliston · November 10, 2021, 4:06pm

Thank you. I will try to use the formatting next time.