Mouse interaction with Windows based HVMs

I have an issue with mouse input on all of my Windows HVMs. It is really hard for me to reproduce it since I don’t know what exactly triggers the issue, but after some time of using said VMs, my mouse stops working in their respected window, while keyboard input works normally. Issue doesn’t persist upon reboot, so that is my current way of dealing with it on some windows qubes, but that’s not an option for the HVM to which a graphics card is passthrough, since rebooting requires complete shutdown due to GPU reset bug.

Has anyone encountered similar issue and would anyone know a way to troubleshoot said problem?