Check out this post of mine: (I managed to run an nvidia 4090 in an HVM). But my setup was a bit different than yours so it might not work.
I had luck with Manjaro booted with proprietary Nvidia graphics and then integrated with the Qubes tools. I’ll make a guide on it once it’s stabilized.