But this should not stop you from your idea, because I still believe is interesting and legit, while not necessarily increasing threat level of your system.
On the contrary, it very much reminds on the next step in Qubes evolution (whatever my concerns would be about it)