External Keyboard in selected AppVMs but *not* dom0

I use Qubes OS 4.1.0-rc2 on a laptop. I want to use an external keyboard (connected via USB). This seems to have security risk especially if the keyboard has access to dom0. So to to balance security with convenience I’m thinking of using the external keyboard in all (or at least some) AppVMs but not in dom0. How can I achieve this without manually adding the keyboard from sys-usb to individual AppVMs all the time?