Accessing a Puri.sm Librem Key

This sounds like the issue I had with my Yubikey.
Did you make a sys-usb (USB Qubes)?