I am not understanding exactly what stage you have got to, but if the hardware PCI device is available in a VM then maybe this recent thread could help.
I did see you mentioned immediate reboot when you start the VM. It can happen if there are other devices in the same IOMMU group which have not been passed through. There are other possible causes though.