Mellanox Connectx-3

Hello,
please give me some advice to get a connectx-3 card working in a hvm instance.
I always get the following messages and so no interface comes up:
Feb 20 12:13:16 mellanox kernel: mlx4_core 0000:00:06.0: DMFS high rate steer mode is: disabled performance optimized steering
Feb 20 12:13:16 mellanox kernel: mlx4_core 0000:00:06.0: 31.504 Gb/s available PCIe bandwidth, limited by 8.0 GT/s PCIe x4 link at 0000:00:06.0 (capable of 63.008 Gb/s with 8.0 GT/s PCIe x8 link)

Feb 20 12:13:20 mellanox systemd[1]: Started Update time from ClockVM.
Feb 20 12:13:20 mellanox systemd[1]: qubes-sync-time.service: Deactivated successfully.
Feb 20 12:13:20 mellanox systemd-journald[297]: Time jumped backwards, rotating.
Feb 20 12:14:10 mellanox systemd-udevd[326]: 0000:00:06.0: Worker [407] processing SEQNUM=1739 is taking a long time
Feb 20 12:14:18 mellanox kernel: mlx4_core 0000:00:06.0: command 0x23 timed out (go bit not cleared)
Feb 20 12:14:18 mellanox kernel: mlx4_core 0000:00:06.0: device is going to be reset
Feb 20 12:14:18 mellanox kernel: mlx4_core 0000:00:06.0: crdump: devlink snapshot disabled, skipping
Feb 20 12:14:19 mellanox kernel: mlx4_core 0000:00:06.0: device was reset successfully
Feb 20 12:14:19 mellanox kernel: mlx4_core 0000:00:06.0: Failed to initialize queue pair table, aborting
Feb 20 12:14:20 mellanox kernel: mlx4_core: probe of 0000:00:06.0 failed with error -5

Thanks a lot :wink:

I’ve tried this already with the default sys-net (Fedora 34) based and also with a gentoo based app vm.
These were always HVM’s.
It is working with PV app-vm’s.

The Host is based on qubes 4.1.
If there is not a hint for a solution for a HVM based app vm, then i will use PV for a while.