NVIDIA Graphics Driver Installed Cannot Open Application Windows

So following this guide:

I managed to pass-through my GPU to a Fedora standalone HVM. The VM will work normally but only before installing the NVIDIA graphics driver. Afterwards, no applications will open and I can only access the VM via SSH.

Any help would be appreciated