You might have a look at this guide:
As alternative install host-based application firewall OpenSnitch, if you want something GUI-based and no extra proxy qube. OpenSnitch might as well be installed in a proxy and can control all connections of qubes, which have this proxy as netvm.