I was finally able to access my phone on sys-usb by disabling (unchecking) minimal-usbvm option in sys-usb Qubes Settings > Services. Although, depending on threat models, some should not disable this feature or disable and re-enable after disconnecting the phone. Here is a forum discussion related: