NVidia + Sys-USB = Disaster

Did you try to figure out if the issue is caused by some specific USB controller?