I think you are right that it may cause problems to your privacy. Have a look at this related discussion: