I've lived in 3 different countries for periods of some years each, and have visited many more countries for 'some week to some months' each.
Sad that in some parts of the world there is so much fear about 'street photography'- and indeed even aggression when a photographer is around with his / her camera in hand. I have researched the laws in various countries and know my rights. I also am an official photographer for events (eg some sports events, church events, youth camps, official openings, etc)
Thankfully I've never been threatened, or felt very harrassed. I am naturally a friendly, smiley guy. But stereotypes are difficult, as I'm a non-married middle aged male - so if I'm alone (eg on a beach) some people might think I'm there to capture photos of unsuspecting people ... for sinister purposes, which is far from the truth! :/ Usually though when I'm at the beach I'm with friends - so that does feel 'easier' if I have my camera then, and especially if they have their phones and/or cameras out too!
Only once (about 5 or 6 years ago) when I was photographing crashing waves on quite a remote beach, did one young surfer (read about 20?) stop surfing and come to me and ask if I was taking photos of him and his mates. I said I wasn't, I was capturing the waves and landscape. He asked me not to take photos of them. I responded in a friendly manner: "No worries mate, as I said I wasn't doing that and I won't take any photos of you". However that was the only exception.
When I travelled to Thailand, for example - I used my 7D with 15-85mm most of the time, especially around people (only using my L white glass less often). I was very thankful to note the friendly and open nature of the Thai people I met. I usually started conversations with people first anyway - that's just my nature.
But I know from various parts of the world - and for some - religion also has an impact on this - photography is much more difficult and threatening. While I prefer visiting 'friendly / safe' places - if in an area of 'photography vulnerability' - I'd probably not take so many photos, and no where there is a feeling people don't like it.
Paul (now in Australia)