I only take photos without explicit permission if it's clear that people are pulling a crazy stunt in the hopes of getting on Youtube or something.

If it's just someone wearing an interesting costume (gothic lolita, for example), I'll ask if I can take a picture.

Otherwise, I don't take photos of strangers.