I wouldn't take anyone's picture without asking for their permission. I'm very clear with my boundaries.
I think there used to be a time when it wasn't acceptable to publish someone's picture without their consent. Remember Glamour magazine's Do and Don't fashion column? All if the faces were edited out.