Where to look

I am somewhat disturbed by people who have some sort of oddity, such as a squint or a facial disfigurement. I feel awkward because I don't know where to look. I don't mean to be offensive or upsetting to people with such afflictions, but I probably come across that way. But then, at the best of times, wearing glasses can make you feel rude because I don't quite feel I'm with people if I can't see them properly. It's like having an invisibility cloak; apart from the fact that I don't become invisible when everything is blurred (so it's not much like it at all, apart from the feel of it).