Not at all, Col
If you open a door for someone and they are offended by that act, it's not sexual harassment on your part, it's impolite on their part.
I've had people complain once or twice. I shrug my shoulders, walk through the door, and let it close in their face. Karma...