Oh, dear. What is wrong with these people? Your weight is not excessive for your height. In fact, depending on your frame, I would be inclined to say that you might be a little underweight.
I know that the skinny model look is "in" these days, but if people are commenting on a five-pound weight gain when you are that tall, they need to get a life. Then again, it's possible that they're just being mean. Girls in particular like to play the "did you gain weight" game, even when their target is too thin. It's mean and vile and stupid.
In your case--are you on HRT now?--if your body is changing, then it will look different to people, and they might comment about it. But the way they're doing it smacks of something else.
If I were you, I would be irritated, too.