I totally get it. My wife actually thinks I'm exercising too much and eating too healthy. I don't feel like I'm doing enough. Yeah, I want to lose weight before I start HRT, but I was over 350 lbs! I needed to lose weight to live! Before I came out, I didn't care if I lived.
Family thinks they are helping, but they just don't always understand. I told my dad I wanted to travel more, and he said "you don't need to transition to do that!" Well, duh! But now I have the desire and confidence.
Good luck and hugs!