Sometimes it's the sort of thing that's a conversation-starter. Whether you're intending it or not, it tells more about who you are, and more information gives them another reason to talk to you. Sometimes it's flat-out curiosity, sometimes there's something fascinating about your presentation, sometimes it's a sentimental thing where they're rooting for you (and they will probably do this with respect to other types of life challenges), and sometimes it's something where they've had a related story in their life that may have gone well (and they may feel they have something to share) or gone not-so-well (in which case they may be proud of you and/or they may be looking for advice).
I think if you're worried about other people only looking at the TG part of you, go ahead and talk about a lot of non-TG stuff that you care about or that is happening in your life, or some topics you know the other people have some interest in. If they're able to engage on something else, I think you'll be alright. If they aren't, you might have to discreetly nudge them in that direction.
