Could it be that you're afraid of the power inside you to go down the same path and the uncertainty associated with it?
Or could it be the opposite - that you're afraid you won't measure up and be able to achieve what they achieved?
I've certainly felt the same thing, especially with very feminine trans women when I get the feeling I could never be as much a woman as they are.