I feel there are certain things we can't change. The male skeleton is a bit different, hip width and angle differs, elbows hinge a little differently. Hands and feet tend to be a bit bigger. Facial hair needs to dealt with and a voice once dropped doesn't go back. Men tend to be taller and wider shoulders. If you transitioned a bit later the pattern of hair growth will differ due to hair loss. That being said why worry about the things you can't change when there are many things you CAN change?
Also, male or female being comfortable in your own skin makes life 1000% better. I know there are things people pick up on and you know what? It doesn't matter. I'm me if people see me as trans or female.

The easiest way to create dysphoria is to worry about things that you can't change.
Also, consider this... How many different shapes of cis females are there out there? We all fit in there somewhere!