I have right out explained that little quirk of clothing to a dozen or so people at one point or another more women than men in fact and none of them had any idea. I work in a deli and we have to wear chef coats which can be button either way and I sometimes point out to people that the men and women tend to button them opposite to each other. I then have to explain to them why they do it that way.
so I think the odds of someone even realizing is low and the odds of someone thinking your trans because of your buttons is almost zero. I wore nail polish, pink sneakers, and braided my long ass hair for a long time and people still didn't guess trans, though I think about 70% of the people I know assumed I was gay, Jokes on them I am sorta, I like women so.
Serena