I am planning to go up on Friday for the day. Had been planning to go on Saturday, but I need to renew a professional certification that I have, and Saturday is the only weekend class they have available for months. I have met and spoken with several folks who will be presenting, and the lineup of sessions this year looks really good.
You are probably thinking too much into it

The conference is free and open to anyone. There are a lot of folks from the medical field there who are not even remotely trans-identified. It's in a center where most of Philly's trans folks go for HRT. Safe place. There are plenty of folks who are pre-everything, genderqueer, or otherwise ambiguous. Nobody will bother you.
I would say, click through the conference schedule online and make sure there are enough sessions that interest you that you are the intended audience for, before you commit to going.