Once HRT has finished with a Transwoman they are unlikely to be stronger than most cis-women anyway, and won't have the experience of the other players in traditionally female sports to have any advantage.
Likewise a Transman will rarely be as large as cis-male players, and also lack match experience which would be a definite disadvantage in contact sports, so I can't see it being an issue in real life.
Maybe the issue of whether Hormones are performance enhancing drugs is more important.