Samantha : Yeah, honestly, it sounds like he's taking the standard cis woman's recommendations to heart - they need to take Vagifem with progesterone to avoid uterine cancer. But again, that shouldn't be an issue for anyone without a uterus (including a cis woman with a hysterectomy)... If I were you, I'd ask him to clarify where he was getting this info from.
Vagifem actually does have a warning to this effect in the US, but it also specifies what type of cancer is a risk. Possibly that's not the case where you are, so he's confused b/c he didn't dig deeper into the studies (which isn't a criticism, any doctor who DID chase down every nitpicky detail of everything wouldn't have time to practice!).