I would be concerned because there's higher chance of undesirable epigenetic changes(faulty gene expression)..and success rate for frozen eggs is low(it's better for frozen embryos)..I chose to stop short HRT(2 months T),and after unsuccessful chemical pregnancy..I concieved again and got healthy baby boy..
The best option would be that you go off hormones,wait few months and try to concieve.
I've read stories in which sister or female relative was egg donor,or even father helped infertile son..all kind of strange stories that ended with success,and that's most important..