I am 5'10'' now and I was 5'10'' almost 30 years ago when I had SRS while in my early 20s. I started estrogen on and off since I was 15 years old as supply permitted. 3 years prior to SRS I was on HRT full time and have never quit. I ditto some in this thread, that it seems extremely improbable that ones height would change as a result of HRT.
As far as height, I think you draw more negative attention by trying to hide it and less if carry yourself proudly. Easier said than done, but it can be done.