If your HRT is correctly dosed, you shouldn't be actually developing more of a beard. Now your blood levels might not be very good, but if they are, there's no worry, really.
I have them too. My mother does, as well. ^^' The annoying thing with those is that due to proximity to the eye and thinness, you can't really laser them. Extra electro for you, maybe, eh.
So, make sure your testosterone is dead and not coming back. If that's all right, don't worry; you'll just have to take care of it.