It sounds like beard shadow is your big obstacle, all right. At this point, I'd really, really suggest finding some way to get facial hair removal. Yes, it's quite expensive, but if you browse around the forum here you'll find lots of tips for minimizing the cost. For instance, laser treatments are cheaper than electrolysis, so you want to have laser first and just do the other to take care of anything that remains (lighter hairs, usually). While not recommended by the manuf. for the face, there are reasonably priced DIY laser devices that have been used successfully, too (again, it's in the forum posts).
If you're two years into HRT, you're obviously aiming for the long term, so hair removal may be you next big step.