Back when I was into cross dressing, I thought the same thing, I was just a guy in drag.  However, there were a couple of occasions when someone mentioned they thought I actually was a woman.  However, there have been many times over the years when I've looked at a cis woman and thought she was a man.  So, there's no hard line in there.