I'd just add, the term is "emasculating" in this context.
And the best response is one that's not allowed in our "polite" society.
This boy wanted to anger you, to hurt you, and was both enabled and allowed to succeed by the society that has decided violence is WRONG - unless a state-sanctioned agent does it, and then summary execution is fine.
Appropriate response to aggression is more aggression, and escalation. You described the bully, shouting in your face, "I'M NOT TOUCHING YOU!"
I sympathize.
Been there, done that, the damage was hidden, though...
At least it didn't become physical. You might want to consider a gym membership, though, or some boxing or krav maga classes. Part of the defense is being too secure to even notice this. And the next part is being able to back it up with violence, which is why I suggest boxing first (so you've been hit before and know how to deal) - and Krav second, because it's a pretty nasty set of responses. It sucks, but the world we live in is enabling the bullies... Better be able to face them on their own terms.
And people likely wonder why I'd say, be ready to go physical, but also at least it didn't go physical? 1. Be ready, being capable, knowing you're capable, will diffuse a lot of situations. Most guys don't want to find out - so bullies and idiots might still step, but since you know they'll fall back, it won't phase you much, if at all. E.G., drunk at a Ren faire, pulls a blade... Next thing he knows, his sword is on the ground, and a dagger against his neck, and he's REAL sober, REAL fast, and his friends are unwilling or incapable of responding. Police can show up, you'll be fine - you didn't injure him, you just defended yourself. (Note, this is outside the faire, because the idiots demand everything be peace-tied. What happens if he unties it and acts that way inside the grounds...? )
Second, in a physical fight, it can still go either way, which is why you generally want to avoid the fight if possible. Especially if you're smaller, you can't absorb the damage as well. But knowing how to fight is very different from most guys, who "know how to fight." It'll take a while, but bring lots of benefits; next thing you know, it's a decade later, and no one would DARE pick a fight - you just give off that aura of, "I can handle myself, you will need friends..." Most guys think fighting comes naturally, but you can poke around a bit and you'll find it's not true. Basic stuff, like "White Collar Brawlers" - TV show where two office guys would settle a dispute in the boxing ring. It's all fun and games until that first punch... Then the world changes.
Imagine knowing how to deal with kicks, throws, joint locks, PLUS knowing how to keep your head if hit. How to control distance and angles so you can deal with multiple attackers. You'll be different from about the third lesson, and if you're working hard physically, or in the gym, as well - you're building character, building strength, and embracing the suck, and that WILL make you stick out in a "masculine" way - making other guys not want to fight you.
Think of the issue in different terms. A 6 foot, 300# bodybuilder doesn't have to prove anything to a 5'2" 120# loudmouth. How drunk does the 5'2" guy have to be to step to the 6' tall dude? It's the chihuahua looking up at the Great Dane...
You can choose which one to be, to some extent.
Little Chihuahua will only step to bigger chihuahua. THEN he's got something to prove. But to a shepherd or a rottweiler? They've got nothing to prove, and if the chihuahua steps, they'll just bite him.
You were seen as a competitor by this person. As someone close in status, close enough to challenge them - so they had to make you feel smaller.
And you allowed it...
So - Get thee to a gym! Or a boxing ring.

-Dianna