If a woman tells you that you aren't man enough, then you know you are a man. Every man worries about those things, and when someone is angry with us (us as in, anyone), they often go for the jugular, and hit you where they know it is going to hurt, even if they don't really mean it, or don't really think it themselves -- they'll say it because they know it will hurt you. So, I'm definitely not going to tell you that you won't hear those kinds of things from a woman that you love someday, but I will tell you that pretty much every man will hear that from a woman that they love at some time or another. Suck it up, big guy.
As for your aunt, she's just propping up her prejudice, don't let it get to you. Prove her wrong.