If you know you want it, go for it. They might be staring at you because they can see you look 'female' but butch, perhaps, and think that's strange or whatever (depending on where you're from)- transitioning, the process, probably won't help as I feel like people are questioning my gender. But I rather they do that than mistake me for a butch lesbian, I hated that, it made me feel like even when I was trying to fit in i still stood out.
I see it like this: I was talked about and given labels (butch, lesbian, weird, etc etc) when I wasn't out, and they were just wrong. I prefer it now that even if people do talk, it's for the right reasons. Because I'm being ME, whatever that is to them. Sometimes it hurts more, if I get insulted or commented at, but at least I'm not hiding and I'm standing up for what and who I want to be.
Think about your future- that some 2-5 years of hardship will result in you feeling better in your own skin, feeling more confident and hopefully more happy- if this is what you decide on. Imagine the end result; male chest, male shape/ hair, voice.