You do what you want, but personally, when I thought of the possibility, I opted against it. Changing one's family name without a real need to pretty much means you want to dissociate yourself from them. Not necessarily in reality, but I think it's how it would be perceived by most people. Besides, I thought to myself, if I'd been born a girl, I would've had this same name, so why change?
So, yeah. Think of how much you feel the need to change it, versus the possible bad consequences of it. If you feel it's worth it, then go for it. I personally didn't, but maybe you will. It's your life, after all.