I gotta say, I'm really connected to my female name. My first name, is my birth name (I'm adopted) with Ann hyphenated to it, because then I fit in with the rest of my family who all have An/Ann/Anne names. My middle name stayed the same after I was adopted, because I associated it with one of my foster aunts that I love, and its also my adopted grandmother's middle name.
So even though my middle name of Louise is distinctly feminine (and as other people my age might say, 'an old lady name'... but I don't view anyone as old so I don't see it that way) and easily made masculine, I don't think I'll ever change it, just because of the deep meaning it has to me. (As for my first name, I'm thinking a unisex name that's close to it, "Cameron", or just a nickname of my name, "Ren" though I'm leaning closer to Ren so that I don't have to go through all the legal stuff if I don't want to.)