I kind of am for the most part. I present really punky/androgynous and "pass" as an andro lesbian for the most part, but every now and then, some people notice that I'm not cis. I used to get upset about that, but now I'm okay with it.
I can understand where you are coming from as far as being "out" and the way people react. I work at an LGBT center, so everyone knows about my past, and I feel like people have the tendency to sensationalize our lives, or the fact that our bodies are "different."
I don't think it's wrong at all to want to be stealth. We all have our reasons. Maybe for safety, maybe because we don't want to be "third-gendered," or maybe it just makes you more comfortable that way.
For me, I'm a girl, and I don't see the need of putting a "T" before that. I'm not in denial that my body is different, and I certainly don't look down upon those that DO want to be open about it.
So, if you want to be stealth, there's no shame in it.