Of course! I especially hate the pretty ones! Lol.
Standing out in any sense is always risky, you get attention from all kinds of people, some of them predictably nasty. We still live in an incredibly prejudiced and scary world. I saw that as early as 2010 someone got away with murder by using the "trans panic defense", or the claim that after fooling around that they dropped that they were trans on them, and this is provocation to kill them. Provocation in court is such that the jury has to agree that any reasonable person would do the same under similar circumstances... I saw a watch mojo top ten like a year ago about top ten movie twists, and one of them was some guy falling in love with a trans woman, only to find out and vomit, to which they say "you know you'd do the same" or something. Society tells people, and re-enforces that we're at minimum disgusting, and sometimes reasonably beaten to death for being "traps".
Not trying to scare you, just trying to say that your fear is reasonable, and by no means unfounded. I agree with the other women that mentioned that you have to live, and plan for safety, not just because you're trans but just for being a woman, let alone that you're trans.
You have to also realize that if you're attractive to men, and men find out, some of them will be extremely angry at themselves about it, and want to take it out on you.
As for feeling that you're kind of blaming the victim, well I don't know that you are. You're empathizing with the victim, seeing yourself as them, and wondering how you could have prevented that. Only natural. The same reason our first question after hearing that someone has died is "how?", because before we care about them, we want to know that what killed them isn't something we ourselves have to worry about.
Be safe.