It can happening. But it's not so common as violence against trans women. My theory is many trans guys pass better after being at testosterone - the manly hormone, because it's so strong. So seeing the difference between a trans guy and a cis guy is hard. (Cis means the person identify himself the same as the sex he got assigned at birth)
When trans guys is pre-everything, they often looks like tomboys. Since they look often masculine, therefor people doesn't dare to be violent in some cases. Often in rape, violence and assault cases, there are more women than men who's the victims. I'm not sure why. Maybe because the society is build up like that, gender roles etc.
It's often much harder for a trans woman to pass and being taken seriously than it's for a trans guy. Testosterone is much more powerful than estrogen and affect much more. I speak about generally.
