The "T" remains by far the least visible and least understood letter in LGBT, and I agree that some transphobia is simply due to complete ignorance, and we have to be patient with such persons. Lots of hate speech is also due to ignorance. With that said, however, the species of hatred that comes our way, even if it may be due to a lack of education, is sometimes bound up with forms of hatred in such a way that I don't know if people trying harder will solve things. Trans-misogyny, for instance, is tied up with sexism, and people who hate transwomen for "reducing" themselves to being women, for stepping down from the privileged pillar of societal male-ness, clearly have more than pure transphobia to work out. Transmen who are attacked for "abandoning" their "female beauty" to become men are also the victims of a species of sexism that intersects with transphobia but is ultimately larger than transphobia itself.
I would like to believe people are trying, and I know some people who say ignorant things simply don't know better and would be better if they knew more. But many issues we face from transphobes are unfortunately tied to deeper, more pervasive issues, and those people have a much longer way to go to accepting us, if they can.