My dad used to say some real nasty stuff like that, too. I lost almost all of my family when I came out and began to transition medically, and sometimes it still stings, but I'm also happier without them. I tried to leave the door open for them and be supportive, but I was an adult and needed to take care of myself. While sometimes I envy people who have their families and their support, I just accept that mine turned out the way they did and that things are more peaceful without their judgement and hatred in my life.
While it's hard to cut toxic people out of your life, especially when you're older and in that awkward place between being a teenager and an adult, you'll find that you feel more confident and normal when you don't have them telling you awful things and putting you down. Just something to think about.