Please tell him as soon as possible. Your safety depends on it, even if he doesn't strike you as unsafe. And don't be surprised if he accepts or rejects your specialness. As the others have said, you're an attractive woman and will you will meet attractive men for whom your being trans won't be an issue. I'm not just blowing smoke. I've been dating men I meet on a dating site for a year. I don't disclose my trans-status until after we start messaging (and LONG before we meet). Probably around 1/3 of the men I think are worth pursing conversation with don't mind. Being rejected two out of three times sucks, but life could be worse. Plus, I've never had my heart broken by any of these men because I had not gone very far without telling them.
You were strong enough to transition; you ARE strong enough to risk rejection.
Jane