Mark,
First, why do you think there was sperm on the handle?
Second, You had your period. And while there have been reports of women have their periods while pregnant, the chance of it happening are very remote.
Third, I know you are worried and there is not much I can say to reassure you. But I very seriously doubt you are pregnant. Like Kyle said get some pregnancy tests and just check.