I've also heard good things about Anthony Logistics razor bump treatment. 

Aloe Vera gel after shaving cools the skin.

Good prep before you shave can also prevent a lot of problems.  Here's a good article on how to prep foar a shave:

http://badgerandblade.com/vb/showthread.php?t=9745

Actually, there is a lot of good shaving (and other men's grooming) advice on Badger & Blade.

I didn't read all the replys so someone could have already said this. I know shaving can irritate the skin. I have never had bumps before but you could try using shaving cream for sensitive skin. Thats what I use and I have never ran into any problems with skin irritation and I have to shave about every other day.

Sweet blade there Jamie-o. Is it a family heirloom? I used to shave with a straight razor as a teenager- even though I didn't need to shave at all.