Yeah, I hear you. It can suck when you're just getting started.
A couple of things, though. First, if you train consistently now, it will pay off later, because even if you're not building much muscle, you'll be getting stronger. When you do get on T, the stronger you are, the more weight you'll be able to lift, and that will help you bulk up faster -- you have to be able to lift significant amounts of weight in order to add muscle.
In fact, at this stage it may be better to focus on a program designed to build strength (higher weights and fewer reps), rather than a body-building program. Concentrate on learning the correct form for the different lifts to start with, using lower weights, rather than pushing yourself to lift as much as you can with poor form. That's what leads to injuries; if you're injured, you can't lift at all, and THAT, more than anything else, will slow your progress.
As far as those bulky guys in the gym go -- keep in mind that many of them are probably doing supplements and even steroids on top of whatever natural T they have going, and that stuff can cause major health problems. Be very wary of bodybuilding nutritional supplements; many if not most of the "cocktails" are spiked with illegal steroids and amphetamines, which can and will cause liver and kidney damage. If you go the supplement route (and many of us do), stick to whey protein, creatine, and maybe one or two other single-ingredient supplements, and get them from certified sources.
Try to remember that your goal is to be the guy you are supposed to be. I know it's hard, but comparing yourself with others isn't nearly as helpful as measuring your own progress and seeing improvements, whether those take the form of increased strength, a drop and shift in body fat, having more energy -- it's all good. Take notes, and set simple, short term goals.