I've never met an atheist that didn't love to parse, and I parse with the best of them. So, onto parsing out the parts of your post. I want to start with the second sentence and beyond, and after those I'll loop back to the beginning, if that's cool.
The universe didn't just start existing at some point.
All available evidence indicates that, yes, the universe we currently experience came into being at some point. Specifically, the point of the Big Bang. Before the Big Bang... and that's as far as I can go. There is no evidence of what happened, no evidence that our current universe or something else existed. Even the word "before" is a linguistic cheat, because it's impossible to know if temporal concepts like "before" even applied.
So, to parse out the parsing. We know that the current universe began, and at this point we cannot know what, if anything, existed "before" the current universe.
If it's always been then it's not a great leap of logic to say that there has always been a God.
Setting aside the fact that we can't say it's always been there, it's a leap of an order of magnitude larger to say that there is a "God". I'd direct you to the "Ultimate Bowing 747" argument advanced by Dawkins. Basically, a creator god has to be more complex than his or her creation in order to create it, if the spontaneous creation of the Universe is unlikely, then the spontaneous generation of a more complex God is definitionaly more unlikely.
But let's set even that aside. Let's say you're right and it's only a slight leap to make. Just because one can make the leap, doesn't mean one should or is rationally justified in doing so. If there is no evidence for the God, then there is no reason to jump to it over any alternate solutions (magic, advanced aliens, Matrix style VR, so on). All of these answers are equally likely and unlikely, and none offer any evidence in support of their probability.
And looping back to the beginning (the last sentence is a restatement, so for brevity I'll skip addressing it separately):
I'm just curious for any reasons why one would not show love of a creator.
Because I don't believe one exists. There is no evidence that such a being exists, so I have no reason to love it.
