This is one of the famous argument for the existence of God. This is what usually believers use to prove God's existence because it looks sound and because it is consistent with the Big Bang theory (which is accepted by many). This looks like a good argument and I once believed in the Kalam Argument. The structure of the Kalam Argument is this:
1) Everything that begins to exist has a cause of its existence.
2) The universe began to exist.
3) Therefore, the universe has a cause of its existence.
And the one who caused the existence of the universe is God. Therefore God exist.
One of the common objection to this argument could even be asked/raised by a (wondering) pre schooler. Who caused God? God also begs for a creator. If no one caused God, then God can't exist. God must have a creator/cause too. This would lead to infinite causes of gods. This is also how I counter the First Cause argument which is very similar to the Kalam Argument.
Now, even if one would argue or reason out that God is infinite, God would still need a cause as much as the universe. Since God created time and places himself in it, then it follows that God exist at a time prior to which there is no time. Because of this God also needs a cause as much as the universe if "everything that begins to exist has a cause of its existence". (Wes Morriston's reply to William Lane Craig's Kalam Argument)
Even if one would assume that God is infinite, this would still lead to infinite regress when he created the universe. Where was God when he created space and time? God must be in some place (be it beyond space and time) when he created space and time. Let us assume that God was in "beyond space and time" when he created the universe. Then, where was God when he created "beyod space and time"? Let us again assume that God was in "another beyond space and time" when he created "beyond space and time". Where was God when he created "another beyond space and time"? And so on... Infinite regress.
Lastly, the Law of Conservation of Mass-Energy states that mass and energy are infinite. Since the universe is composed of mass and energy then the universe, in one way and form or another, is infinite. (I am not really a science guy and I am still currently doing my research on this.)