Carl Sagan had some precise thoughts on the matter how we could abandon the concept of god altogether.
If the general picture, however, of a Big Bang followed by an expanding Universe is correct, what happened before that? Was the Universe devoid of all matter and then the matter suddenly somehow created, how did that happen? In many cultures, the customary answer is that a God or Gods created the Universe out of nothing. But if we wish to pursue this question courageously, we must of course ask the next question: where did God come from? If we decide that this is an unanswerable question, why not save a step and conclude that the origin of the Universe is an unanswerable question? Or, if we say that God always existed, why not save a step, and conclude that the Universe always existed? That there’s no need for a creation, it was always here. These are not easy questions. Cosmology brings us face to face with the deepest mysteries, with questions that were once treated only in religion and myth.