Two thoughts on religion and atheism:
1) Under most modern Western post-Enlightenment versions of religion, you don't expect to make radically different observations regardless of whether religion is "true" or "false".
You can, if you choose, make fun of the "God can't/doesn't give definitive proof of his own existence, because that would remove room for faith and/or free will" argument. (And if you do it well, I will probably laugh). But that's the argument a lot of sophisticated proponents of religion are making explicitly, and which most people more or less tacitly accept.
And at that point, when you argue about whether religion is true or false, you're not arguing about what observations you expect to make, so much as how to explain them---about what story to tell about your life.
(In fact, the Rational Christianity piece I linked above makes basically the same point. It suggests that there's no such thing as absolute proof that god exists, because any concrete observation will always admit some other explanation.)
And that has two implications. First, these arguments are hard to resolve: "what story do I prefer" is a more personal and subjective question than "will god magically light this altar on fire." Which is why these debates mostly go nowhere.
Second, people speaking from one interpretation tend to be completely incomprehensible to people speaking in the other. If your worldview/explanation includes god, then much of what you see is evidence of god's presence. But if your worldview doesn't include god, then you see no evidence and can't come up with a reason to believe him.
This would be a fantastic example of the theory-ladenness of observation, if it weren't so controversial and didn't impinge on everybody's core philosophical commitments.
2) There's a deeper reason that religion always feels kind of ridiculous (and perverse and depraved) to me; but most non-religious people are vulnerable to exactly the same critique.
Fundamentally, religion only makes sense if you want an external source of meaning. God provides order and meaning to the cosmos, and it's important to worship him and abide by his judgments.
But the idea of external meaning is absurd. The outside world can't make things meaningful to me unless and until I decide to care about them, so any attempt to externalize meaning is just kind of goofy. (And since I think abdicating your responsibility to create yourself, and your own meaning and values, is deeply Wrong and condemnable, I also find it perverse).
If every factual claim in your scripture of choice is literally, plainly, factually true, that still doesn't give me any reason at all to care what god thinks. It's not possible to make someone value something, or care about something. Values are always a choice.
(This is somewhat ignoring the "do what god says or else option". But that still doesn't give me a reason to believe things---just a reason to superficially comply. And most religious people don't think that God is really Anthony Fremont).