Lyric discussion by Killjoy192000 

Cover art for God Is in the House lyrics by Nick Cave and the Bad Seeds

I'm sure you'd like to think of it as a critical view of small-town Christianity, which is a subject that's been the victim of satire for quite some time by many who barely understand it, but you must take into account that Nick Cave is a Christian himself, although he doesn't believe in an interventionist's God.

http://dir.salon.com/story/ent/feature/2004/11/18/cave/index.html?pn=3

^^ That should help if you need proof.

Anyway, Christianity has gotten a bad stereotype, but we're not all the homophobic rednecks you'd prefer to think we are.