New Ceremony

I feel like this is about an affair with someone you're really in love with while you're in a relationship with someone else.

"It's anybody's guess how, The angel of doubt came down, And crept into your bed."

I think this refers to the doubt in the actual relationship. You find someone else, and what was once your everyday life, a relationship you're used to, seems less perfect now. Maybe there's something better out there, the one you're having an affair with.

"Now the stairs forget your shoes, And the gate don't creak for want of you. But the jury's out on me."

The affair has ended, they're not seeing each other anymore but the narrator's still got to take responsibility of their actions.

"We're wise beyond our years, But we're good at bad ideas, my love. Or so it seems to be."

While the affair has ended, they're still in love or feel a deep connection. They're wise, they know what matters in life and they know what they are supposed to do. Maybe they've had conversation neither of them can have with anyone else. They know exactly what they're not supposed to do, yet they do. Even though they know they're hurting themselves, each other and everyone involved. Because the narrator is truly in love with the person s/he's having an affair with, "Or so it seems to be" refers to how they might not see the affair as such a bad idea after all. They know it won't end well, but they still hope it might because after all they're in love. The narrator is a romantic.

"Shine a little light, Don't wrestle with the night, Don't think about the future now. I know it's gotta stop love but I don't know how."

There will be darkness, things will go wrong and they'll be found out and everyone will get hurt and they will have to stop their affair at some point. The narrator's persuading them not to think about their impossible future but live in the moment and do what they want to do once more. They both know it can't go on forever but they don't want to stop it as it feels right.

"My little one, My kettle drum"

This shows how they are truly in love with each other, it's more than just a sexual affair.

"My babel tongue, My come-undone"

Babel is "In the Bible, a city (now thought to be Babylon) in Shinar where God confounded a presumptuous attempt to build a tower into heaven by confusing the language of its builders into many mutually incomprehensible languages."

The idea of the person was heavenly, yet doomed in the first place.

"My prison kiss, My dying wish"

The person is the one thing the narrator wants anymore, it's always the one they'd choose, the last person to think about, the only person to see.