Lyric discussion by Dohle 

Cover art for And No More Shall We Part lyrics by Nick Cave and the Bad Seeds

Frankly, as a non-native english speaker, I always thought it a bit different. The protagonist of this song had a very troubled relationship with that woman, but now, when they're getting married, it could all be good. At least, he hopes it and hopes that the marriage will save it.