Lyric discussion by xdvr 

Cover art for You Keep It All In lyrics by Beautiful South, The

Never thought it was about domestic abuse.

Just more that the bloke keeps all his feelings bottled up, and although he did feel like knifing her in the heart, he didn't.

The crimes are other things he's done, that he thinks he probably shouldn't tell people.