Lyric discussion by sallyneedler 

Cover art for Navy Sheets lyrics by Hold Steady, The

"Belt it out like back-scratched choirs" is right, it's a reference to "Same Kooks" off Boys and Girls in America:

"The scratches on my back had formed into a choir and belted out a chorus"

GOD, I love this band.