Lyric discussion by phs1028 

Cover art for Swingin' Party lyrics by Replacements, The

A swinging party is public execution by hanging. That's my guess. Paul is saying that he's guilty of a lot of things (being wrong, making bad choices) and if those things are crimes, he'll hang for them (figuratively, of course).