Lyric discussion by DeathByWaffle 

Cover art for My Evil Twin lyrics by They Might Be Giants

Yeah, I think like NQArbuckle said, it's about finding a scapegoat. Lines like "He always wants to start when I begin" just make me think that he really likes doing whatever "the evil twin" wants him to do.