Lyric discussion by gracetbe 

Cover art for Damned Ladies lyrics by Rufus Wainwright

He's empathizing with women, all of these women are women that were devoted in love and had men to terrible things to them that essentially ruined their lives. "your arias caused a stir in my sad and lonely heart." an aria is a solo in an opera. He's saying their stories make his heart go out to women. Give the man more credit, he's an artist.