Living in Spite Lyrics

Lyric discussion by powerbait 

Cover art for Living in Spite lyrics by Midtown

I think this is about a guy who doesn't know how to deal with a girl. He is really frustrated with her, and he's trying to figure her out, but he can't and it leads to those petty fights.

But, I don't understand how living in spite factors in.