Lyric discussion by loveisfiction 

Cover art for Bookworm lyrics by Margot & the Nuclear So and So's

Yeah, that line has made me wonder, too. But I assumed it was like this:

But you're talking to me, saying "I wish that I had died". Like she would have rather passed while giving birth to him because he is a burden.