True Love Tends to Forget

i don't get if he's forgetting her "you're so hard to recognize" or if she is forgetting him "you're a tearjerker baby but i'm under your spell". it could likely be both but his tone and most of the lyrics suggest she's forgetting him? not the deepest or best dylan song but i like it okay =)