You Can't Count on Me

I agree with you. I think that the girl was just another fling for him. This part makes it apparent:

But you're just my toy And I can't stop playing with you, baby

Seems like he doesn't love her like she loves him, but he needs her nonetheless. Maybe a case of lust.