Brown Eyed Blues

i dont really get though why he says "She loves me for me and I can't explain" and then "loving her, is a game i'll always lose"

...if she loves him, then why would loving her be a game he always loses? yeah i dont really get it. still love the song though