Someone Else's Life

"I keep your picture in my worn through shoes. Then there's you. Then came you. When I'm lost, I look at my picture of you."

I think it means that he keeps a picture or memory of her wherever he goes. He's not literally putting a picture of her in his shoes, but thinking about her always.