Lyric discussion by wingofasongbird 

Cover art for 14th Street lyrics by Rufus Wainwright

Rufus said once that this song had something to do with one of his many relationships with straight men. I think he basically wants to be a part of this person's life again, because he's missing the time they shared together, but his heart has been absolutely broken.

I also think the "where I'll learn how to save, not just borrow" refers to the fact that the man was married. I'm just taking this from the Want One commentary.