Lyric discussion by Bosko 

Cover art for Sister Ray lyrics by Velvet Underground, The

If you want to read a literary inspiration for this song, check out "Last Exit to Brooklyn" by Hubert Selby, Jr. There's a chapter that describes a similar, sleazy situation...

@Bosko correct, lou Reed states in a loaded interview that the inspiration "is Selby; uptown."