Leave, make the memory of her leave, she is already gone, her memory still resides, but that memory just causes pain, so he is saying it to the memory, the part of her that remains with him to leave, go away.
Leave, make the memory of her leave, she is already gone, her memory still resides, but that memory just causes pain, so he is saying it to the memory, the part of her that remains with him to leave, go away.