Lyric discussion by bibop 

Cover art for The Rider Song lyrics by Nick Cave and the Bad Seeds

Another idea based on infinityontrialon's interpretation is, that he is not about to kill himself, but other people. Moon, wind, clouds, etc. are aliases for hostages he has taken which he kills. In the end everyone is dead but him and so he lays down his gun after that.

My Interpretation