Lyric discussion by ghostwheel 

Cover art for Machine Gun lyrics by Slowdive

I always thought the name of the song referred to the fact that when Neil sings "Son of Sheba" it sounds like "saw a machine gun". I can imagine that in early rehearsals that's what people said, and the name stuck. It's quite suitable and striking considering the suicidal theme of the song.