Lyric discussion by Invincible500 

Cover art for Cave lyrics by Muse

In my opinion, this "CAVE" that he speaks ofis all the decisions that he has made and the problems that he caused. Almost like the phrase, "digging yourself into a hole" you know? And the other person that he's singing to, he wants them to come with him and take the fall for him. Hence "it's got nothing to do with you". The situation has nothing to do with the others but he wants them to take the fall. But I could be wrong.

@Invincible500 not what I thought, but an interesting take :)