Driftin' Too Far from Shore Lyrics

Lyric discussion by Katonitrain 

Cover art for Driftin' Too Far from Shore lyrics by Bob Dylan

I'm gonna go simple here and say I think it's about a guy who's scared of this girl (probably his ex). From what I read into these lyrics he seems to be tolerant of her position, but not of their relationship's, peace.

My Interpretation