Lyric discussion by epicmikenomore 

Cover art for Let It Be Me lyrics by Social Distortion

the song is like Romeo and Juliet. He wants to be with her, even though others may discourage the whole thing.