Lyric discussion by peytipay 

Cover art for Leaving Babylon lyrics by 311

i think in jamaican/ rastafarian culture the term "babylon" refers to government, or basically any 'establishment' of sorts that holds a lot of power (i.e. military, police). drawing from that i'd guess the song means getting away from a place (using the term loosely.. maybe even a state of mind) of oppression or negativity and just going someplace with better vibes. :)