Lyric discussion by ColorPhilosophy 

Cover art for All My People lyrics by Portugal. The Man

To me... I think he's saying that your time will come regardless if you sit around doing noting (keep your hands by your side) or if you actually get out and live (got your hands on it).

I believe when he says "bring all my people with me" he's saying that he wants to bring his friends/family to take the chance to get out and live.

Song Meaning