Lyric discussion by TheFranzFerdinand 

Cover art for Lost for Words lyrics by Pink Floyd

I think the Right One refers to Rick Wright and maybe Gilmour is saying that it was always Gilmour and Wright versus Waters for the songwriting, and with Wright gone there was no more "safety in numbers" and Waters was allowed to completely control the songwriting.