Anderson localization in disordered systems with competing channels: Who wins, the fast or the slow?