I think that we are held to different standards because trying to appease everyone is a dampener on effective activism. The status quo of course moves rightwards, we dont need to help that along by ignoring our radical flank.
Whatever stage of radicalism you are at I promise you there are activists closer to the centre pushing a more toned down message that someone radicalising from the centre can latch on to. Worrying about polarization as a radical is how nothing radical gets done because we have to wait for everyone to agree to smash up the factory.