Personally I'm more concerned about the Spiral of Silence.

The spiral of silence theory, proposed by German political scientist Elisabeth Noelle-Neumann in the 1970s, explains how public opinion is formed and how individuals may withhold expressing their views if they perceive them to be in the minority. This theory is often applied to political and social contexts, including the rise of ideologies like fascism.

In the context of fascism or any other controversial ideology, the spiral of silence suggests that when people believe their opinions are not widely supported, they tend to remain silent and refrain from expressing their views publicly. This silence, in turn, can create an illusion that the majority supports the prevailing ideology, even if it might not be the case. As a result, individuals who disagree with the ideology might feel isolated and discouraged from speaking out, contributing to the seeming growth and acceptance of the ideology.

I don't think people tolerate intolerance so much as they're scared to speak out.