It's slightly more complicated than that. "Tolerant" means you support the advancement of marginalized groups in word and deed. "Marginalized groups" roughly means BIPOC, LGBTQ, and (depending on circumstances) sometimes women. "Intolerant" means you effectively support the continued oppression of these groups in word and deed, irrespective of what your actual opinions and motivations truly are. You cannot be neutral or indecisive; per Desmond Tutu, to do so is to choose the side of the oppressor.

But again, it all boils down to membership in these specific identity groups and their perceived need for protection.