When someone is being fired you remove them from an organization, you don't give them the organization and tell everyone else to go find new jobs, especially since they're the ones doing all the work.
That's essentially what's happening here. You have something like half the keynote speakers from LibreConf last week announcing that they will no longer participate in FSF events, and a bunch of community members supporting them.
No that's not what's happening. What is happening is they are trying to force RMS and now the entire FSF board out of the community. That's not the same as refusing to work with someone.
Interesting, could you point out where in that letter these people are being forced out of the community?
Alternatively, could you explain how you differentiate "we will not work with these people" and "forcing someone out of the community"? Like if enough people refuse to work with someone, doesn't that functionally force them out of the community?
I see two demands: the FSF board step down, and Stallman remove himself from any leadership positions. This is functionally the same request as last time, to keep RMS out of leadership. I'm unaware of any significant backlash to him having been a speaker at LibreConf, so clearly he could still still be a community member.
How is demanding the entire FSF board step down not an attempt to force them out of the community? To refuse to work with them would take the form of "we refuse to work with the FSF moving forward" or something to that effect. They are not doing this. They are demanding people lose their jobs because they disagree with them. Take your blinders off and be rational.
You aren't being force to interact with the FSF.