Which would require creating a couple of hundred (in my case) duplicate host aliases instead of adding one shell alias that can be used with any host, including those not mentioned in ~/.ssh/config.

You can resolve this with a conditional. See the `Match` keyword.

Though I agree, probably not the best solution to start all sessions with tmux. There's other issues it can cause.

No, host matches allow wildcards.