Because the NSA isn't going to stop, the CCP isn't going to stop. Anyone who doesn't stop is a threat to my personal freedom, so the only logical reaction to me is to empower yourself as well as possible and keep training.
A government's proprietary possession of computational power is analogous to it having weapons barred from public ownership, meaning they control a vector of violence than could be used against their citizens without counter-balance.
If someone else has the ability to weaponize information against you, your ability to understand reality is threatened. Without personal LLMs or other AI tools, my ability to analyze things like deepfakes, LLM-written text, or other reality-distortion assets is threatened.
It might sound hyperbolic but we're already hearing people talk about banning GPUs. I'm not trying to fall back into the past.
Because the folks at the NSA are not going to stop doing so... The government itself is going to continue with it. And we don't want to allow the state to have the monopoly on advanced AI.
Some kind of distributed training, BitTorrent style would be one way of getting around it, using thousands of GPUs worldwide? If we could somehow make the training process profitable, like a cryptocurrency, then that would be even better.
