You should be more concerned that Chinese labs can train models that are just as good for 10X less because Americans treat the USD’s status as the global reserve currency as the ultimate bitter lesson. Who needs better math and engineering when you can print money to buy more GPUs???
The author literally said gpt is spending 10x more for equivalent. This really means ChatGPT had that intelligence at that cost a year or two ago. Smaller domain models are better at focused tasks in that area but can’t be generalized.
