GPT4 supposedly cost USD 100M to train and seems much smarter than anything else... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		lanstin on April 19, 2023 \| parent \| context \| favorite \| on: StableLM: A new open-source language model GPT4 supposedly cost USD 100M to train and seems much smarter than anything else released. is there any chance to get this much money for open source training? rea lly big EU grants or some philanthropist or?

MacsHeadroom on April 20, 2023 [–]

It would cost a tenth of that to replicate GPT-4 by training on its outputs.

It's quite likely that finetunes of the forthcoming larger StableLMs will rival GPT-4. (and by that time GPT 4.3 will be shipping)

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact