like that but requiring 60GBs of CPU RAM for some reason :-P one has to wonder h... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		muyuu on April 4, 2023 \| parent \| context \| favorite \| on: State-of-the-art open-source chatbot, Vicuna-13B, ... like that but requiring 60GBs of CPU RAM for some reason :-P one has to wonder how did they implement the storage of those deltas to require that sort of RAM

wongarsu on April 4, 2023 [–]

For perspective, that's about $200-$250 of RAM on a desktop computer. They might just not have cared.

Though I expect somebody to write a patch to make this more accessible to people on laptops.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact