Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Use a local model. For most tasks they are good enough. Let's say Mistral 0.2 instruct is quite solid by now.


Do different versions react to prompts in the same way? I imagined the prompt would be tailored to the quirks of a particular version rather than naturally being stably optimal across versions.


I suppose that is one of the benefits of using a local model, that it reduces model risk. I.e., given a certain prompt, it should always reply in the same way. Using a hosted model, operationally you don't have that control over model risk.


What are the best local/open models for accurate tool-calling?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: