Can anyone explain what this means? | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		yodsanklai on Dec 9, 2023 \| parent \| context \| favorite \| on: Mistral "Mixtral" 8x7B 32k model [magnet] Can anyone explain what this means?

ukuina on Dec 9, 2023 [–]

Possibly a huge leap forward in open-source model capability. GPT4's prowess supposedly comes from strong dataset + RLHF + MoE (Mixture of Experts).

Mixtral brings MoE to an already-powerful model.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact