This format, or similar formats, seem to be the standard now, I was just reading the "Lessons from Building Manus"[1] post and they discuss the Hermes Format[2] which seems similar in terms of being pseudo-xml.
My initial thought was how hacky the whole thing feels, but then the fact that it works and gives rise to complex behaviour (like coercing specific tool selection in the Manus post) is quite simple and elegant.
Also as an aside, it is good that it appears that each standard tag is a single token in the OpenAI repo.
Prediction: GPT-5 will use a consortium of models for parallel reasoning, possibly including their oss versions. Each using different 'channels' from the harmony spec.
I have a branch of llm-consortium where I was noodling with giving each member model a role. Only problem is it's expensive to evaluate these ideas so I put it on hold. But maybe now with oss models being cheap I can try and it on those.
I tested a consortium of qwens on the brainfuck test and it solved it, while the single models fail.
MOEs are a single model. An 'expert' is a subset of layers chosen by a router model for each token. This makes them run faster. A consortium is a type of parallel reasoning that uses multiple of the same or different models to generate parallel response and find the best one.
All models have a jagged frontier with weird skill gaps. A consortium can bridge those gaps and increase performance on the frontier.
Yesterday I gave a presentation on the role of harmony in AI — as a matter of philosophical interest. I’d previously written a large literature review on the concept of harmony (here: https://www.sciencedirect.com/science/article/pii/S240587262...). If you are curious about the slides, here: Bit.ly/ozora2025
I assume they are using the concept of harmony to refer to the consistent response format? Or is it their intention for an open weights release?
> The format enables the model to output to multiple different channels for chain of thought, and tool calling preambles along with regular responses
That's pretty cool and seems like a logical next step to structure AI outputs. We started out with a stream of plaintext. In the future perhaps we'll have complex typed output.
Humans also emit many channels of information simutaneously. Our speech, tone of voice, body language, our appearance - it all has an impact on how our information is received by another.
Same here - all those links are either broken or asking for auth. Classic case of announcing something before the infrastructure is ready.
This kind of coordination failure is surprisingly common with AI releases lately. Remember when everyone was trying to access GPT-4 on launch day? Or when Anthropic's Claude had those random outages during their big announcements?
Makes you wonder if they're rushing to counter Google's Genie 3 news and got caught with their pants down during the GitHub outage. The timing seems too coincidental.
At least when it does go live, having truly open weights models will be huge for the community. Just wish they'd test their deployment pipeline before hitting 'publish' on the blog post.
Yes but then you can use the pelican test in all your marketing where you say that this is the <apple slide deck voice> most capable model. ever. And then ignore the new test except as a footnote in some long dry boring evaluation.
I hope this ends in well poisoning to where all data about pelicans is associated with a bicycle in some way to which you can't get any model to give you correct information about pelicans or bicycles but you can get a pelican riding a bicycle.
... but these links aren't active yet. I presume they will be imminently, and I guess that means that OpenAI are releasing an open weights GPT model today?
Basically, LLMs are trained with a specific conversation format, and if your input does not follow that format, the LLM will perform poorly. We usually don't have to worry about this because their API automatically puts our input into the proper format, but I guess now that they open sourced a model, they are also releasing the corresponding format.
> GPT OSS is a hugely anticipated open-weights release by OpenAI, designed for powerful reasoning, agentic tasks, and versatile developer use cases. It comprises two models: a big one with 117B parameters (gpt-oss-120b), and a smaller one with 21B parameters (gpt-oss-20b). Both are mixture-of-experts (MoEs) and use a 4-bit quantization scheme (MXFP4), enabling fast inference (thanks to fewer active parameters, see details below) while keeping resource usage low. The large model fits on a single H100 GPU, while the small one runs within 16GB of memory and is perfect for consumer hardware and on-device applications.
Apparently the issue was resolved, but there's no indication there was an outage in the last 24 hours when looking at status...
https://www.githubstatus.com/
Every OpenAI announcement has threads of people complaining that the links don't work yet as if you can trivially deploy 10 different interconnected websites completely instantly.
My initial thought was how hacky the whole thing feels, but then the fact that it works and gives rise to complex behaviour (like coercing specific tool selection in the Manus post) is quite simple and elegant.
Also as an aside, it is good that it appears that each standard tag is a single token in the OpenAI repo.
[1] https://manus.im/blog/Context-Engineering-for-AI-Agents-Less... [2] https://github.com/NousResearch/Hermes-Function-Calling