This article makes no sense. It criticizes current LLMs and then without stopping for a second pretends future LLMs will have these problems. Even though hallucination levels have been going down with every generation. Even though every test and benchmark we can come up with, LLMs do better with every generation.
> Even though hallucination levels have been going down with every generation.
Gonna need a BIG citation on that one, chief.
> Even though every test and benchmark we can come up with, LLMs do better with every generation.
Has it occurred to you the people making the tests and benchmarks are, more often than not, the same people making the LLM? Like yeah if I'm given carte blanche to make my own test cases and I'm accountable to no one and nothing else, my output quality would be steadily going up too.
The other day I tried asking Copilot for a good framework for accomplishing a task, and it made one up. I tried the query again, more specifically, and it referred me to a framework in another language. And yes, I specified.
