> So when an LLM was asked to analyze the unit distance conjecture, it just spat out a bunch of average-or-random tokens that coincidentally happened to correspond to a valid proof that had eluded humans for decades?
How many problems and/or times did it make up completely random bullshit with no basis in reality? Random noise looks really cool or impressive when it's right, but if and only if, you're willing to ignore all the times it was wrong.
yes
https://en.wikipedia.org/wiki/Texas_sharpshooter_fallacy
How many problems and/or times did it make up completely random bullshit with no basis in reality? Random noise looks really cool or impressive when it's right, but if and only if, you're willing to ignore all the times it was wrong.
I'm not.