We inflicted that to ourselves by picking the most confusing terminology ever. "No, reasoning isn't thinking. No when the model says it thinks it's not actually thinking... No an agent isn't actually a creature with agency... No, when we say it hallucinates it doesn't, like, actually hallucinate"
How is it's process (inputs, training weights, processing those weights based on an initial given state -prompt-) different than how a brain thinks? And is it a difference of architecture and scale (like an ENIAC and a Apple Silicon M5) or a difference of fundamental operation?
While I'm sure professionals in neuroscience or philosophy can expound on this topic in a more satisfactory manner than myself, I think a relevant point is that despite all our efforts we still don't know how brains think.
