Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

> "Anti-distillation: injecting fake tools to poison copycats"

Plot twist: Chinese competitors end up developing real, useful versions of Claude's fake tools.



I cannot bring myself to care about distillation, when these companies have built their empires on top of everyone else's stolen data, while at the same time telling the world they're out to replace us all.


Sure, AI progress comes to a halt then as everyone switches to the copycats that can't innovate, and the frontier companies are bled dry.


"frontier" as in the frontier of using everybody else's code, books, art of everyone else for a specific purpose that was never intended to, as in, not even open source projects ever imagined LLMs becoming a thing and their licenses reflected as much.


You have a very poor understanding of LLMs if you think that is the frontier today. Maybe in 2024 it was.


Please educate us then.


These companies don't get the chance to raise a trillion dollars, and you're laughing???


Poor babies.

Again, I don’t care about them.


it's not about the companies, what a myopic viewpoint

every delay to AGI results in deaths that AGI could have prevented. we are talking millions of deaths for, say, just a year's delay.


What a ridiculous, reductive and dangerously accelerationist viewpoint.


It's not accelerationist, it's just fact.

Not saying we shouldn't be careful with AGI. But the glib tone of "who cares if these companies die?" is where one needs to consider the consequences of AGI not happening or being delayed.


I struggle with the idea that AGI (which I don't think is coming via LLMs, but sidebar) will improve the outcomes of lives and not end up as a tool of privilege and control.

Pitch me on this utopian outlook, because nothing about any of the Frontier companies points away from dystopia to me


You can't call hypotheticals about AGI facts.

It’s not a fact in the slightest.

I thought we gave up on AGI and turned into making sex chatbots and simulated porn instead. Wasn't that what Sam was pushing for all along when he went all in on Sora and the erotic modes?


- you are assuming that an AGI will prevent more deaths than it would cause

- you are assuming that AGI is just around the corner and that scaling up language models is the path to get there

- you can make this argument about basically anything (nuclear power, tuberculosis medication, free healthcare). I’d say the burden of proof is on you to back up your extraordinary claim with extraordinary evidence.


> every delay to AGI results in deaths that AGI could have prevented

Uhm, that's not what Hollywood told me. I trust the screenwriters of "Terminator" more than I trust your anonymous forum comment.


> every delay to AGI results in deaths that AGI could have prevented

Sure, that's what AGI would be used for /s

In other news, we are not even close to AGI and even with the current experimental technology, frontier AI model companies are already fighting to help departments of war, which actually results in the most deaths. What makes you think AGI would be used for not leading to the same millions of deaths?


Qwen are the only guys doing real innovation. (LLM architectures and such.)

Everyone else is just gaming engagement metrics and benchmarks.


Amazing that people on HN can't distinguish between training a model on open source data vs distilling a model's outputs.


You must have some absolutely unhinged ideas about what "open source" means.


Tbh, I think distillation is happening both ways. And at this stage, "quality" is stagnating, the main edge is the tooling. The harness of CC seems to be the best so far, and I wonder if this leak would equalize the usability.


This was my favorite bit, "We're going to steal countless copy righted works and completely ignore software licenc... wait, what? You aren't allowed to turn around and do it to us! Stop that right now!"


‘You can’t fight in here. This is the War Room!’

Has Claude stopped claiming to be deepseek when prompted in Chinese yet? It wasn't long that it hit the news and blogs

Definitely. We can expect zAI, Qwen, Minimax CCs very soon


more likely, they would parse them out using simple regex, the whole point is they're there but not used. Distillation is becoming less common now however




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: