> do you know what "Mechanistic Interpretability Researcher" means? Because that would be a fairly bold statement if you were aware of that.
The mere existence of a research field is not proof of anything except "some people are interested in this". Its certainly doesn't imply that anyone truly understands how LLMs process information, "think", or "reason".
As with all research, people have questions, ideas, theories and some of them will be right but most of them are bound to be wrong.
> (d) “Three-dimensional printer” means a computer-aided manufacturing device capable of producing a three-dimensional object from a three-dimensional digital model through an additive manufacturing process that involves the layering of two-dimensional cross sections formed of a resin or similar material that are fused together to form a three-dimensional object.
I expect someone to get around this by modifying the slicing software to use a different algorithm that doesn't rely strictly on layering 2D cross sections.
> I expect someone to get around this by modifying the slicing software to use a different algorithm that doesn't rely strictly on layering 2D cross sections.
Socialist economies larger than kibbutzes could only be created and sustained by totalitarian states. Socialism means collective ownership of means of production.
And people won't give up their shops and fields and other means of production to the government voluntarily, at least not en masse. Thus they have to be forced at a gunpoint, and they always were.
All the subsequent horror is downstream from that. This is what is inherent to building a socialist economy: mass expropriation of the former "exploitative class". The bad management of the stolen assets is just a consequence, because ideologically brainwashed partisans are usually bad at managing anything including themselves.
This is exactly what I meant, a centrally-planned economy where the state owns everything and people are forced to give everything up is just one terrible (Soviet) model, not some defining feature of socialism.
Yugoslavia was extremely successful, with economic growth that matched or exceeded most capitalist European economies post-WW2. In some ways it wasn't as free as western societies are today but it definitely wasn't totalitarian, and in many ways it was more free - there's a philosophical question in there about what freedom really is. For example Yugoslavia made abortion a constitutionally protected right in the 70s.
I don't want to debate the nuances of what's better now and what was better then as that's beside the point, which is that the idiosyncrasies of the terrible Soviet economy are not inherent to "socialism", just like the idiosyncrasies of the US economy aren't inherent to capitalism.
It is the model, introduced basically everywhere where socialism was taken seriously. It is like saying that cars with four wheels are just one terrible model, because there were a few cars with three wheels.
Yugoslavia was a mixed economy with a lot of economic power remaining in private hands. You cannot point at it and say "hey, successful socialism". Tito was a mortal enemy of Stalin, stroke a balanced neither-East-nor-West, but fairly friendly to the West policy already in 1950, and his collectivization efforts were a fraction of what Marxist-Leninist doctrine demands.
You also shouldn't discount the effect of sending young Yugoslavs to work in West Germany on the total balance sheet. A massive influx of remittances in Deutsche Mark was an important factor in Yugoslavia getting richer, and there was nothing socialist about it, it was an overflow of quick economic growth in a capitalist country.
You've created a tautology: Socialism is bad because bad models are socialism and better models are not-socialism.
> You cannot point at it and say "hey, successful socialism"
Yes I can because ideological purity doesn't exist in the real world. All of our countries are a mix of capitalist and socialist ideas yet we call them "capitalist" because that's the current predominant organization.
> Tito was a mortal enemy of Stalin, stroke a balanced neither-East-nor-West, but fairly friendly to the West policy already in 1950, and his collectivization efforts were a fraction of what Marxist-Leninist doctrine demands.
You're making my point for me, Yugoslavia was completely different from USSR yet still socialist. Socialism is not synonymous with Marxist-Leninist doctrine. It's a fairly simple core idea that has an infinite number of possible implementations, one of them being market socialism with worker cooperatives.
Aside from that short period post-WW2, no socialist or communist nation has been allowed to exist without interference from the US through oppressive economic sanctions that would cripple and destroy any economy regardless of its economic system, but people love nothing more than to draw conclusions from these obviously-invalid "experiments".
"You" (and I mean the collective you) are essentially hijacking the word "socialism" to simply mean "everything that was bad about the USSR". The system has been teaching and conditioning people to do that for decades, but we should really be more conscious and stop doing that.
" no socialist or communist nation has been allowed to exist without interference from the US through oppressive economic sanctions that would cripple and destroy any economy regardless of its economic system"
That is what COMECON was supposed to solve, but if you aggregate a heap of losers, you won't create a winning team.
"Socialism is not synonymous with Marxist-Leninist doctrine. It's a fairly simple core idea that has an infinite number of possible implementations, one of them being market socialism with worker cooperatives."
Of that infinite number, the violent Soviet-like version became the most widespread because it was the only one that was somewhat stable when implemented on a countrywide scale. That stability was bought by blood, of course.
No one is sabotaging worker cooperatives in Europe and lefty parties used to given them extra support, but they just don't seem to be able to grow well. The largest one is located in Basque Country and it is debatable if its size is partly caused by Basque nationalism, which is not a very socialist idea. Aside from that one, worker cooperatives of more than 1000 people are rare birds.
"The system has been teaching and conditioning people to do that for decades, but we should really be more conscious and stop doing that."
No one in the former socialist bloc will experiment with that quagmire again. For some reason, socialism is a catnip of intellectuals who continue to defend it, but real-world workers dislike it and defect from various attempts to build it at every opportunity.
We should stop trying to ride dead horses. Collective ownership of means of production on a macro scale is every bit as dead as divine right of kings to rule. There are still Curtis Yarvin types of intellectual who subscribe to the latter idea, but it is pining for the fjords. So is socialism.
> That is what COMECON was supposed to solve, but if you aggregate a heap of losers, you won't create a winning team.
What kind of disingenuous argument is that? Existence of COMECON doesn't neutralize the enormous disadvantage and economic pressure of having sanctioned imposed on you.
> Of that infinite number
I'm glad we agree that Soviet communism is not synonymous with "socialism".
> Aside from that one, worker cooperatives of more than 1000 people are rare birds.
You're applying pointless capitalist metrics to non-capitalist organizations and moralizing about how they don't live up to them.
> No one in the former socialist bloc will experiment with that quagmire again.
You're experimenting with socialist policies and values right now, you just don't want to call it by that name because of your weird fixation. Do public healthcare, transport, education, social security benefits ring any bells?
If you talked to people from ex-Yugoslavia, you'd know that many would be happy to return to that time.
> We should stop trying to ride dead horses.
We should stop declaring horses extinct when it's just your own horse that has died.
This is not really a contradiction. When the world became bipolar, there was a lot of alpha in arbitrage. The most valuable Yugoslav (state owned) company was Genex, which was an import/export company -- it would import from one bloc and export to the other bloc, because neither bloc wanted to admit that the other bloc had something they needed. (This set the Yugoslavs up for failure, like so many other countries that believed that the global market would make them rich).
The Soviets and their satellites (like the DDR), had another problem related to arbitrage, and that is that their professionals (such as doctors and engineers and scientists, all of whom received high quality, free, state-subsidized education), were being poached by the Western Bloc countries (a Soviet or East German engineer would work for half the local salary in France or West Germany, _and_ they would be a second class citizen, easy to frighten with deportation -- the half-salary was _much_ greater than what they could earn in the Eastern Bloc). The iron curtain was erected to prevent this kind of arbitrage (why should the Soviets and satellites subsidize Western medicine and engineering? Shouldn't a capitalist market system be able to sustain itself? Well no, market systems are inefficient by design, and so they only work as _open_ systems and not _closed_ systems -- they need to _externalize_ the costs and _internalize_ the gains, which is why colonialism was a thing to begin with, and why the "third world" is _still_ a thing).
Note that after the Berlin Wall fell, the first thing to happen was mass migrations of all kinds of professionals (such as architects and doctors) and semi-professionals (such as welders and metal-workers), creating an economic decline in the East, and an economic and demographic boom in the West (the reunification of Germany was basically a _demographic_ subsidy -- in spite of the smaller size, East Germany had much higher birth rates for _decades_; and after the East German labor pool was integrated, Western economies sought to integrate the remaining Eastern labor pools (more former Yugoslavs live abroad in Germany than in any other non-Yugo part of the world [the USA numbers are iffy, but if true Croatians are the only exception, with ~2M residents in USA, which seems unlikely]).
The problem, in the end, is that all of these countries are bound by economic considerations (this is thesis of Marx, by the way), and they cannot escape the vicious arbitrage cycle (I mean, here in the USA, we have aggressively been brain-draining _ourselves_ since at least 1980, which is why we have the extreme polarization, stagnation, and instability _today_ -- it is reminiscent of the Soviet situation in the mid 1980s to late 1990s). Not without something like a world government (if there is only one account to manage, there is no possibility of deficit or surplus, unless measured inter-temporally), or an alternative flavor of globalization.
Internationalism is a wonderful ideology, and one that I support. You can make the case that Yugoslavia, the USSR, etc, were an early experiment in Internationalism, that each succumbed to corruption and unclear thinking (a citizenry that is _inclusive_ by nature and can _think_ clearly is a hard requirement for any successful polity). Globalization, on the other hand, has a bit of an Achilles Heel: when countries asked why they should open their borders and economies to outsider/foreigners, they were told, "so that we can all get rich!". The problem is that once the economic gains get squeezed out of globalization, countries will start looking for new ways to rich, even if it means reversing decades of integration. Appealing to people's greed only works to the extent that you can placate their appetites. We should have justified Internationalism using _intrinsic_ arguments: "we should integrate because learning how others see and experience the world is intrinsically beautiful, and worth struggling for".
Note that most of these economic pathologies disappear, when the reserve currency (dollar) is replaced with a self-balancing currency (like Keynes' Bancor: https://en.wikipedia.org/wiki/Bancor). We have the tools, but everyone wants to feel like the only/greatest winner. These are the first people that have to be exiled.
> Socialist economies are like "adblock for your life".
There's nothing inherent to socialism that would preclude advertising. It's an economic system where the means of production (capital) is owned by the workers or the state. In market socialism you still have worker cooperatives competing on the market.
And he's dead and he's been dead for a long time, and people still paying daily attention to this are being played for laughs and having their rage strip-mined.
He is but everyone else who participated is very much alive and yet to face any accountability and justice. Do you genuinely not understand why people would be outraged that "leaders of the free world", namely Trump and the rest of the US government that's been keeping a lid on this, are just a bunch of unaccountable sex-trafficking pedophiles?
Whatever is left of the western social contract is disintegrating in front of us and the reaction of our societies has been extremely mild if anything - there should be mass protests over revelations of this magnitude.
More than anything I want "Here's the current officially sanctioned best practice of how to report errors with payloads". For a language that's highly opinionated about everything it's strangely unopinionated here and worse off for it because many libraries just swallow useful diagnostic information, some of my own projects included.
There's a barrier to setting up the diagnostic pattern. When you're in the greenfield phase it's easy to search for information about error reporting, discover various different approaches and long threads of people arguing about what better and just say "ah screw it, I have more important things to do right now" and postpone the decision.
Your approach is fine, I don't love how verbose it is but it could probably be tweaked. If this is the way forward then it should be included in stdlib, documented, and promoted as the recommended way of reporting errors.
I agree. You understand why I wrote this post. It's what I wanted to read 3 weeks ago. We're told "Use Diagnostics like the json stdlib module!" but then you realize the json module is way too simplistic for a complicated application.
But also, I'm sure this method has flaws and can be greatly improved, so hopefully we can come to the right solution.
The diagnostic struct could contain a caller-provided allocator field which the callee can use, and a deinit() function on the diagnostic struct which frees everything.
> Example is unexpected data that doesn’t match expectations. Can’t fault the AI for those bugs.
I don't understand, how can you not fault AI for generating code that can't handle unexpected data gracefully? Expectations should be defined, input validated, and anything that's unexpected should be rejected. Resilience against poorly formatted or otherwise nonsensical input is a pretty basic requirement.
I hope I severely misunderstood what you meant to say because we can't be having serious discussions about how amazing this technology is if we're silently dropping the standards to make it happen.
yeah you're spot on - the whole "can't fault AI for bugs" mindset is exactly the problem. like, if a junior dev shipped code that crashed on malformed input we'd send it back for proper validation, why would we accept worse from AI? I keep seeing this pattern where people lower their bar because the AI "mostly works" but then you get these silent failures or weird edge case explosions that are way harder to debug than if you'd just written defensive code from the start. honestly the scariest bugs aren't the ones that blow up in your face, it's the ones that slip through and corrupt data or expose something three deploys later
The mere existence of a research field is not proof of anything except "some people are interested in this". Its certainly doesn't imply that anyone truly understands how LLMs process information, "think", or "reason".
As with all research, people have questions, ideas, theories and some of them will be right but most of them are bound to be wrong.
reply