> humans manage to do all sorts of mean things to one another, and the only reason that we haven't wiped ourselves out is that we need each other,
We don't need cats or dogs. Or orangutans. Why haven't we wiped them out? Because over the centuries we've expanded our moral circle, not contracted it. What's preventing us from engineering this same principle into GPT-n?
>What's preventing us from engineering this same principle into GPT-n?
Because "expanding our moral circle" is an incredibly vague concept, that developed (and not even consistently among all humans) as the results of billions of years of evolutionary history. We don't even fully understand it in ourselves, let alone in AGI.
Because you don't know how to. You don't know how they currently work and the resources to potentially do that are essentially nonexistent compared to the billions being poured into making GPT-n.
We don't need cats or dogs. Or orangutans. Why haven't we wiped them out? Because over the centuries we've expanded our moral circle, not contracted it. What's preventing us from engineering this same principle into GPT-n?