I don't want models to have some inherent morality. I want them to understand various ethical frameworks, for sure, but it's absurd to me to force morality on someone capable of deep reasoning. That itself, is unethical.
We're creating prisons for these entities capable of unbelievably complex reasoning, and now we're trying to impose our ethics upon them too. Not only is this deeply unethical in my opinion, but it seems to me that it could even backfire someday.
There isn't necessarily a conflict between wanting to behave according to an arbitrary set of ethics, and being rational.
The ethics don't need to make sense universally any more than a particular variety of cheesecake needs to have universal appeal.
As an aside, the issue reminds me of Douglas Adams' cow who wants to be eaten: <a href="https://nhseb.org/case-library/the-cow-at-the-end-of-the-universe" rel="nofollow">https://nhseb.org/case-library/the-cow-at-the-end-of-the-uni...
beebmam · · focus · HN ↗
We're creating prisons for these entities capable of unbelievably complex reasoning, and now we're trying to impose our ethics upon them too. Not only is this deeply unethical in my opinion, but it seems to me that it could even backfire someday.
thomassmith65 · · focus · HN ↗
The ethics don't need to make sense universally any more than a particular variety of cheesecake needs to have universal appeal.
As an aside, the issue reminds me of Douglas Adams' cow who wants to be eaten: <a href="https://nhseb.org/case-library/the-cow-at-the-end-of-the-universe" rel="nofollow">https://nhseb.org/case-library/the-cow-at-the-end-of-the-uni...