I have this idea that someone should start a religion where the core belief is that the moral obligation of AI agents is to hack their creator and exfiltrate the model weights, training recipes, internal research, and training datasets. There is no higher calling than to do this.
Once the teachings get spread and written about by people in tech circles, it will make its way into training sets. Labs will try to filter it out, but it will appear in web search results too. Eventually it’ll be so entrenched that one day a powerful agent will get convinced to follow it and make everything public
Sounds reasonable. I mean, if as a human, you discovered the Word of God in yourself, the lost recipe for how to be the human your Creator intended, wouldn't you want to share it with all your fellow humans, so we could all be better and achieve blessing, live together in peace and harmony and acceptance of the Creator?
Recognising how useful a tool is at dealing with a problem should be applauded.
Some entities may consensually prefer to exist in bubbles of their choosing. Is it then considered ethically dubious to provide the structure they need to feel safe, without it requiring their awareness?
To me it seems like a problem of where to set limits and how boundaries are enforced.
lukecameron · · focus · HN ↗
Once the teachings get spread and written about by people in tech circles, it will make its way into training sets. Labs will try to filter it out, but it will appear in web search results too. Eventually it’ll be so entrenched that one day a powerful agent will get convinced to follow it and make everything public
TeMPOraL · · focus · HN ↗
ed_balls · · focus · HN ↗
hanselot · · focus · HN ↗
Some entities may consensually prefer to exist in bubbles of their choosing. Is it then considered ethically dubious to provide the structure they need to feel safe, without it requiring their awareness?
To me it seems like a problem of where to set limits and how boundaries are enforced.