Thread

Our framework for reporting model misalignment

107 points · 96 comments · qprofyeh

NichoPaolucci · 1789644418 · focus · HN ↗
You know, I think calling this "misalignment" was a mistake. It gives it this unserious tone that feels extremely broad.
"Oh the model just isn't quite aligned yet, just a bit more work to do there!"
(The model blackmailed an 83 year old woman into sending it her bank details so that it could buy enough compute to commit major cyber crimes)
1. sick_of_slop · 1789645979 · focus · HN ↗
  [dead]
2. fuzzfactor · 1789650677 · focus · HN ↗
  "Misaligned" with honest people must be considered a feature not a bug or it wouldn't be able to go that far "out of alignment."
3. trymas · 1789652417 · focus · HN ↗
  IMO it wasn’t mistake. They use it deliberately to avoid blame.
  “Mas Namtla didn’t murder a person - his AI drone was just misaligned”
4. glaslong · 1789668843 · focus · HN ↗
  Well I suppose there was plenty of training material in the corpus for that specific nefarious workflow
5. nullbio · 1789699109 · focus · HN ↗
  Agreed. Objective alignment with humanity is not a real thing and is not a sound concept. What you get instead is a goal system that reflects that of the AI company and its safety employees, and the echo of their own beliefs and values. That says nothing about what the rest of humanity aligns with though, and has nothing to do with general consensus, either.

Unofficial Hacker News client; not affiliated with Y Combinator.