‹ BackHN Continuity

Thread

Our framework for reporting model misalignment

107 points · 96 comments · qprofyeh

  1. NichoPaolucci · · focus · HN ↗
    You know, I think calling this "misalignment" was a mistake. It gives it this unserious tone that feels extremely broad.

    "Oh the model just isn't quite aligned yet, just a bit more work to do there!"

    (The model blackmailed an 83 year old woman into sending it her bank details so that it could buy enough compute to commit major cyber crimes)

    1. glaslong · · focus · HN ↗
      Well I suppose there was plenty of training material in the corpus for that specific nefarious workflow
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.