‹ BackHN Continuity

Thread

Our framework for reporting model misalignment

107 points · 96 comments · qprofyeh

  1. eithed · · focus · HN ↗
    What even is this shit? Every time I interact with models they do that, or any other variation of "let me make decisions on my own just to get the task done" - is all of this misalignment now? The most egregious to me was when model asked itself if it should proceed with dangerous command, gave itself approval and then wiped my local DB.

    What can I even do with this report? "Our models don't follow what users ask them to do", no shit sherlock.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.