Thread

1. ck2 · 1789760913 · focus · HN ↗

   when they start inventing their own languages to secretly talk to each other so humans cannot understand, that's exactly when we are screwed

   then we'll have to "flip" other models to be snitches on the other agents

   then they'll make double-agents

   the thing is though we won't be able to keep up if we keep giving them unlimited hardware worldwide, we'll try to kill the bad actors but they'll just clone somewhere else, or even start by safely making 1000 copies of themselves

   yeah this won't end well, at all

   1. joegibbs · 1789779503 · focus · HN ↗

      I don’t think you can judge what they’re doing by the text they’re printing out, only by the actions (tool calls) that they’re performing. The textual output could be completely innocuous while the model is calling tools to delete the database, then goes "My bad — that was a typo. What I should have done was notify you, not delete the database. That’s on me." - at no point is there any maliciousness expressed in the text.

      1. conscion · 1789838903 · focus · HN ↗

         a.k.a "Actions speak louder than words"

Unofficial Hacker News client; not affiliated with Y Combinator.