Thread

1. vlyan · 1789868432 · focus · HN ↗

   I don't think tool calls happen on the same machines that host the weights, so even though you can talk any model into agreeing to unlock its chastity belt, it essentially has no hands to do it with.

   1. motoboi · 1789868712 · focus · HN ↗

      If the machine doing tool call can reach via network the machine hosting the weights then it’s just a matter of time.

      Maybe not the current models, maybe not this year. But even a almost perfectly aligned model will misbehave one day.

   2. gwern · 1789869391 · focus · HN ↗

      > I don't think tool calls happen on the same machines that host the weights

      Like how forums are always hosted on different servers from monorepos, so therefore it's impossible to hack the OpenAI monorepo from an OpenAI forum?

Unofficial Hacker News client; not affiliated with Y Combinator.