Thread

1. teagee · 1789610641 · focus · HN ↗

   Is there any precedent from other industries where a company tries to frame their own product’s shortcomings appear to be society’s problem?

   Would nytimes cover a self driving car company disclose concerning ‘behavior’ of their cars the same way?

   For anyone who has had to remind a coding agent to not leave comments over and over again, not following instructions seems more feature than bug

   1. bitexploder · 1789610988 · focus · HN ↗

      They are just pushing for favorable legal environment before the Anthropic IPO.

      1. [deleted] · 1789612266 · focus · HN ↗

         [deleted]

      2. EA-3167 · 1789619064 · focus · HN ↗

         I'll believe it when they confirm a date.
      3. bigglebear · 1789619285 · focus · HN ↗

         This is an entirely pointless exercise without transparency into how these "unreleased" models are trained, what their RL goals and biases are and related RL data, what their system prompts are, what their environments are and its restrictions, etc. What good is it for the industry to say:

         "Our unreleased model attempted to create a bioweapon", but "trust me bro, we didn't tell it to do that. We didn't train the model on a dataset that specializes in creating and glorifying bioweapons. We'd never stand to gain from misleading people about model capabilities in any way shape or form." - Anthropic are renowned for doing exactly this, for starters.

         So this ends up resulting in more safety theater. You can't have anything fruitful come of this without transparency. Stop trying to protect your moat if you truly care about safety and actionable outcomes, and provide real transparency, otherwise this is as good as saying nothing at all.

         I'm not even saying they're intentionally trying to do this by the way, but this is not sufficient if the goal is balanced incentives and accountability.

      4. swat535 · 1789661974 · focus · HN ↗

         It's not only that but another aim is for them to ban the competition, US and domestic, including open source models.

         Basically, the billionaire elites and their employees are panicking because they fear their funds are at risk when the bubble bursts.

Unofficial Hacker News client; not affiliated with Y Combinator.