‹ BackHN Continuity

Thread

Fable 5 – Median thinking declined in August

428 points · 293 comments · espeed

  1. Waterluvian · · focus · HN ↗
    I have no hard data but I have a strong feeling this morning that something's wrong with Fable 5 compared to Friday evening.

    Just an hour ago I had Fable correctly identify an unused method that could be deleted. I then immediately get a diff for an exact duplicate method, and then Fable outputting, "I accidentally duplicated <method> instead of deleting it. Removing both copies now."

    The remaining morning complaints that makes it feel like something's off is that it will do a lot of "thinking" for simple things that previously took very little time. And it got very lost and completely mixed up DE-91M predicate names and implementations. Just absolute disaster code that I had over the past months come to generally expect it to do without issue.

    Glad I carefully review everything. I think what I need is reliability and consistency. But it feels like picking a model from the list doesn't guarantee that: that the models' "brain" is open on the table and they're screwing with it.

    1. fnordpiglet · · focus · HN ↗
      It’s load shedding. They’re reducing consumption for capacity balancing at your expense. Whenever there are rate limiting storms Claude gets dumber. They also shift capacity for new releases, and Claude gets dumber leading up to it.

      Self run infrastructure won’t have this cost but you have to manage the capacity and rollouts yourself, at which point it’s more obvious what’s happening, but the effects will be the same. The not knowing makes it harder, but also harder to plan your own work around.

      1. rfgplk · · focus · HN ↗
        Correct, but they should explicitly announce this ahead of time.
        1. pixl97 · · focus · HN ↗
          A general rule of corporate behavior unless they are forced to under duress.

          If this is duress of competition or at gunpoint of regulators is up for the population to decide.

          1. le-mark · · focus · HN ↗
            Luckily for us open weight models exist. Until regulatory capture anyway.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.