‹ BackHN Continuity

Thread

Fable 5 – Median thinking declined in August

428 points · 293 comments · espeed

  1. Waterluvian · · focus · HN ↗
    I have no hard data but I have a strong feeling this morning that something's wrong with Fable 5 compared to Friday evening.

    Just an hour ago I had Fable correctly identify an unused method that could be deleted. I then immediately get a diff for an exact duplicate method, and then Fable outputting, "I accidentally duplicated <method> instead of deleting it. Removing both copies now."

    The remaining morning complaints that makes it feel like something's off is that it will do a lot of "thinking" for simple things that previously took very little time. And it got very lost and completely mixed up DE-91M predicate names and implementations. Just absolute disaster code that I had over the past months come to generally expect it to do without issue.

    Glad I carefully review everything. I think what I need is reliability and consistency. But it feels like picking a model from the list doesn't guarantee that: that the models' "brain" is open on the table and they're screwing with it.

    1. prodigycorp · · focus · HN ↗
      New release of fable and opus 5.5 is pending and Anthropic is reallocating resources. Degradation always happens in transition, it sucks.

      Opus 5.5 is being served under opus 5 right now.

      1. pertymcpert · · focus · HN ↗
        Why would reallocating resources make a single inference run worse in quality?
        1. carljungslabtek · · focus · HN ↗
          Isn’t the idea that they’re limiting the amount of gpu time normal users get to spend on the “thinking” portion of their query?

          I think that’s the claim in the post, that even though no one can see the true chain of thought, that even the “thinking” text that does get exposed to the user is shorter given the same prompts over time. Not saying it’s true but I think that’s the claim. I’ve personally never noticed the alleged “nerfing” with my enterprise use at work or my subscription use at home which is only during off hours.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.