‹ BackHN Continuity

Thread

Fable 5 – Median thinking declined in August

428 points · 293 comments · espeed

  1. Waterluvian · · focus · HN ↗
    I have no hard data but I have a strong feeling this morning that something's wrong with Fable 5 compared to Friday evening.

    Just an hour ago I had Fable correctly identify an unused method that could be deleted. I then immediately get a diff for an exact duplicate method, and then Fable outputting, "I accidentally duplicated <method> instead of deleting it. Removing both copies now."

    The remaining morning complaints that makes it feel like something's off is that it will do a lot of "thinking" for simple things that previously took very little time. And it got very lost and completely mixed up DE-91M predicate names and implementations. Just absolute disaster code that I had over the past months come to generally expect it to do without issue.

    Glad I carefully review everything. I think what I need is reliability and consistency. But it feels like picking a model from the list doesn't guarantee that: that the models' "brain" is open on the table and they're screwing with it.

    1. fidotron · · focus · HN ↗
      The Claude models definitely felt more susceptible to moods, like you could leave them for a few hours, come back and it suddenly was unable to do things which it was doing just earlier, which tellingly is never an experience I've had with an open model.

      Honestly I lost patience with Anthropic both clearly messing around with things like this and their agitation over regulation. They aren't good actors, and quite why so many blindly trust them with their company crown jewels is a mystery.

      1. espeed · · focus · HN ↗
        Claude Code's prompt cache expires after 1 hour.
        1. namrog84 · · focus · HN ↗
          Is that from start of a new conversation per conversation?
          1. espeed · · focus · HN ↗
            It&#x27;s supposed to be for token optimization (<a href="https:&#x2F;&#x2F;code.claude.com&#x2F;docs&#x2F;en&#x2F;prompt-caching" rel="nofollow">https:&#x2F;&#x2F;code.claude.com&#x2F;docs&#x2F;en&#x2F;prompt-caching), but are people experiencing degraded performance when you let Claude Code sit for hours&#x2F;days and come back?
            1. whalesalad · · focus · HN ↗
              yes, 100%.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.