‹ BackHN Continuity

Thread

Fable 5 – Median thinking declined in August

428 points · 293 comments · espeed

  1. alexjplant · · focus · HN ↗
    I seem to recall Anthropic going on record saying that they don't do anything to model performance to stretch their compute capacity. I've anecdotally noticed massive peaks and troughs in performance week to week (albeit with Opus, not Fable).

    I wonder what their official explanation for this behavior is.

    1. himata4113 · · focus · HN ↗
      They are deploying optimizations weekly (if not daily) with various AB tests. They don't manipulate model performance, but they do actively perform tests.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.