‹ BackHN Continuity

Thread

I don't want to read what you didn't write

1070 points · 460 comments · mooreds

  1. muzani · · focus · HN ↗
    There's a lot of misunderstanding here. The quality of LLM writing has not plateaued, it has dropped significantly. They've cut it to the point where people start noticing.

    Do a search on "Claude Sonnet 4.5" on Reddit and you'll see lots of disappointed users [1]

    If I could give out ratings,

    Average human with a degree: 5/10

    Sonnet/Opus 5: 2/10

    GPT 6 Astra, 5.4 Sol: 3/10

    Sonnet 4.6: 8/10

    Claude Sonnet 4.5: 9/10

    GPT 4o: 6/10

    GPT 4.5: 10/10

    GPT 3 Davinci (with a lot of coaching): 7/10

    [1] <a href="https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;claudexplorers&#x2F;comments&#x2F;1ta6f9c&#x2F;i_still_dont_understand_why_they_remove_sonnet_45&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;claudexplorers&#x2F;comments&#x2F;1ta6f9c&#x2F;i_s...

    1. hatthew · · focus · HN ↗
      I&#x27;m curious if there have been any formal studies on this. I suspect that people have become better over time at identifying LLM writing styles, and are also combining that with selection&#x2F;confirmation bias. Dunno what fraction of the perceived drop in quality comes from that.
      1. muzani · · focus · HN ↗
        Yeah, I think I&#x27;ll start making my own creative writing benchmark. It&#x27;s a little late to start data collecting, but better late than never.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.