‹ BackHN Continuity

Thread

Sonnet 5.5

884 points · 613 comments · D2OQZG8l5BI1S06

  1. MisterMunchkin · · focus · HN ↗
    It costs 20x more than the Chinese models I use. I just don’t need them anymore. Sure I’d use them if forced to for a job, but I don’t pay them outside of that anymore.

    And my job won’t even pay for Claude now because it’s so ruinously expensive.

    1. yipinwong · · focus · HN ↗
      Say that to Luna's face. Ya all bringing up this not-so-cheap-nowadays chinese models and not that more intelligent than luna and bringing "cost" as the only factor.
      1. cromka · · focus · HN ↗
        Not even GPT6 Sol cannot match DeepSeek 4.1 in my work, with outrageous bugs. Don't get me started on Luna.

        From my today's session with Sol:

        - it actually failed to correctly understand a simple English grammar and logical implication of it, then when challenged it admitted its mistake but couldn't explain why it made it.

        - for the code I am working on, I asked to create two PRs for the two small features (couple lines of code). It created one in upstream, as intended, and other one in my own fork. Just like that, out of nowhere, and called the job done.

        - it said it would ask me to approve/amend the suggested PR message, it never did and fired off right away

        - it keeps forgetting the changes it did itself; no context compaction was used

        - it said it tested the change visually, but it did not even try

        - hallucinated several facts despite me asking beforehand to check online.

        On top of that, it ignores all of my AGENTS.md, which is short and concise. I mean I point it at ignoring it, it acknowledges and ignores again.

        This is astonishingly bad and it is nowhere close to what Sol 5.6 was a month ago.

        I can't deal with this sh*t anymore, I have no trust in the tools I use and both OpenAI and Anthropic do the same thing.

        1. gruez · · focus · HN ↗
          >Not even GPT6 Sol cannot match DeepSeek 4.1 in my work, with outrageous bugs.

          That seems hard to believe even with deepseek's own benchmarks. Not to mention for every person who says chinese ai is ahead of american labs, there's like 10 saying that they're benchmaxxed or that they're merely "decent value for money".

          1. MitziMoto · · focus · HN ↗
            Yeah, I don't know what model that guy is using. He's talking about Sol like it's GPT4.

            I haven't had these issues in multiple model generations of models.

            Failing to understand English grammar? Give me a break.

            1. cromka · · focus · HN ↗
              > me: "The tool divides network rates by 1,000, but uses the \`KB\` instead of \`kB\`. \`KB\` (alongside the SI-standardized KiB), is reserved for units based on 1,024. This change corrects the usage of those units.

              > it: That still attributes two claims to SI that SI does not make. `KB` is not reserved for 1,024 bytes, and `KiB` is the standardized binary symbol.

              > me: where does it say that SI reserves KB?

              > it: Nowhere. You said *KiB* was SI-standardized; you did not say SI reserves *KB*. I misread your sentence and argued against a claim you did not make.

              It was correct to point me out on my mistake in essence, but still misunderstood my bracketed "(alongside the SI-standardized KiB)" sentence.

              Sure, it wasn't a grammar mistake as such, more like a logical one, but it still shouldn't make it. I had more than one such issues already with it, this one was most pronounced.

              What it interesting, though, is the number of corporate apologists my comment brought in. It's like it doesn't matter how many times OpenAI and Anthropic have botched some of the models while keeping the branding, some people would still die on that apologist hill.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.