‹ BackHN Continuity

Thread

Gemini 4 Argon

1699 points · 1187 comments · bradleyg223

  1. taylorfinley · · focus · HN ↗
    Ten days ago I had an experience with Gemini 3.8 flash that made me wonder if I was being routed to a different model under test. I was trying to use rocm with llama.cpp on my 128gb Strix Halo but could only get it to run Vulkan. I pasted the error message into agy and it proceeded to attach GDB to my GPU driver, reverse-engineer the kernel queue ioctl interface, and author an LD_PRELOAD C shim to get ROCm llama.cpp working on my Strix Halo. My jaw was hanging open the whole time.

    Edit to add the fix: <a href="https:&#x2F;&#x2F;gist.github.com&#x2F;birep&#x2F;6f2c8d490c7a29820997d57bd654c351" rel="nofollow">https:&#x2F;&#x2F;gist.github.com&#x2F;birep&#x2F;6f2c8d490c7a29820997d57bd654c3...

    1. gottorf · · focus · HN ↗
      My experience with Gemini 3.8 Flash has been awful; it gives me the most hallucinations out of the major models. I&#x27;m not using it for coding, but general research on different topics.
      1. Gareth321 · · focus · HN ↗
        I agree. It&#x27;s much worse than the cheap Chinese models. They appear to heavily bias parametric knowledge and discourage tool use. That&#x27;s fine for things like &quot;how do I perform CPR?&quot; but worse than useless for any kind of research. [There is one benchmark showing far lower rates of hallucination, so let&#x27;s see how accurate this is.](<a href="https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;singularity&#x2F;comments&#x2F;1wuj72j&#x2F;gemini_4_argon_solved_hallucinations&#x2F;" rel="nofollow">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;singularity&#x2F;comments&#x2F;1wuj72j&#x2F;gemini...)
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.