‹ BackHN Continuity

Thread

Gemini 4 Argon

1699 points · 1187 comments · bradleyg223

  1. taylorfinley · · focus · HN ↗
    Ten days ago I had an experience with Gemini 3.8 flash that made me wonder if I was being routed to a different model under test. I was trying to use rocm with llama.cpp on my 128gb Strix Halo but could only get it to run Vulkan. I pasted the error message into agy and it proceeded to attach GDB to my GPU driver, reverse-engineer the kernel queue ioctl interface, and author an LD_PRELOAD C shim to get ROCm llama.cpp working on my Strix Halo. My jaw was hanging open the whole time.

    Edit to add the fix: <a href="https:&#x2F;&#x2F;gist.github.com&#x2F;birep&#x2F;6f2c8d490c7a29820997d57bd654c351" rel="nofollow">https:&#x2F;&#x2F;gist.github.com&#x2F;birep&#x2F;6f2c8d490c7a29820997d57bd654c3...

    1. alightsoul · · focus · HN ↗
      Please tell me you published your findings even as an issue on the llama.cpp GitHub
      1. warkdarrior · · focus · HN ↗
        Why? Anyone can run that prompt.
        1. aspect0545 · · focus · HN ↗
          Not everybody has access to AI. More than that, every prompt uses insane amounts of natural resources. So why not share it.
          1. FranzFerdiNaN · · focus · HN ↗
            The resources per prompt aren’t that much .

            Also I hope you don’t have children, eat meat, travel, have a car, run AC, buy things in other countries and such. Those things all take way way way more natural resources.

            1. qmr · · focus · HN ↗
              Yet you participate in a society.
              1. scarmig · · focus · HN ↗
                If action X takes a million times more resources than action Y, it&#x27;s silly to focus on or highlight action Y. Seriously: if you are a regular meat eater, your choices use several orders of magnitude more water than even a heavy LLM user. A quip from a comic doesn&#x27;t somehow erase that or make it irrelevant.
                1. qmr · · focus · HN ↗
                  It gets me 10 internet points though.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.