Thread

1. taylorfinley · 1790799418 · focus · HN ↗

   Ten days ago I had an experience with Gemini 3.8 flash that made me wonder if I was being routed to a different model under test. I was trying to use rocm with llama.cpp on my 128gb Strix Halo but could only get it to run Vulkan. I pasted the error message into agy and it proceeded to attach GDB to my GPU driver, reverse-engineer the kernel queue ioctl interface, and author an LD_PRELOAD C shim to get ROCm llama.cpp working on my Strix Halo. My jaw was hanging open the whole time.

   Edit to add the fix: <a href="https:&#x2F;&#x2F;gist.github.com&#x2F;birep&#x2F;6f2c8d490c7a29820997d57bd654c351" rel="nofollow">https:&#x2F;&#x2F;gist.github.com&#x2F;birep&#x2F;6f2c8d490c7a29820997d57bd654c3...

   1. alightsoul · 1790800007 · focus · HN ↗

      Please tell me you published your findings even as an issue on the llama.cpp GitHub

      1. warkdarrior · 1790800665 · focus · HN ↗

         Why? Anyone can run that prompt.

         1. aspect0545 · 1790800906 · focus · HN ↗

            Not everybody has access to AI. More than that, every prompt uses insane amounts of natural resources. So why not share it.

            1. FranzFerdiNaN · 1790801384 · focus · HN ↗

               The resources per prompt aren’t that much .

               Also I hope you don’t have children, eat meat, travel, have a car, run AC, buy things in other countries and such. Those things all take way way way more natural resources.

               1. hexfish · 1790802148 · focus · HN ↗

                  Checkmate. &#x2F;s
               2. qmr · 1790802473 · focus · HN ↗

                  Yet you participate in a society.

                  1. scarmig · 1790803262 · focus · HN ↗

                     If action X takes a million times more resources than action Y, it&#x27;s silly to focus on or highlight action Y. Seriously: if you are a regular meat eater, your choices use several orders of magnitude more water than even a heavy LLM user. A quip from a comic doesn&#x27;t somehow erase that or make it irrelevant.

                     1. qmr · 1790930388 · focus · HN ↗

                        It gets me 10 internet points though.
               3. articulatepang · 1790802675 · focus · HN ↗

                  All your examples are private goods: excludable and rival. If one person uses a unit, that prevents others from using them.

                  Patches to open source software are public goods. Your using them doesn’t prevent others from using them. So if you spend resources creating a public good, it’s in everyone’s interest to share it.

Unofficial Hacker News client; not affiliated with Y Combinator.