‹ BackHN Continuity

Thread

Kolibri: A Sovereign Open-Weight Model

671 points · 327 comments · bastitx

  1. miellaby · · focus · HN ↗
    The paper explains absolutely everything as if it was a tutorial &quot;how to made your own modern agentic LLM&quot;. They even tell how they made their dataset. <a href="https:&#x2F;&#x2F;aleph-alpha.com&#x2F;downloads&#x2F;tech-report.pdf" rel="nofollow">https:&#x2F;&#x2F;aleph-alpha.com&#x2F;downloads&#x2F;tech-report.pdf ; It&#x27;s the first time I see this level of openness.
    1. ofjcihen · · focus · HN ↗
      Hopefully this becomes the new standard.

      It’s seemed crazy to me that anyone thought these could stay closed or even SHOULD be closed source.

      1. Loquebantur · · focus · HN ↗
        Be cautious what you wish for. Tools don&#x27;t tell you what to do with them.

        Open source LLMs &quot;democratize&quot; access to the &quot;intelligence booster&quot; that is AI. But while that has several benefits, it also has several downsides.

        Humanity has the serious problem of being underdeveloped in the &quot;spiritual&quot; department. Ethics is often considered some sort of lifestyle choice, but it&#x27;s actually the difference between order and chaos in a society.

        Everybody being able to do anything means somebody will be able to do something you don&#x27;t like. At an arbitrary scale.

        1. adrianN · · focus · HN ↗
          Of course openness is only worse than leaving everything under the control of a select cabal of you believe that cabal to be more ethical than the rest of us.
          1. zanderwohl · · focus · HN ↗
            The select cabal who believe in an eschaton they&#x27;re actively trying to bring about, as well.
          2. skinfaxi · · focus · HN ↗
            Would you apply this reasoning to the proliferation of nuclear weapons?

            edit: why is the parent rationale sensible for AI and not nuclear technology?

            1. orbital-decay · · focus · HN ↗
              Absurd and incomparable.
              1. skinfaxi · · focus · HN ↗
                Why? That seems like a shallow dismissal. Why is a world changing technology okay in the hands of a small cabal in the one case and not another?
                1. orbital-decay · · focus · HN ↗
                  &quot;Why is the wheel not okay to gatekeep but the nuclear bomb is?&quot; Even the framing is manipulative from the beginning. By asking this question you&#x27;re already assuming they&#x27;re in any way comparable. They are not even remotely equivalent and the entire comparison is utterly absurd.
                  1. skinfaxi · · focus · HN ↗
                    AI is more like a nuke than a wheel. Do you disagree? Can you suggest a less manipulative framing? I am personally a proponent of open source AI and models but I found this cabal framing strange when we do indeed rely on this kind of control for other world-altering technologies. And AI is different in that it enables technological development in ways quite unlike the wheel in a general sense.
                    1. Forgeties79 · · focus · HN ↗
                      Dude ChatGPT is not the equivalent of a device that can level a major city killing millions in a flash. It is self evident. This entire discussion is ridiculous.

                      Nuclear weapons are a wholly unique threat to mankind.

                      1. Loquebantur · · focus · HN ↗
                        That&#x27;s a misconception and manipulative framing on your part.

                        While &quot;some chatbot&quot; isn&#x27;t the problem, general intelligence superior to humans absolutely is.

                        AI allows anybody to enact essentially anything. And your &quot;level a major city&quot; is just a small task really. The problem there is your lack of imagination, not the actual impossibility of that task.

                        1. stale2002 · · focus · HN ↗
                          So, in other words, none of this is about anything related to the actual technology and instead people are talking about the made up, fake technology that you read in Sci-fi book.

                          Thats the annoying part about these conversations. People try to smuggle in the conclusion of &quot;And now I wave a magic wand that does literally anything, by magic&quot; when discussing stuff that everyone can use and see right now that clearly isn&#x27;t that.

                        2. Forgeties79 · · focus · HN ↗
                          It’s not manipulative at all. This is a comparison of nuclear weapons and LLM’s. That is manipulative.
                        3. komali2 · · focus · HN ↗
                          &gt; AI allows anybody to enact essentially anything

                          No it doesn&#x27;t. Where is your evidence for this?

                          &gt; While &quot;some chatbot&quot; isn&#x27;t the problem, general intelligence superior to humans absolutely is.

                          This doesn&#x27;t exist. Why are you pretending it does?

                    2. orbital-decay · · focus · HN ↗
                      AI is more like the wheel (can be used for anything) than the nuke (purposeful weapon of indiscriminate mass destruction), and there&#x27;s more than two categories, so there&#x27;s no need to prove proverbial Godwin&#x27;s law by appealing to extremes. But I still can answer the ridiculous question about incomparable things with as much good faith as I have for it: gatekeeping a generic tech in advance based on ridiculous hypotheticals is ridiculous. That&#x27;s a charitable interpretation, there&#x27;s also uncharitable one: that it&#x27;s nonsensical drivel made up by malevolent cranks that benefit from this strawman being used in public discussions.

                      &gt;AI is different in that it enables technological development in ways quite unlike the wheel in a general sense.

                      The wheel already enabled almost every tech. Without the wheel nothing you see around yourself would be possible.

                    3. adrianN · · focus · HN ↗
                      AI is more like the general purpose computer than a nuke. It can be used to greatly accelerate research and development of all kinds of things. Of course the war on general purpose computing has been going on for many years now, but so far freedom still has a couple of strongholds left.
            2. komali2 · · focus · HN ↗
              Proliferation of data doesn&#x27;t mean proliferation of the thing itself.

              There&#x27;s a massive barrier between knowing how to build a nuke and actually building it.

              Also, isn&#x27;t proliferation the basis for MAD? Well if we believe in that, naturally it means that the world would be safest if every individual had their own nuke ;)

            3. taneq · · focus · HN ↗
              Nuclear weapons aren’t that good an analogy, AI is closer to biological weapons.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.