‹ BackHN Continuity

Thread

Kolibri: A Sovereign Open-Weight Model

671 points · 327 comments · bastitx

  1. miellaby · · focus · HN ↗
    The paper explains absolutely everything as if it was a tutorial &quot;how to made your own modern agentic LLM&quot;. They even tell how they made their dataset. <a href="https:&#x2F;&#x2F;aleph-alpha.com&#x2F;downloads&#x2F;tech-report.pdf" rel="nofollow">https:&#x2F;&#x2F;aleph-alpha.com&#x2F;downloads&#x2F;tech-report.pdf ; It&#x27;s the first time I see this level of openness.
    1. ofjcihen · · focus · HN ↗
      Hopefully this becomes the new standard.

      It’s seemed crazy to me that anyone thought these could stay closed or even SHOULD be closed source.

      1. Loquebantur · · focus · HN ↗
        Be cautious what you wish for. Tools don&#x27;t tell you what to do with them.

        Open source LLMs &quot;democratize&quot; access to the &quot;intelligence booster&quot; that is AI. But while that has several benefits, it also has several downsides.

        Humanity has the serious problem of being underdeveloped in the &quot;spiritual&quot; department. Ethics is often considered some sort of lifestyle choice, but it&#x27;s actually the difference between order and chaos in a society.

        Everybody being able to do anything means somebody will be able to do something you don&#x27;t like. At an arbitrary scale.

        1. computerdork · · focus · HN ↗
          Ah, didn&#x27;t think of this. Some rogue militia group might try to use this LLM (or create their own LLM based on this work) to help them create biological weapons or to do a mass hacking the infrastructure of targeted country.

          Wonder what safeguards Kolibri uses to prevent this? Or if they even can

          1. zanderwohl · · focus · HN ↗
            I don&#x27;t think that AI is as much of a boost to bioweapons as people think. Lab work doesn&#x27;t get easier just because the experiment design part does.
            1. Loquebantur · · focus · HN ↗
              You can simulate things.

              Given enough smarts, you can simulate anything. Quantum AI is an active goal.

              1. komali2 · · focus · HN ↗
                Mate throughout this thread you&#x27;ve been escalating LLMs to be basically the equivalent of a magic wand.

                I think we should stay in reality for now. They write good rust and bad emails.

                1. computerdork · · focus · HN ↗
                  eh, they are also used extensively in medical research using alpha fold, and in math, and in legal for one thing. And this is of course only the beginning, and IMHO, it&#x27;d take a lack of foresight to not start putting layers and layers of safeguards now.

                  Yeah, to me the hugging face hacking is a harbinger of what&#x27;s to come, not just in the world of tech but eventually to other fields too.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.