‹ BackHN Continuity

Thread

Cloudflare OS: an open platform for agents, apps, and work

641 points · 315 comments · speckx

  1. rozenmd · · focus · HN ↗
    I liked Kenton&#x27;s take on this: <a href="https:&#x2F;&#x2F;x.com&#x2F;KentonVarda&#x2F;status&#x2F;2084990137180590572?s=20" rel="nofollow">https:&#x2F;&#x2F;x.com&#x2F;KentonVarda&#x2F;status&#x2F;2084990137180590572?s=20

    Text from tweet:

    Today we are releasing Cloudflare OS, a chatbot with connectors, just like every other tech company is doing.

    Except actually, it&#x27;s different. This is a remake of Sandstorm[.]io, my startup from 10 years ago, except this time built on Cloudflare Workers (the platform I&#x27;ve spent the last 9 years building) and deeply leveraging AI. This is more or less the culmination of my secret 10-year master plan.

    This is a full-on personal app vibe coding platform, in which the sandbox is so secure that you can pretty much go wild -- the AI cannot introduce a significant security bug. We believe a company&#x27;s security team can feel comfortable giving non-technical users permission to vibe code and then sleep soundly at night.

    How is that possible? It&#x27;s the Sandstorm security model, revisited. A &quot;Gadget&quot; is the same thing as a Sandstorm &quot;Grain&quot;: a fine-grained app instance. For example, if you have a document editor app, each document runs as a separate instance of the app, in a separate sandbox (one &quot;Gadget&quot;).

    This means two things, both of which I think are Big Deals: 1. The platform can manage all access control, by controlling who can access the Gadget at all. There is no way the Gadget can accidentally leak itself to an attacker -- even an attacker who has access to other Gadgets based on the same app. 2. Since everyone is running their own copy of the code, everyone can freely modify their copy of the code.

    Think about #2 a bit more.

    What if, when you wanted a new feature in the software you are using, you could just prompt your agent to add it?

    This doesn&#x27;t work in the cloud Software-as-a-Service model, because you are not running your own copy of the app.

    Sandstorm tried to change that 10 years ago, but the world wasn&#x27;t ready, because not enough people had the skills or patience to actually modify their software. AI has changed that. Now you just ask the agent -- the same agent that you are using to help you interact with the Gadget can also modify the code of the Gadget.

    And it is so fun.

    1. mosura · · focus · HN ↗
      Sandstorm without self hosting has no interest though. (Edit: see below, where the creator states it _can_ be run locally)

      Buzz looks like a more reasonable direction than this does.

      1. kentonv · · focus · HN ↗
        What do you mean? This is 100% open source and self-hostable!

        <a href="https:&#x2F;&#x2F;github.com&#x2F;cloudflare&#x2F;cloudflare-os" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;cloudflare&#x2F;cloudflare-os

        It runs on the open source Workers Runtime:

        <a href="https:&#x2F;&#x2F;github.com&#x2F;cloudflare&#x2F;workerd" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;cloudflare&#x2F;workerd

        You can run it at home if you want. There&#x27;s even a Home Assistant Gatekeeper.

        1. mosura · · focus · HN ↗
          So you can run it off the public internet with no sneaky external dependency on cloudflare, slack etc?

          And it would be functionally the same? With the same performance if you put enough hardware there?

          If so cool, and that should have been clearly in the announcement, because as it sounded it is “I am a sucker, lock me in!”

          1. kentonv · · focus · HN ↗
            &gt; So you can run it off the public internet with no sneaky external dependency on cloudflare, slack etc?

            Yes. It even supports ollama and works decently well with some local LLMs.

            &gt; And it would be functionally the same? With the same performance if you put enough hardware there?

            Honestly it is faster running locally.

            &gt; If so cool, and that should have been clearly in the announcement,

            We had so many things we wanted to say, it was hard to fit them all into one story.

            The blog post is for an enterprise audience. My tweet thread is for the hacker audience.

            1. mosura · · focus · HN ↗
              That is actually cool.

              Maybe it is my bubble, but the experience people are having with Anthropic particularly is motivating a big “get this stuff back under control” effort so while it may not be strategically optimal for Cloudflare the local hosting would prove more valuable to enterprises than maybe a few years back, even if presented as a backup plan.

            2. edaemon · · focus · HN ↗
              Neat! How does that work with the AI Gateway portion? I see some references in the code but at a quick glance I can&#x27;t tell if you can configure it to skip AI Gateway.
              1. kentonv · · focus · HN ↗
                Use of Cloudflare AI Gateway is optional.

                In the default configuration, you just plop your Anthropic&#x2F;OpenAI&#x2F;Gemini&#x2F;Workers AI&#x2F;ollama API keys into the UI and it talks to each provider directly.

                That said, I would recommend AI Gateway, it has a lot of nice features. :)

          2. upcoming-sesame · · focus · HN ↗
            You&#x27;re not alone The name &quot;cloudflare-os&quot; by itself made me think this was heavily based on Cloudflare
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.