Thread

1. gavinray · 1790094229 · focus · HN ↗

     > Postgres makes those files searchable. memory.entries stores chunks and line references, memory.embeddings holds 384-dimensional vectors, and memory.claims tracks evidence, confidence, and status. 
   

   Is each Muse instance running it's own Postgres??

   That seems wildly wasteful, especially since earlier in the article it states that the Muse instance has a SQLite database and schema already...

   1. cute_boi · 1790096227 · focus · HN ↗

      Looks like RAM shortage hasn't hit meta yet. They are probably burning money to grab userbase.

      1. tsunitsuni · 1790097195 · focus · HN ↗

         My instance claims the container has 2 vCPU and 8gb of RAM. I got it to set up a Minecraft server with access over Tailscale

         1. dcss_gardener · 1790098538 · focus · HN ↗

            It's the best free vps on the market right now. Comes with a coding harness and a few hundred million tokens on a decent model. Can't last long but it's fun.

            1. Gareth321 · 1790103311 · focus · HN ↗

               I’m trying to rein in my hyperbole but if Meta is able to follow through on the promise, Muse is world-changing. I share the scepticism. How on Earth can they offer this for free?

               1. bryan_w · 1790118501 · focus · HN ↗

                  Hyperion.
               2. tancop · 1790148995 · focus · HN ↗

                  They have paid subscriptions and it gets you using other Meta services more so they make money from ads. If that's not enough they might put ads and affiliate links when you use it for shopping.

                  The VM is about the same specs as a 9EUR/month VPS from Hetzner but it only runs a fraction of the time, they spin it down when Muse stops using it. Meta is a hyperscaler with optimized infra and they don't need to make a profit because VMs are not their actual service. I think it costs them at least 10x less than inference for most users.

         2. kevinrineer · 1790103208 · focus · HN ↗

            I guess I'm poor then because my homelab has nodes with these specs.
   2. Gareth321 · 1790102662 · focus · HN ↗

      Wasteful but FAR more secure. Surprisingly secure. If they wanted to follow through on their promise of sandboxed and encrypted data which even they couldn’t access, this is one way to do it.

      1. corford · 1790107601 · focus · HN ↗

         > which even they couldn’t access

         What would prevent them from getting the data out of postgres?

         1. Gareth321 · 1790144961 · focus · HN ↗

            E2E encryption, but I don't know the architecture. I.e. Meta doesn't have the keys. My comment above is based on an interview I saw with Zuckerberg where he wanted to use the Signal model to ensure the data was secure "even from Meta."

Unofficial Hacker News client; not affiliated with Y Combinator.