The privacy issue blocks me from adopting this or other personal assistants: do I want to give muse my identity data and access to my mail, calendar, and phone so it can do even basic tasks like make appointments or pay bills?
It will be interesting to see if muse's privacy features can get users over this.
A lot of use cases for agents require long running sessions. And you're likely to have many agent sessions running in parallel. These aren't going to be running on your personal devices
Why not? Why wouldn't your phone be able to do this?
The other advantage long running sessions have is that very low tok/s are perfectly acceptable. In fact, hardly noticeable.
(aside, of course, from Google and Apple both having incentives to prevent this from happening, as both depend on selling centralized services to you and advertisers, and the local model breaks both)
I agree. I currently do run a bunch of dev containers on my local Docker but that is not good enough, they neeed to be able to work while I am on the run and close my laptop. So we are trying having personal containers on a managed Kibernetes cluster for every developer. We’re still working on making this work but it seems promising, the hardest thing being just permissions to let the agent use MCP servers, http APIs etc. If anyone has done this, how did you manage that?? I know there are products like OpenCLI that help with the problem but we want something we can build ourselves since AI makes it so much easier to build things!
Use ai to build it a poc and read the code after, learn, rebuild until you find something that works.
I host all of my custom applications on a machine in my home with Tailscale, k8, infrastructure as code
It’s wired, always on, has access to my gpu running on another machine or falls back to cloud inference
Self hosted GitHub action runners on each different platform for build/deploy of various projects: tauri v2, apis, web uis, native macOS apps, Unity 3d
None of this existed a month ago and it’s been a blast pretending to run my own platform
Durability and parallelism aren't that hard, and you won't be needing frontier models for much of this stuff. The parameter efficiency of models is increasing rapidly. I don't see why a (near-)future device wouldn't be capable of running a perfectly capable personal assistant.
My personal solution to this is to run DSH in an Incus VM on a local machine, then expose the web UI to the internet through my VPS (with some extra auth). I also made a couple of UI tweaks so it works better as a PWA.
Now I have persistent chats and a persistent environment that I can talk to from any device, including my phone. Even have X11 + CUA + Chromium inside the VM so the agent can use a real browser for sites that require it. DSH bwrap is the first layer of containment, VM is the second layer. I can swap between API models and local inference with a drop-down in the UI.
I realise this is way more setup than Meta's customers would tolerate, but the HN crowd could slap something together quite quickly. Using a coding agent with a nice chat UI as your general chat client is surprisingly smooth: just create an empty workspace.
I think Muse is the right shape in a lot of ways but I come unstuck at the point where my personal details and credentials are inside the VM.
egl2020 · · focus · HN ↗
It will be interesting to see if muse's privacy features can get users over this.
rienbdj · · focus · HN ↗
raz32dust · · focus · HN ↗
spwa4 · · focus · HN ↗
The other advantage long running sessions have is that very low tok/s are perfectly acceptable. In fact, hardly noticeable.
(aside, of course, from Google and Apple both having incentives to prevent this from happening, as both depend on selling centralized services to you and advertisers, and the local model breaks both)
brabel · · focus · HN ↗
devrwoody · · focus · HN ↗
I host all of my custom applications on a machine in my home with Tailscale, k8, infrastructure as code
It’s wired, always on, has access to my gpu running on another machine or falls back to cloud inference
Self hosted GitHub action runners on each different platform for build/deploy of various projects: tauri v2, apis, web uis, native macOS apps, Unity 3d
None of this existed a month ago and it’s been a blast pretending to run my own platform
ctolsen · · focus · HN ↗
wren6991 · · focus · HN ↗
Now I have persistent chats and a persistent environment that I can talk to from any device, including my phone. Even have X11 + CUA + Chromium inside the VM so the agent can use a real browser for sites that require it. DSH bwrap is the first layer of containment, VM is the second layer. I can swap between API models and local inference with a drop-down in the UI.
I realise this is way more setup than Meta's customers would tolerate, but the HN crowd could slap something together quite quickly. Using a coding agent with a nice chat UI as your general chat client is surprisingly smooth: just create an empty workspace.
I think Muse is the right shape in a lot of ways but I come unstuck at the point where my personal details and credentials are inside the VM.