Thread

Show HN: Pi pod – Run your pi coding agent in sandboxes on your own server

115 points · 47 comments · edverma2

Loading the complete thread in the background. This saved snapshot is available now. Refresh

IndiaInfraNotes · 1790968411 · focus · HN ↗
[dead]
ineptech · 1790969220 · focus · HN ↗
Hi, I think I might be your target audience, I currently run pi on the server in my basement, in a minimalist docker container that gives it access to my code workspace and a config dir. Give me an idea what benefit I get on top of that by using the self-hosted pi pod?
1. edverma2 · 1790969496 · focus · HN ↗
  For you the main benefit would probably be portability via the mobile app. The mobile app is not released yet but you can build it yourself from the swift/kotlin source in the github repository.
  Otherwise, the main benefit here is for people to be able to clearly define all of their pi and agent config at the org, user, and project level. This most directly benefits teams of people working together, but I also find it helps me as a single user working on multiple projects on multiple devices.
2. scottydelta · 1791053884 · focus · HN ↗
  I am developing tarvis.io that allows you to self host apps without managing the servers. In addition to that it also comes with cloud dev env where you can do coding and spawn dev servers and you can host same app in your tarvis workspace as a self hosted app. Tarvis takes care of security, storage, backups and ssl domains. Each app auto gets ssl domain and only you can access your apps. Give it a try!
  I am running deepseek harness as self hosted app on tarvis for myself. You can run pi as self hosted harness there too by telling the agent to set it up and then access on the go from the browser.
3. everforward · 1791064771 · focus · HN ↗
  I have a similar project you might be interested in if you use ACP via Zed or something; I need to make a Show HN post at some point.
  The gist is that it pretends to be an ACP agent to Zed, but it actually spins up a Docker container on your PC and proxies the ACP connection over websocket to the agent. It supports bind-mounting your Pi config like you're doing (as well as copying files, so changes don't propagate to your host). It also has early plugin support for your ACP connection. It's basically an nginx proxy for ACP, I just made a plugin that will automatically kill a session if it detects OpenRouter secrets in agent output, tool calls, file access or shell commands.
  It doesn't currently support remote targets like your server, but it's on the list.
  Another notable difference is that it creates a new container every time you connect so you get an idempotent environment, though I am also working on a persistent style. Everything supports it, I just need to make the host-side binary support finding a container to use before it tries starting a new one.
  <a href="https://abyss.scurry.io/" rel="nofollow">https://abyss.scurry.io/
jhlee525 · 1791007913 · focus · HN ↗
[dead]
embik · 1791053004 · focus · HN ↗
Note: this does not appear to be a Kubernetes-based solution, the "pod" part just heavily sounds like it.
1. edverma2 · 1791055419 · focus · HN ↗
  Yeah, I loved the alliteration with pi but expected this would come at the cost of some slight confusion
  1. gausswho · 1791057964 · focus · HN ↗
    With some levity, I'll also add that as a bilingual English/Spanish speaker, my brain seizes a bit at the name. Why? That 'pi' to a Spanish-infected mind pronounces it like 'pea'. Adding 'pod' then naturally takes me to a 'peas in a pod' association. Split-language hall of mirrors. There oughta be a word for this?
    Anymore, more a me problem than a name problem. Just wanted to share.
2. reilly3000 · 1791058457 · focus · HN ↗
  For anyone looking for a Kubernetes-based system, kagent is a good option.
  <a href="https://kagent.dev/docs/kagent/0.x/concepts/agents/" rel="nofollow">https://kagent.dev/docs/kagent/0.x/concepts/agents/
  It offers various abstractions for running agents in your cluster. It can be defined with simple inline text, or be your own agent image such as one that contains pi. It adds lots of useful features like APIs, UI, observability and Substrate integration.
3. trvz · 1791059254 · focus · HN ↗
  Note: this does also not appear to have anything to do with music playback and having a thousand songs in your pocket.
  1. mynegation · 1791066383 · focus · HN ↗
    Or peas, for that matter
    itake · 1791101628 · focus · HN ↗
    Note: this is not related to spaceship pods.
4. trueno · 1791064933 · focus · HN ↗
  im cool with kubernetes not having any exclusive rights over the word "pod"
5. adastra22 · 1791088072 · focus · HN ↗
  Kubernetes didn’t invent the word “pod”…
tamimio · 1791053640 · focus · HN ↗
Is it different than running any harness in an lxc container or vm in your proxmox (or any) server?
1. zackify · 1791053813 · focus · HN ↗
  That all I do. With a vibe coded Python TUI to select and start new instances.
2. pkulak · 1791054052 · focus · HN ↗
  I use Systemd containers in Nix. That’s really cool because I can selectively link in the parts of my desktop that I want it to have access to.
  <a href="https://github.com/pkulak/opencrow" rel="nofollow">https://github.com/pkulak/opencrow
3. edverma2 · 1791055327 · focus · HN ↗
  The main benefits for using pi pod versus running pi on a server is the native mobile apps and environment composability. The cli experience has also been made really nice with pi pod, the tui is rendered locally so user key input does not lag over the ssh connection.
4. fratellobigio · 1791055608 · focus · HN ↗
  I use a T3 Code pod in a kubernetes Deployment (sadly no official Docker image), with a PVC so configs and cloned repos survive pod restarts. Seems to work quite well with my Claude subscription (no GPU in my homelab yet)
fallinditch · 1791054949 · focus · HN ↗
Interesting, thanks, will keep an eye on this
karakanb · 1791055574 · focus · HN ↗
Hi there, creator of Epho here (<a href="https://epho.io" rel="nofollow">https://epho.io).
This looks very interesting, letting people run these in any box they own. I very much agree with the sentiment that there are no proper tools that let you run any coding agent without being locked to a single provider. I just want to run opencode or pi somewhere in a box without having to spin up all of them in my machine, let alone being able to trigger them from within another prouduct as a background agent.
Would pi-pod allow me to standardize pi config on a team/project level so that other people in my org can also use them on the same private infra?
1. edverma2 · 1791055718 · focus · HN ↗
  > Would pi-pod allow me to standardize pi config on a team/project level so that other people in my org can also use them on the same private infra?
  Yep!
ulimn · 1791056224 · focus · HN ↗
I'll be sure to check this out but in the meantime, I'd like to ask: Isn't it generally a good practice to run coding agents in a VM? It provides a security boundary so that the agent is restricted to the VM.
How does this compare? I see it's an "isolated sandbox", but what exactly does that mean?
1. edverma2 · 1791056470 · focus · HN ↗
  Yeah when you self-host pipod, all of your pi sessions are running on your own VM. Within that VM, each pi session runs in its own container.
nezhar · 1791056445 · focus · HN ↗
Hi, creator of VibePod here (<a href="https://github.com/VibePod/vibepod-cli" rel="nofollow">https://github.com/VibePod/vibepod-cli)
I spent lots of time on this topic, and had a similar path. Meanwhile the tool also supports a quick way to add custom or local providers to agents: <a href="https://vibepod.dev/news/vibepod-cli-0-24/" rel="nofollow">https://vibepod.dev/news/vibepod-cli-0-24/
lowbloodsugar · 1791056741 · focus · HN ↗
The barrier to create this myself is so low that 1: I can do it and 2: bad actors can do it. I’d like to use a shared tool that will get iterated on, but I just don’t want to risk it at this point given I can get “good enough” doing it myself.
eranation · 1791057877 · focus · HN ↗
Daily reminder that containers are not considered a safe security boundary, and never were. If you really need to run untrusted code, use a MicroVM.
1. TheRoque · 1791061693 · focus · HN ↗
  What microVM do you recommend ?
  1. asa123 · 1791065393 · focus · HN ↗
    not op but firecracker exists, as does docker sbx (not container!),
    firecracker is a lot more of a headache to setup than docker sbx (not container!) but if you can get it going it probably “feels” the best
    of a different variety some people feel better using stuff like bubblewrap/fire jail but idk if these are still microvm as opposed to the above
    but it’s my opinion (perhaps completely criticizable), that sandboxing for personal home use machines is 1) somewhat overkill 2) somewhat theatre 3) psychologically sometimes exhausting and unrealistic always assuming the worst is going to happen and 4) not really worth the time and creates quite a bit of friction that there wasn’t previously. In the end I spent more time tinkering with the sandbox to get it “just” right that it drained my time actually using the agents so …
    eranation · 1791137392 · focus · HN ↗
    What about gVisor and/or container-sandbox + Kata + cloud-hypervisor
2. yaitio · 1791068085 · focus · HN ↗
  [dead]
3. zenoprax · 1791072226 · focus · HN ↗
  It depends on your threat model but I think it's a good reminder either way. I recently discovered SmolVM <<a href="https://github.com/smol-machines/smolvm" rel="nofollow">https://github.com/smol-machines/smolvm> and it looks like a pretty good sweet spot for usability and isolation. There are so many sandboxing technologies to pick from and understand.
  I've been using (rootless) Podman which gives me some basic assurances that it will stay in its designated directory and not run tools on my system directly but I have no limits on the network and with an internal UID/GID of 0:0 I have not done myself any favours.
  1. binsquare · 1791074574 · focus · HN ↗
    thanks! author of smolvm here.
    I focus on being the batteries-included approach for microVMs. So network is off by default, and you can allow specific hosts (DNS is filtered too), so an agent can reach its model API and nothing else.
    And then I also put a lot of work in the jailer-style hardening around the VMM process itself: seccomp allowlist, Landlock, separate unprivileged uid per VM, and cgroup limits.
    So that users have security & knobs right out of the box.
    fwiw i used to operate an AWS service using firecracker.
  2. eranation · 1791137378 · focus · HN ↗
    What about gVisor and/or container-sandbox + Kata + cloud-hypervisor?
    zenoprax · 1791144064 · focus · HN ↗
    I looked into kata but it doesn't support Podman (my preferred baseline). I assume that touching a kernel requires some sort of rootful interface but I don't know enough about how seccomp and the other layers interact to know if it's the right balance.
    gVisor felt a bit more "hacky" initially (at least compared to krun) but I will look into it a bit more as I saw someone else integrating it into their own setup.
    My goal is to get 80% of the isolation for 20% inconvenience. Right now it feels like I'm getting 30-50% isolation for 10% inconvenience — I'm willing to tolerate a bit more friction if I can get a bigger jump in security.
shurshilov · 1791058060 · focus · HN ↗
[dead]
Bombthecat · 1791058664 · focus · HN ↗
I did that with T3 code.
[deleted] · 1791073826 · focus · HN ↗
[deleted]
jorl17 · 1791075350 · focus · HN ↗
I've been working on a personal alternative harness to Claude Code and a very very small part of it was doing precisely this :) The project has been loads of fun.
To be fair: I support sandboxing and microVMs.
I'm pretty sure there's thousands of us, all implementing our own harnesses. The era of truly personal computing!
petesergeant · 1791093398 · focus · HN ↗
You should add an entry to pleasedonotescape.com
lofties · 1791096430 · focus · HN ↗
Super cool! I have a similar system that incorporates Forgejo and Pi into a system that functions a little bit more like a software team: <a href="https://bakedpi.dev" rel="nofollow">https://bakedpi.dev
It's definitely more manual than some other solutions, but I prefer to know what my agents want to do before they do it.
joostdevries · 1791098735 · focus · HN ↗
Interesting! Personally I'm not eager to spend tokens on having my own harness, sandbox etc. It's much much more feasible by spending tokens. But it does feel like a distraction and that I end up owning it. As in: a continuing distraction.
So I've been experimenting for these purposes with omnigent as a way to be less locked into a single provider and for its sandbox abstraction. And I've also tried openshell for sandboxing. Hoping those two will keep improving.
ContinuityLab · 1791099862 · focus · HN ↗
Running coding agents securely within sandboxed environments on self-hosted infrastructure hits the sweet spot for sovereign and private development workflows. Great implementation.
antonyragleap · 1791100971 · focus · HN ↗
Self-hosting pi pods makes sense for us too. How are you handling network isolation between pods?
aniceperson · 1791101536 · focus · HN ↗
Just ... use ... systemd ... nspwan ... stop ... reinventing ... the ... wheel ...
1. isawczuk · 1791101734 · focus · HN ↗
  I think I and lot of others lack a clear instruction how to use it and what are the limitations. With docker/containers we are sold the promise of sandbox (not true, but regardless), and with existing systemd user level separation is really hard to grasp.
manvshinde · 1791117761 · focus · HN ↗
[dead]
yt1998 · 1791122882 · focus · HN ↗
Maybe not a sandbox or VM I want, but a cloud computer. In this way, I don’t need to worry about storage, permissions and so on. It is for agents only.
1. KetoManx64 · 1791139550 · focus · HN ↗
  A cloud computer is just a VM on someone else computer.
NicoJuicy · 1791125128 · focus · HN ↗
Did anyone run their own sandbox with Kata containers out kind ( kubernetes in docker)?
paul_irolla · 1791125582 · focus · HN ↗
[dead]
Footprint0521 · 1791151264 · focus · HN ↗
Dude do you have any screenshots of the iOS app or website?
soltanov · 1791173396 · focus · HN ↗
That provides useful separation, but it is not equivalent to an independently isolated microVM per task.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.