‹ BackHN Continuity

Thread

WalShadow: Sub-second Postgres replication to ClickHouse from physical WAL

63 points · 10 comments · spathak

  1. vmsp · · focus · HN ↗
    They're not using `wal_level = logical`, which has been the "friendly" way of doing CDC on Postgres since ever, but are going straight to `wal_level = replica` which, afaik, has never really been used to build something atop of except Postgres' own replication.

    This is very interesting. I'd never have guessed that it'd make such a difference. I also bet this is the sort of thing that would have never end up being implemented without access to coding agents. Having to figure out these protocol-level details is no longer the huge time sink it was

    1. __s · · focus · HN ↗
      we require wal_level=logical, would be nice to support looser in future

      agreed that there's a huge complexity cost to going this route

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.