‹ BackHN Continuity

Thread

S3 Is the Future, S3 Is the Past

79 points · 120 comments · tkhattra

  1. zokier · · focus · HN ↗
    Right now it is not even clear how to interface with SSDs even on a single host, there has been all sorts of attempts to move away from the traditional plain block device model. NVMe has extensions for KV, ZNS, and FDP, all which offer different characteristics. And then there are of course open channel SSDs and some others too. I kinda expect the future foundational IO interface to be more S3-like than block-device or unixy filesystem-like.
    1. jauntywundrkind · · focus · HN ↗
      I really wish reviewers would harp on FDP (Flexible Data Placement) and perhaps KV support. FDP supposedly somewhat ate ZNS as a spec, allegedly, but there might be gaps, reasons to keep ZNS.

      There's only a small little mention, if we are lucky, on the couple drives that have it (expensive enterprise flagships). It should be a regular sticking point, whether it's there or not. Without pressure it's not going to get regularly available, it feels like.

      FDP is so simple. Declare a number for what pool of data you want to write into. Data of the same pool gets written to the same storage such that you can wipe it latter together. It has huge wins though against write amplification! Massive wins. For so close to free.

      Some day I want to own a FDP drive. And then I can finally start using the tokio&#x2F;io-uring support that I contributed! <a href="https:&#x2F;&#x2F;github.com&#x2F;tokio-rs&#x2F;io-uring&#x2F;issues&#x2F;380" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;tokio-rs&#x2F;io-uring&#x2F;issues&#x2F;380

      The NVMe-KV is more radical. Still worth putting some pressure on, but your drive as KV, as object store, feels harder. Side note, really enjoyed this ceph nvme-kv offload post thing, my favorite tech write up in a while! <a href="https:&#x2F;&#x2F;ceph.io&#x2F;en&#x2F;news&#x2F;blog&#x2F;2026&#x2F;for-whom-the-door-bell-tolls&#x2F;" rel="nofollow">https:&#x2F;&#x2F;ceph.io&#x2F;en&#x2F;news&#x2F;blog&#x2F;2026&#x2F;for-whom-the-door-bell-tol...

      1. someonebaggy · · focus · HN ↗
        FDP relies on putting logic on the drive side, then they can upcharge for drives with this feature and still give you limited control. If you go the other direction instead, you have MTD devices which gives the host system kernel full control over data placement, page erasing and error correction, and for this reason they need specialized filesystems. These devices usually aren&#x27;t attached over PCIe as they use controllerless raw flash interfaces instead, but in principle they could be.
        1. jauntywundrkind · · focus · HN ↗
          I&#x27;m very much a fan of open channel flash. My understanding is that the Open Channel flash people when they tried a decade ago basically got told no by drive makers, that the drive makers weren&#x27;t interested in becoming commodity vendors, and were intent on keeping product lines somewhat as they were. I wish I had some links to share to back this up, but that&#x27;s basically my recall. ZNS and then FDP was sort of a compromise to give people some of the wins they were looking for, while basically not disrupting the product.

          FDP is a very minimal addition of control. But yes it is another box to ticket, is another place to upcharge. Yet still, we&#x27;re only just seeing mainstream products emerge. Kioxia&#x27;s CM10 for example. <a href="https:&#x2F;&#x2F;www.techpowerup.com&#x2F;351218&#x2F;kioxia-introduces-first-pcie-6-0-enterprise-ssds-utilizing-newest-bics-flash-generation-10" rel="nofollow">https:&#x2F;&#x2F;www.techpowerup.com&#x2F;351218&#x2F;kioxia-introduces-first-p...

          I&#x27;m hoping that the need is great enough to break the industry control. I think for a while the market felt relatively well enough served such that it was unclear whether clear wins would actually result in customers. With AI need for speed, I can definitely imagine incredibly crazy CXL controllers or what not, that allow low latency acces to many many open channel flash systems. Wouldn&#x27;t that be a thing.

          Again though, FDP is such a ridiculously tiny add, and it helps SSDs so much for so many use cases. I really hope it becomes an expectation, not a feature, sooner rather than latter.

          Edit: happy to see a new group has shown up asking for open channel flash, Open Flash Platform. <a href="https:&#x2F;&#x2F;openflashplatform.org&#x2F;" rel="nofollow">https:&#x2F;&#x2F;openflashplatform.org&#x2F;

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.