‹ BackHN Continuity

Thread

Btrfs/ZFS/bcachefs under workloads classic benchmarks skip

179 points · 190 comments · farlight

  1. fenio · · focus · HN ↗
    The author of the benchmark here. I went over some comments and I'll try to tackle them here. I'm pretty clear that GH runner based benchmark is far from perfect due to noisy neighbours etc. Thus every test first is running so called calibration... to reject completely unreliable VMs. I'm fully aware that this can't completely fix the issue. Can limit it but not fix. But as of now there are 593 runs recorded so average should still be quite meaningful.

    Having that said I'm desperately trying to get REAL hardware to run that benchmark. With some successes ;)

    Few months ago I got Hetzner machine from Kent Overstreet and I was able to finish 3 runs before machine died... Results: <a href="https:&#x2F;&#x2F;bartosz.fenski.pl&#x2F;modern-fs-benchmark&#x2F;real-hw&#x2F;" rel="nofollow">https:&#x2F;&#x2F;bartosz.fenski.pl&#x2F;modern-fs-benchmark&#x2F;real-hw&#x2F;

    Currently I&#x27;ve got even more interesting machine with tons of disks and I&#x27;m running new set of benchmarks but it&#x27;s really in its initial stage.

    <a href="https:&#x2F;&#x2F;bartosz.fenski.pl&#x2F;modern-fs-benchmark&#x2F;sas-hdd&#x2F;" rel="nofollow">https:&#x2F;&#x2F;bartosz.fenski.pl&#x2F;modern-fs-benchmark&#x2F;sas-hdd&#x2F; 2nd run in progress... one run on REAL hardware takes much more time than on GH runner so it&#x27;s slow.

    But this new hardware has also so many disks that the plan is to try also more complex, tiered cache topologies. I&#x27;m working on it.

    I&#x27;m happy to answer any other questions, sources of every piece of this benchmark are freely available and I&#x27;m not saying they are 100% correct. I&#x27;m open to improvements.

    1. Joel_Mckay · · focus · HN ↗
      Should include:

      1. Dual Ext4 + external 32GB journal X4 pcie SSD (the prior winner of benchmark surveys)

      2. Bare F2FS after a trim and SSD vendor software cache flush operation (it should be slower, but knowing how much slower on identical hardware could be interesting.)

      3. DRBD across a 48U 100Gbps host rack (single X4 pcie data drive per host, OS on primary)

      4. CephFS across a 48U 100Gbps host rack (single X4 pcie data drive per host, OS on primary)

      Best regards =3

      1. throwaway270925 · · focus · HN ↗
        Also

        5. a ZFS dRaid configuration. There could be very different characteristics there with it using slabs.

        Speaking of slabs, MS ReFS of you feel adventurous!

      2. delamon · · focus · HN ↗
        6. modern nvme drive, preferrably pcie gen5 that can push &gt;14GiB&#x2F;sec
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.