‹ BackHN Continuity

Thread

Writing Parquet files using Haskell

86 points · 29 comments · cosmic_quanta

  1. mugul · · focus · HN ↗
    Looks like a pretty cool community building great tools with care. Using a functional language for data transforms sounds like a sane idea, haven't played around with it yet but it's definitely on my list now.

    However they claim using Haskell for data science is "fast", which doesn't really mean anything until you have numbers to show. A little benchmark with pandas and polars wouldn't hurt I guess.

    1. epgui · · focus · HN ↗
      Haskell tends to be C-fast.
      1. veltas · · focus · HN ↗
        That's not what I see reported, they say Haskell tends to have bad memory layout generally and takes a 5x or so hit to performance.
        1. kccqzy · · focus · HN ↗
          The phrase “tends to” is doing a lot of work here. Inexperienced Haskellers tend to use the singly linked list for everything and that data structure just doesn’t perform in any language.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.