‹ BackHN Continuity

Thread

PSSA: A non-transformer language model written from scratch in Rust

89 points · 38 comments · sparticle62

  1. purple-leafy · · focus · HN ↗
    “In Rust” man of all the cliche title baits, I hate this one the most.

    Why did you choose Rust? Why does that matter?

    Nothing wrong with Rust. Lots wrong with the bandwagon that “in Rust” somehow adds value.

    1. anon291 · · focus · HN ↗
      Yeah I read the title and did a double-take. It's an uninteresting choice for systems like these. The more pressing concerns, which go undescribed, are the exact mathematical choices behind the actual model. Rust provides almost zero value here because tensor stuff is all just 2d-arrays of floats for the most part.
      1. sparticle62 · · focus · HN ↗

        [dead]

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.