‹ BackHN Continuity

Thread

Tokens too cheap to meter

354 points · 227 comments · teoruiz

  1. automatic6131 · · focus · HN ↗
    >We are likely to see LLMs running locally at current frontier-quality on commodity hardware in the next 3-6 years

    Yeah okay bud, anyone checked in with the state of consumer hardware recently? Not the author, evidently.

    >oh in 3-6 years this will all be over

    Yeah I'm sure Samsung, Nvidia and sk hynix will all be very calm with lower volumes and lower margins.

    1. sanderjd · · focus · HN ↗
      Seems like 3-6 years is a pretty conservative timeline to me. Memory and inference chip production could ramp up massively in that amount of time.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.