‹ BackHN Continuity

Thread

Tokens too cheap to meter

354 points · 227 comments · teoruiz

  1. jetrink · · focus · HN ↗
    > Tokens become cheaper than tool calls

    The author observes that a call to GPT-5.6 Luna is only 4-5 orders of magnitude more expensive than grep, and then predicts that at current rates of progress, calling an LLM will soon be cheaper than a grep. I think this is a good time to invoke Stein's Law: "If something cannot go on forever, it will stop." These efficiency improvements won't continue forever. It's more likely that the per-call cost of high-quality, compiled software like grep will be a lower-bound that LLMs asymptotically approach, rather than a line that they blow past with perpetual exponential progress. (Barring a true breakthrough in something like quantum computing or room-temperature superconductors.)

    1. WokeUp420 · · focus · HN ↗
      If the providers can't find a way to nickel and dime us to death they will no longer provide the service
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.