‹ BackHN Continuity

Thread

Tokens too cheap to meter

354 points · 227 comments · teoruiz

  1. jetrink · · focus · HN ↗
    > Tokens become cheaper than tool calls

    The author observes that a call to GPT-5.6 Luna is only 4-5 orders of magnitude more expensive than grep, and then predicts that at current rates of progress, calling an LLM will soon be cheaper than a grep. I think this is a good time to invoke Stein's Law: "If something cannot go on forever, it will stop." These efficiency improvements won't continue forever. It's more likely that the per-call cost of high-quality, compiled software like grep will be a lower-bound that LLMs asymptotically approach, rather than a line that they blow past with perpetual exponential progress. (Barring a true breakthrough in something like quantum computing or room-temperature superconductors.)

    1. sanderjd · · focus · HN ↗
      Yeah I bumped on that too. If it's possible to make llms cheaper than current grep, then it is also almost certainly possible to make grep cheaper.
      1. rdsubhas · · focus · HN ↗
        grep is deterministic. Llm is probabilistic. Llm can be transferred to a tiny quantum cpu or a lower precision float.

        When the author wrote Llm can be as cheap as a tool, I read it as not equivalent. They even said the Llm can be embedded into a tool.

        Their point was, the higher level use case — like classification — could become as cheap as grep. Which is quite well possible.

        1. sanderjd · · focus · HN ↗
          Yeah you may be right!
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.