Thread

1. cowboylowrez · 1790597906 · focus · HN ↗

   So my naive understanding is that the stochastic parrot part of this business is the "statistical likelyhood of the next token", so there must be abstractly a function of "whats the next token" right? I'm also assuming that this function could be able to also return how "right" that next token is, or somehow some "strength" based on how many close matches there are, like for instance some tokens are obviously the right next token by a long shot, some next token spaces might have more closely competing candidates, so I guess my question is whether there is any value in saving or accumulating information on whether overall the tokens were close matches or not? Like a "confidence" running total or "history log", or is that just somehow too expensive or nonsensical to do?

   1. otabdeveloper4 · 1790618213 · focus · HN ↗

      > could be able to also return how "right" that next token is

      No. LLMs always output the next most statistically likely token. They don't reason. The so-called "hallucination" you see is just the most likely answer.

      1. redsocksfan45 · 1790618991 · focus · HN ↗

         [dead]

Unofficial Hacker News client; not affiliated with Y Combinator.