Thread

1. andy_ppp · 1791017358 · focus · HN ↗

   So predicting the next word given all humanity’s knowledge is surely going to max out at slightly less good (we probably can’t get perfect data) than the best human in any specific field. What test does the AI do to be able to understand it is improving? At some point it becomes impossible to know that the output is actually better right?

   1. tux3 · 1791017580 · focus · HN ↗

      There's many fields where it's easier to find new problems than to solve them, and it's easier to check the solution once you have it.

      They're doing RL on open problems these days, not just next token prediction.

Unofficial Hacker News client; not affiliated with Y Combinator.