‹ BackHN Continuity

Thread

Introducing System One Models and Jev

1989 points · 520 comments · albelfio

  1. initsecret · · focus · HN ↗
    > [others] Output tokens: ~5x more expensive than input tokens.

    > [them] Output tokens: FREE (too cheap to meter).

    I'm very confused by this.

    1. quotemstr · · focus · HN ↗
      They're not doing autoregression, so all the outputs are computed in one big forward pass. Very cheap.
      1. ambicapter · · focus · HN ↗
        I think OP is confused about "others" vs "them".
        1. initsecret · · focus · HN ↗
          they’re talking about two totally different things, right?
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.