‹ BackHN Continuity

Thread

Introducing System One Models and Jev

1989 points · 520 comments · albelfio

  1. initsecret · · focus · HN ↗
    > [others] Output tokens: ~5x more expensive than input tokens.

    > [them] Output tokens: FREE (too cheap to meter).

    I'm very confused by this.

    1. quotemstr · · focus · HN ↗
      They're not doing autoregression, so all the outputs are computed in one big forward pass. Very cheap.
      1. ambicapter · · focus · HN ↗
        I think OP is confused about "others" vs "them".
        1. initsecret · · focus · HN ↗
          they’re talking about two totally different things, right?
    2. CompleteSkeptic · · focus · HN ↗
      it's our output tokens that are free (under the system one / jev column)
    3. varenc · · focus · HN ↗
      The output tokens are just responses to your inputed questions and their probability. So relatively few output tokens. No unstructured text back in the response.
    4. someguynamedq · · focus · HN ↗
      This is not confusing
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.