Thread

1. verdverm · 1790803627 · focus · HN ↗

   token vendors on the path to unlimited plans like mobile data, you love to see it

   1. georgel · 1790803872 · focus · HN ↗

      And just like those "unlimited" plans, the disclaimer always reads speeds slow down after N GB transferred/mo. If this unlimited tokens world happens, I expect vendors to start throttling or downgrading models.

      Network neutrality meet token neutrality.

      1. skeledrew · 1790804720 · focus · HN ↗

         In this case I wouldn't mind some throttling. After all this is constantly using particular amount of resources to get particular performance, unlike internet/data where it's essentially the same level of resource usage regardless of performance.
      2. verdverm · 1790805910 · focus · HN ↗

         That's essentially what the OpenCode Go plan is half way to, but with clear quotas

         There is a difference in that different models consume different a.ounts of resources (electricity), so times are not as uniform as bytes of data

Unofficial Hacker News client; not affiliated with Y Combinator.