Thread

1. znpy · 1789815815 · focus · HN ↗

   Maybe this is OT but I wonder if openai/anthropic have private versions of their models with wider context windows (4M tokens? 10M tokens?).

   We know that the us government usually has private/custom versions of technology available to the general public, but much better.

   1. irthomasthomas · 1789820737 · focus · HN ↗

      I doub't it. The main issue is not cost, though they do get expensive as context grows, but intelligence. A frontier model like fable becomes as dumb as haiku after 200k tokens. They have been stuck at ~1M context/200k useful context for 18 months, now, with little sign of advancement. A model with a 10M context window that retains it's intelligence up to 2M tokens would be a big breakthrough.

      1. znpy · 1789824288 · focus · HN ↗

         > A model with a 10M context window that retains it's intelligence up to 2M tokens would be a big breakthrough.

         so the true next frontier might not be just raw intelligence but rather larger context window?

         1. [deleted] · 1789826577 · focus · HN ↗

            [deleted]

         2. DenisM · 1789847447 · focus · HN ↗

            Or better context curation - less lossy compression saving back to context. Maybe even jettisoning part context into an external semantic store instead of conpression. Or placing less data into context to start with.

            Or a combination of all those things.

            1. gyyyu · 1789852363 · focus · HN ↗

               [dead]

Unofficial Hacker News client; not affiliated with Y Combinator.