Maybe this is OT but I wonder if openai/anthropic have private versions of their models with wider context windows (4M tokens? 10M tokens?).We know that the us government usually has private/custom versions of technology available to the general public, but much better.
My vague understanding of the context window limitation is that it is largely a constraint of the model architecture. So maybe they have special extra long ctx, but it might just be a hard limit of the model itself.
znpy · · focus · HN ↗
We know that the us government usually has private/custom versions of technology available to the general public, but much better.
ImaCake · · focus · HN ↗