Thread

1. mmastrac · 1789625462 · focus · HN ↗

   I've been working with an automatic incremental context compactor enabled and it's been surprisingly helpful. It was particularly effective with DS41f - I think I was running at an effective session length of 5M, with the model running around 300k-400k and it was holding on both speed and intelligence.

   TBH I also ran the 400tok/s preview and that was just nuts. I just let the thing compact over and over over the course of a day attacking a couple of tough problems

   1. nchmy · 1789642769 · focus · HN ↗

      Can you share a link to thr automatic compactor? I've been noticing that when I get to around 60% context window, the cache will simply break and suddenly I've paid 50x more than expected. The only solution seems to be to compact or start a new session.

      1. mmastrac · 1789651746 · focus · HN ↗

         Send me an email- it's not public just yet

Unofficial Hacker News client; not affiliated with Y Combinator.