‹ BackHN Continuity

Thread

Unreal Agent

246 points · 125 comments · trollied

  1. nojs · · focus · HN ↗
    For everyone self-hosting models, optimising for cost is an anti-feature. It makes the results worse for no benefit (except a little speed).

    What I'd love to see is a harness that deeply optimises for the best results obtainable out of non-frontier models. Many of these have 1M context windows, and most of it remains unused and under utilised in these harnesses, in my opinion.

    1. jedisct1 · · focus · HN ↗
      This is exactly what Swival was built for: <a href="https:&#x2F;&#x2F;swival.dev" rel="nofollow">https:&#x2F;&#x2F;swival.dev
      1. nojs · · focus · HN ↗
        Is it? The tagline says “Designed for tight context windows and limited resources.”
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.