‹ BackHN Continuity

Thread

Beating GPT-5.6 Sol on retrieval with 100x cheaper open models

414 points · 114 comments · moonikakiss

  1. punnerud · · focus · HN ↗
    What’s in that “Search tool”, could actually be the same solution presented in a different way
    1. softwaredoug · · focus · HN ↗
      Usually in these cases you don't need to do much tuning to the retriever. So you just give it BM25 or somesuch.

      I'm hesitant to say absolutely zero tuning, because there are cases where you do want to say, bias towards trustworthy results or recent results etc to help the model avoid wasting tokens. But probably not much beyond that.

      You can also just create a param in the tool for the agent that selects for "recent" or "popular" or "trustworthy" in ranking.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.