‹ BackHN Continuity

Thread

Beating GPT-5.6 Sol on retrieval with 100x cheaper open models

414 points · 114 comments · moonikakiss

  1. mrinterweb · · focus · HN ↗
    There is so much opportunity for purpose built models like this. Ideally a harness should spin up a subagent to offload to targeted models for specific tasks like this. I know this is not a novel idea. Claude code does some of this by handing off the "explore" agent work to haiku. I just love seeing that specialized LLMs are being developed.
    1. devolving-dev · · focus · HN ↗
      Models keep on improving though, so doesn't fine tuning become an ongoing task with ongoing maintenance burden?
      1. kumama · · focus · HN ↗
        (one of the blog post authors here) -> once you set up a finetuning pipeline, it's often trivial to rerun it on top of a new open weights model. so, it's orthogonal to base model improvements
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.