Thread

Beating GPT-5.6 Sol on retrieval with 100x cheaper open models

414 points · 114 comments · moonikakiss

cmiles8 · 1785978944 · focus · HN ↗
The big lab models are academically interesting but business wise they seem toast long term. There’s no way for these model companies to compete when the models are becoming a pure commodity and others offering options that are orders of magnitude cheaper.
It’s not that the big labs couldn’t theoretically just also put out 100x cheaper options but their business model requires them to generate huge revenues from higher priced tokens or they’ll implode.
1. kumama · 1785979924 · focus · HN ↗
  castform founder here. despite our bet on fine-tuned smaller open-source models, i'm still quite bullish on the big labs. i think scaled closed models will continue to dominate for more general purpose use-case like codegen, search, etc. but intelligence has lots of long-tail applications and i think for these longer-tail applications, finetuned custom models will rule
  1. sroussey · 1785980986 · focus · HN ↗
    Product search model:
    <a href="https://www.linkedin.com/posts/introducing-ontology-1-ugcPost-7488272626277294080-XxvU/" rel="nofollow">https://www.linkedin.com/posts/introducing-ontology-1-ugcPos...
    Edit: more direct links, sorry:
    <a href="https://onton.com/research/ontology-1" rel="nofollow">https://onton.com/research/ontology-1
    <a href="https://onton.com/research/ontology-1-benchmarks" rel="nofollow">https://onton.com/research/ontology-1-benchmarks
    podocarp · 1786009195 · focus · HN ↗
    Sorry but what is neurosymbolic model, it's not explained I think
    sroussey · 1786043427 · focus · HN ↗
    IMB YouTube video explainer:
    <a href="https://www.youtube.com/watch?v=ZfWDVO3rzeA" rel="nofollow">https://www.youtube.com/watch?v=ZfWDVO3rzeA

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.