Thread

1. JCharante · 1785957691 · focus · HN ↗

   I have done my own testing and found that smaller models can beat their larger siblings on fact retrieval from documents. I haven’t investigated it in depth with a large enough dataset but my guess is that larger models overthink it while smaller ones just do it. I would like if they compared this with 5.6 Luna instead.

   1. jorl17 · 1785965463 · focus · HN ↗

      Have been feeling the same. There's a sweet spot that threads the needle between "too dumb to search the right thing / relay the correct results" and "too smart to just stop overthinking and just report the damn thing"

Unofficial Hacker News client; not affiliated with Y Combinator.