Thread

1. JCharante · 1785957691 · focus · HN ↗

   I have done my own testing and found that smaller models can beat their larger siblings on fact retrieval from documents. I haven’t investigated it in depth with a large enough dataset but my guess is that larger models overthink it while smaller ones just do it. I would like if they compared this with 5.6 Luna instead.

   1. hankbond · 1785968894 · focus · HN ↗

      Just an anecdote but thats why Deepseek v4 flash 0731 is my current favorite model. It's really not very "eager" and stays on the task at hand.

Unofficial Hacker News client; not affiliated with Y Combinator.