Thread

1. JCharante · 1785957691 · focus · HN ↗

   I have done my own testing and found that smaller models can beat their larger siblings on fact retrieval from documents. I haven’t investigated it in depth with a large enough dataset but my guess is that larger models overthink it while smaller ones just do it. I would like if they compared this with 5.6 Luna instead.

   1. andrenotgiant · 1785958098 · focus · HN ↗

      Any data or public links you can share? That surprises me

Unofficial Hacker News client; not affiliated with Y Combinator.