Thread

1. petercooper · 1786044913 · focus · HN ↗

   Hopefully this boils down to the smaller versions they've teased. In my experience, Qwen models are the closest to the "less knowledge, more intelligence" (yes, the two are hugely correlated!) ideal some tool-dependent tasks need. Even the 3.5 2B can be easily prompted to always lean on tools and not jump to false conclusions (although its actual coding skills are abysmal, as you'd expect).

   1. quotemstr · 1786045237 · focus · HN ↗

      > less knowledge, more intelligence

      People produce such models by over-RL-ing smaller models on math and coding tasks. I've found the results capable of neither innovative work nor thinking outside the box. They're straight-A students raised by tiger moments who never let them play freely for hours in the dirt.

      Perhaps you could say such models are skilled --- but intelligent? Not by my measure.

      People and AIs alike need diversity of experience and a broad liberal arts education to see hidden connections between fields and make real advances.

      1. DC-3 · 1786045423 · focus · HN ↗

         It's amusing to me that AI has become sophisticated enough that people have started being racist to it.

Unofficial Hacker News client; not affiliated with Y Combinator.