‹ BackHN Continuity

Thread

Intelligence per Watt: Measuring Intelligence Efficiency of Local AI

169 points · 65 comments · pythonic_hell

  1. surprisetalk · · focus · HN ↗
    I rather like this paper, but I think it is generous to say their benchmarks measure "intelligence".

    [0] <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;1911.01547" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;pdf&#x2F;1911.01547

    We have no dang clue what intelligence is, nor how to measure it.

    [1] <a href="https:&#x2F;&#x2F;taylor.town&#x2F;crowpower" rel="nofollow">https:&#x2F;&#x2F;taylor.town&#x2F;crowpower

    1. paimapi · · focus · HN ↗
      it really does feel like &#x27;intelligence&#x27; is becoming so much more of a marketing term moreso than it is any actual definitive measure. I was acquaintances with a cognitive science post-doc many years ago who trained under the same program that Douglas Hofstadter was part of (and who he saw as a great popular science communicator but perhaps a bit over-rated when it came to his own research)

      my very naive question to him back then was how close we were to understanding human cognition. we were both fans of grand strategy games (though the few hundred hours of Stellaris I played vs his thousands in EU4 paled in comparison) and I was asking if it was possible to map human cognition to the same array of interdependent logical chains-of-reasoning that games like that could be boiled down to

      his answer, in short, was &#x27;we are so, so, so far away and no, that&#x27;s, at best, a reductive mental model of intelligence&#x27;

      I keep that conversation in mind whenever I hear about all this talk of AGI - that realistically we&#x27;re so far away from actual AGI in the same way that the inventor(s) of the wheel were from a gas-powered car, and there&#x27;s many paradigm shifts to go in how we even understand what the nature of intelligence is before we get there

      1. mswphd · · focus · HN ↗
        there&#x27;s a funny paper on this theme, titles &quot;Could a Neuroscientist Understand a Microprocessor&quot;

        <a href="https:&#x2F;&#x2F;pmc.ncbi.nlm.nih.gov&#x2F;articles&#x2F;PMC5230747&#x2F;" rel="nofollow">https:&#x2F;&#x2F;pmc.ncbi.nlm.nih.gov&#x2F;articles&#x2F;PMC5230747&#x2F;

        roughly, it reviews common techniques in neuroscience, and comes to the conclusion that they would not be able to understand even simple computing platforms that we have perfect information for (and can perfectly stimulate any internal connection, can perfectly read out the values on any internal connection, etc).

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.