‹ BackHN Continuity

Thread

Don't be fooled–LLMs don't reason

75 points · 159 comments · leopoldj

  1. lordnacho · · focus · HN ↗
    I thought I saw a paper recently explaining that LLMs have a global workspace. Is that not like having the internal state that he's talking about?
    1. f6v · · focus · HN ↗
      There was a blog post from Anthropic saying Claude has a "J space" or something like that.
      1. Den_VR · · focus · HN ↗
        Why J?
        1. gpjt · · focus · HN ↗
          From Jacobian. They developed a tool called a Jacobian Lens, or J-Lens (itself a descendant of an earlier simpler tool called a Logit Lens) to examine what was going on inside an LLM, and named the space they found with it a J-Space.

          Jacobians are essentially derivatives but for matrices.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.