Thread

1. shonenknifefan1 · 1790198625 · focus · HN ↗

   > While combing through the raw DNA sequence near the RT, the agent exclaimed: “[The DNA next to the RT] is spectacular: I can see by eye a tandem repeat array … that's a CRISPR-like … repeat array?!”

   I love that with AI discoveries, we can relive the discoveries from agent transcripts like this.

   I'm sort of imagining future histories involving notable AI events peppered with direct quotes like these.

   1. hatthew · 1790204802 · focus · HN ↗

      My guess is that in the near* future, reasoning will no longer happen in a way that can be neatly decoded as human language.

      *near meaning single digit years, which is far for AI I guess

      1. DennisP · 1790205435 · focus · HN ↗

         Rumor has it that OpenAI is already going that way. There's a technique of repeatedly looping through several neural layers that has the same effect as chain-of-thought, but without the efficiency loss of translating out to human-readable tokens, and some of OpenAI's statements about their latest model seem to fit well with that.

         1. killerstorm · 1790242669 · focus · HN ↗

            No, layer looping increases effective depth, but it still has to go through decode. So it's more like they increased number of layers from 100 to 200 without increasing number of parameters.

            "Latent reasoning" is rather trivial - you can just replace unembed-embed step with a MLP. But labs don't do that largely because they want to read the output of unembed.

            1. fc417fc802 · 1790281715 · focus · HN ↗

               The additional layers provide additional computation without going through one or more dec/enc cycles in between. Whether or not that impacts interpretability of the final token stream depends entirely on the maximum depth permitted (and how efficient the model in question is).

Unofficial Hacker News client; not affiliated with Y Combinator.