Thread

1. vatsachak · 1790797844 · focus · HN ↗

   I wonder what the "waves" in LLMs are; The global firing patterns that can help us interpret what the weights are doing en-masse

   1. altruios · 1790800505 · focus · HN ↗

      Care to define 'waves' in this context?

      I suspect, if our conscious experience === the waves created by neuron's firing, that the hum of the GPU when running a LLM doesn't have the dynamic range to meaningfully talk about having a conscious experiences.

      But that's armchair conjecturing.

Unofficial Hacker News client; not affiliated with Y Combinator.