Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data
Thread
Unofficial Hacker News client; not affiliated with Y Combinator.
Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data
Unofficial Hacker News client; not affiliated with Y Combinator.
lubujackson · · focus · HN ↗
Putting attribution/privacy issues to the side, imagine if any individual could try new approaches to solve a problem/make a discovery and any micro-advancement gets integrated into the model itself, dynamically. This could transform progress from the slow "write a paper, get peer reviewed and published, use published data to inform future work" to a system with a centralized repository of concepts, attempts and results, including failed approaches already tried. How much work do humans waste replicating failed approaches?
Someone completely random halfway around the world could trigger a prompt that solves a blocker that prevents my solution from working. Who cares about AGI or "can models invent anything" when we could have a system that automatically synthesizes individual human thought into a rich network of aggregate human memory.
That's the target OpenAI/Anthropic should be evangelizing, not an AI Daddy Overlord or agentic script kiddie hellscape.
jester997 · · focus · HN ↗
It’s not the destination, it’s the journey to get there. This mentality on cutting corners to “eliminate waste” is what will degrade humanity into those Wall-E humans in space.
For example, if we just say, “Oh, someone did this already, why bother?” Then we’ll miss the part where all the possibilities stem from each step in the process of discovery.
Do what you love to do. Solve problems people have already completed. That’s where perspective comes from. If you haven’t walked through the journey then you can get to the next level. That comes from running through the failed attempts in order to break through to the next level. Don’t worry about what people have and haven’t done. If you’re doing something enjoyable, then that’s all that matters.
hmartin · · focus · HN ↗
jester997 · · focus · HN ↗
willy_k · · focus · HN ↗
Tell that to modern academia. This may be true but the barriers to realizing it are great today.