Thread

1. in_absentia · 1790086050 · focus · HN ↗

   So OpenAI is not a believer in recursive self-improvement after all?

   1. jrflo · 1790087352 · focus · HN ↗

      Read the article, that's not what this is about. Title is clickbait, they fired contractors for using AI to label data when the whole point of labeling data is to distill human knowledge into weights, not distill weights into weights.

      1. in_absentia · 1790088685 · focus · HN ↗

         You're replying to a joke, and yes, that's all it's about. For all the tales of rapid self-improvement, all labs are real careful not to taint their precious training sets with anything that comes out of their systems. Website reputation modeling, fingerprints in generated text, firing contractors that rely on AI.

         I've been told on HN about a year ago that the era of scraping is over and that it's all AI-training-AI now. My web server logs and stories like that disagree.

         1. jrflo · 1790090566 · focus · HN ↗

            There's a difference between shoving LLM output back into the input and RSI more broadly. Using synthetic training data didn't work super well, that would have been one path to RSI, but it doesn't work. The main path towards RSI people are talking about today is using the models to do research and experimentation for training new models. Machine learning is a very empirical field, you need to run tons of experiments, tune hyperparameters, and try different architectures. It's something agents are extremely good at doing, just because one path to RSI doesn't work doesn't mean it won't work at all.

Unofficial Hacker News client; not affiliated with Y Combinator.