Thread

1. eqmvii · 1790189198 · focus · HN ↗

   In a year or two, articles like this will either be artifacts from peak hype or evidence of the beginning of the singularity. Right?

   1. pizza234 · 1790189484 · focus · HN ↗

      The singularity, as defined by Hinton (and others) as RSI (Recursive Self Improvement) may actually be beginning already, as OpenAI has announced an AI acting as a "research intern" (!).

      1. physicallyIllfr · 1790190370 · focus · HN ↗

         How is it improving, that would require rearranging its weights and biases which it cannot do easily or quickly.

         1. pixl97 · 1790191664 · focus · HN ↗

            Self improvement during training, and AI self training are already happening. Easily/quickly are seemingly a factor of how much power/hardware you want to use at once.

            With the level of compute they have they aren't stuck with frozen models like you are.

            1. physicallyIllfr · 1790223985 · focus · HN ↗

               The infrastructure provisioning alone to train is heavily dependent on humans, as is dealing with failures (training runs fail a ton). Its not as simple as adding another ec2 on your dashboard. < 1k people in the world know how to do this, there will not be looped improvement methodology. Not to mention the chains of businesses and the people requires to operate them just to obtain the data needed, clean it and hand it to the llms.

               The llms are supervising rlhf and creating synthetic data (to an extent) but they're nowhere close to being able to operate the full training stack end to end. This is a fantasy being sold to investors to create fomo.

Unofficial Hacker News client; not affiliated with Y Combinator.