‹ BackHN Continuity

Thread

Show HN: Mini-AGI – Dynamic continual learning model trained on 8GB VRAM

277 points · 80 comments · volotat

Loading the complete thread in the background. This saved snapshot is available now. Refresh

  1. volotat · · focus · HN ↗
    Sorry for the pretentious name, I know, I know.. It just contains all the pieces I would like to see a AGI model to have, and I can't stand the temptation. Before throwing rocks at me, please take a glance at the Readme, and I hope it will cover your mood a little bit.

    So, first of all it does work and you can see the sample from the whole training run here: <a href="https:&#x2F;&#x2F;raw.githubusercontent.com&#x2F;volotat&#x2F;mini-AGI&#x2F;refs&#x2F;heads&#x2F;main&#x2F;runs&#x2F;samples.txt" rel="nofollow">https:&#x2F;&#x2F;raw.githubusercontent.com&#x2F;volotat&#x2F;mini-AGI&#x2F;refs&#x2F;head...

    Here is the scaling law graph I have so far, and it looks very promising: <a href="https:&#x2F;&#x2F;github.com&#x2F;volotat&#x2F;mini-AGI&#x2F;blob&#x2F;main&#x2F;assets&#x2F;scaling.png" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;volotat&#x2F;mini-AGI&#x2F;blob&#x2F;main&#x2F;assets&#x2F;scaling...

    The model was built under my deep dissatisfaction so we cannot really train even moderately big models (1B+ scale) on the consumer&#x27;s hardware. We can inference and fine-tune them for sure, but I would like to have full control over what the model sees over the training run, so it is fully aligned with my interests, not some corporations.

    I was thinking about for some time and come up with two interesting ideas I thought worth pursuing: MoE with a lot of experts that gets added and pruned from the model while it trains, where only a small subset of of experts are actually in use at any particular moment + batch 1 training on the single continuous stream of data.

    First allows us to be bounded only by the disk space in terms of number of parameters and load and unload experts only when they are needed. The second (if figured out and it turns out to be doable) allows us to get aways with small VRAM capacity because we do not need to store big randomized batches and their respective gradients.

    I started brainstorming with Claude and after some time we found an approach that seems to be promising, and low and behold, a few weeks pass and you can see the results yourself.

    Obviously, I did use AI in the process of making this project and I am pretty sure it would be completely impossible for me to do something like this without it, so I hope it is more than justified.

    The model is still running over the first of 7.8B characters corpus I selected for training, so the weights are not out yet, and it&#x27;s about a couple weeks of waiting until they are cooked at the current reading speed. And yeah, the model just read continuous interleaved passages from the dataset, each by 32K characters long each as a single stream. Just as you or I would do.

    The set up seems to be really simple so you can git clone the project, run it and observe everything for yourself.

    Thanks for your attention.

  2. hexley19 · · focus · HN ↗
    Seeing &#x27;Mini-AGI&#x27; and &#x27;8GB VRAM&#x27; in the same sentence is a breath of fresh air. Maybe local AGI isn&#x27;t so far-fetched.
    1. fuzzfactor · · focus · HN ↗
      &gt;Maybe local AGI isn&#x27;t so far-fetched.

      Why settle for anything less?

      Before they had personal computers I always figured the established computer experts were going to get their mainframes to do AI a lot sooner than it turned out.

      That was a non-starter though, not many people could afford huge amounts of hardware in a centralized datacenter where you don&#x27;t have unlimited access. How was the next level of progress supposed to occur if you didn&#x27;t fully own the electronics?

      It was pretty impressive when it required a forklift to move the CPU, but kind of forbidding too.

      PCs took over fast for that very reason and rapidly became more powerful until they were quite capable of incredible amounts of automation well over 20 years ago for so many things.

      The whole time since the mainframe days the thing that has held true for AI in automation, is that it has to take the same powerful, sophisticated PC hardware that already works so well without AI, and bring that to the next level in logical progression.

      No dependency on remote data, remote storage, network or internet at all. Otherwise why bother?

      As long as AI can not make the same stand-alone hardware outperform what it&#x27;s already capable of beforehand, there&#x27;s quite a bit more work to do.

      An idealized automation workflow on a new PC without AI:

      Insert blank SSD &gt; Install OS &gt; Install automation app &gt; Program app &gt; Run automaton

      Same stand-alone hardware, with AI:

      Insert blank SSD &gt; Install OS &gt; Install AI app &gt; Train app &gt; Run automaton

      If AI can&#x27;t make the same hardware run smarter, it&#x27;s not as intelligent as it could be, is it?

      I don&#x27;t need AGI, I just need this.

  3. myshapeprotocol · · focus · HN ↗

    [dead]

  4. whizzter · · focus · HN ↗
    Nobody will throw rocks, I think most people are curious&#x2F;suspicious about the big players and wants more hands-on since we suspect that this all will come down in cost soon enough.
  5. skeledrew · · focus · HN ↗
    Getting conceptually closer to how the human brain works. Looking forward to more of this.
    1. volotat · · focus · HN ↗
      I also like how it is very organic. It naturally grows and deletes unused elements, so in addition to traditional backprop there is also a natural selection happening in the background. Each new expert has 16 parents by the way, lol.
  6. advael · · focus · HN ↗
    Seems interesting, I&#x27;ve been messing with a lot of continuous learning approaches lately and it&#x27;s cool to see something that&#x27;s built from the ground up for avoiding catastrophic forgetting. Worth a clone for sure
    1. lostmsu · · focus · HN ↗
      It doesn&#x27;t show any indications of solving catastrophic forgetting.
      1. HarHarVeryFunny · · focus · HN ↗
        In fact it says the opposite - that there is pruning.

        Our brain also has some capacity limit, and maybe degraded memory performance over time, but in either case it&#x27;s a graceful degradation - you may forget fine details of things that happened a long time ago etc, but you don&#x27;t forget how to ride a bike just because it&#x27;s been a while.

        Continual learning by itself is useless - that&#x27;s just memorization and filling up a fixed size memory bank. What &quot;continual learning&quot; as one of the things missing from LLMs, is really referring to is roughly &quot;continual learning, with ongoing generalization and merging of memories, with no catastrophic forgetting, with graceful degradation&quot;.

        1. fuzzfactor · · focus · HN ↗
          &gt;roughly &quot;continual learning, with ongoing generalization and merging of memories, with no catastrophic forgetting, with graceful degradation&quot;.

          Sounds a bit like real-time &quot;distillation&quot; to me.

          I coudn&#x27;t imagine there was any choice back in 1980 when we only had kilobytes of memory.

  7. loopydosuette · · focus · HN ↗
    throwing crumpled paper ball
  8. cpldcpu · · focus · HN ↗
    Is this architecture actually able to generalize or is it mostly based on memorization? Have you tried some basic tasks that require generalization? e.g. number addition etc?
    1. volotat · · focus · HN ↗
      The model is way too small and undertrained to make any generalization claims. I want to wait until it reads the whole corpus I gave and then test it on some simple established benchmarks to see how it will behave.
      1. jacquesm · · focus · HN ↗
        What kind of hardware are you using for training?
      2. dinfinity · · focus · HN ↗
        Seems a bit premature to make an HN post about then, imho.

        It&#x27;s an interesting idea, but it doesn&#x27;t really do anything interesting yet. I looked at the output in the training run and it is a far, far cry from intelligence. Worse than GPT-2 as it stands.

        I do hope it will perform well when scaled and trained, though; best of luck.

  9. hanselot · · focus · HN ↗
    THANK YOU SO MUCH. This is the missing piece.
  10. ilusion · · focus · HN ↗
    Have you tested what it remembers from early in the stream after a shift in the topics thrown at it?
    1. volotat · · focus · HN ↗
      It interleaves random streams of 32K characters long each when reading the whole corpus, but each such stream reads continuously as you would expect. This is a necessary step to prevent just normal, not catastrophic, forgetting. I have not tested it in any other regimes yet with bigger or smaller windows. You can imagine a person that changes the activity from time to time, so I think it is justified. So there is not really &quot;early in the stream&quot;.

      What I did test though is reading 524K characters of chess data only and see how other domains have degraded. The results are in the readme under &quot;How continual learning works&quot; section. Spoiler: it just barely degraded the performance.

  11. bananaflag · · focus · HN ↗
    This is the first thing I see in my life that really looks like proto-AGI, it deserves its name.
  12. awfm9 · · focus · HN ↗
    What&#x27;s the advantage of doing this, versus becoming good at context management and RAG? I always found trained knowledge unreliable, given that it is lossy by construction.
    1. dinfinity · · focus · HN ↗
      Do you find all your own (human) trained knowledge unreliable?
      1. awfm9 · · focus · HN ↗
        That&#x27;s a total non sequitur. Training an LLM creates a reasoning engine. The residual knowledge from that does not compare to how humans learn knowledge.
        1. dinfinity · · focus · HN ↗
          Can you answer your original question now? If not, you should think about the similarities between humans and LLMs more rather than get lost in technical pedantry.

          Or think about an extreme case: an LLM that is trained on almost nothing combined with great RAG and context.

          1. awfm9 · · focus · HN ↗
            I asked my question because I have an opinion, and I wanted to hear the creator&#x27;s perspective. Your question had nothing to do with any of it, and is irrelevant.

            You can call it &quot;technical pedantry&quot;, but what you actually meant is &quot;precision and logic&quot;. Which is relevant to make a connection. Your new fallacy is called &quot;ad hominem&quot;, btw.

            And there is one more logical fallacy hidden in your message: training an LLM on a lot of data is not the same thing as then relying on that lossy data once training is done.

    2. truejaian · · focus · HN ↗
      I don&#x27;t think there&#x27;s much of advantage tbh. Memories in files will always outperform non-frontier model weight adjustments imo.
      1. awfm9 · · focus · HN ↗
        I always found the frontier AI labs&#x27; focus on trained knowledge a bit confusing. From my perspective, training creates a reasoning engine. Beyond that, models reason about data from more reliable sources. I wonder why this is not a distinction they make?
  13. comboy · · focus · HN ↗
    what character prediction rates are you getting on some unseen datasets?
    1. volotat · · focus · HN ↗
      The held-out scores reported in the Readme IS the unseen dataset.
      1. comboy · · focus · HN ↗
        These are not successful prediction rate per char though.
        1. volotat · · focus · HN ↗
          I got you, will add later to the repository.
          1. comboy · · focus · HN ↗
            Thanks, it seems like a nice way to compare effectiveness of different non-typical methods which are not yet capable of some more ambitious benchmarks.
  14. lostmsu · · focus · HN ↗
    [delayed]
  15. maaaaattttt · · focus · HN ↗
    Have you thought about making the whole thing &quot;self-similar&quot;? Every time I hear about MoE I think (and I know it&#x27;s way easier thought than done) &quot;why stay shallow&quot;? I mean by that: would it be possible to extend&#x2F;adapt the architecture so that an expert can be a previously trained Mini-AGI model? And recurse like this? Inuitively I would think some form of generalization could happen, as higher level experts (in the recurrence stack) would become sort of the &quot;intuition&quot; layer.
    1. killerstorm · · focus · HN ↗
      Making model to consists of many small modules is inefficient on GPU, especially as routing adds data dependencies, etc, and especially with pytorch (compared to a custom kernel).

      The difference might be smaller on a CPU which has limited parallelism.

      But it&#x27;s basically equivalent to a very deep model which might be problematic for training.

  16. ilaksh · · focus · HN ↗
    I would like to see a benchmark and&#x2F;or a video of it in action. Or at least a transcript of a chat session.

    Has anyone else tested this?

    1. synctext · · focus · HN ↗
      Using the term AGI and not including any performance analysis. Somebody called this slop in the comments.

      As a professor who published on continual learning I&#x27;m leaning towards agreement[1]. It lacks any substance. No relation to related work, no description of algorithm, no ablation study, just hand-waving that we&#x27;re feeding some data and &quot;Chess is not forgotten&quot;.

      [1] <a href="https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2301.12530" rel="nofollow">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2301.12530

      1. ilaksh · · focus · HN ↗
        Actually I&#x27;m mad that I wasted my time looking at it based on the claims. He implies it is trained and uses the term &quot;AGI&quot; and &quot;continuous learning&quot;. He never finished a single training run or enough that he considers not &quot;undertrained&quot;. It&#x27;s not trained. And actually there is no evidence that it can actually learn anything useful.
        1. synctext · · focus · HN ↗
          Indeed this is wasting HN time.

          &quot;The model reads 524,000 characters of chess&quot;. This is 100KByte of training data in a toy model with rigid parameters and no global learning. Gap with real LLM and trillions of tokens.

      2. volotat · · focus · HN ↗
        There is no special algorithm, the finding is that slowing down the LR or the trunk, while keeping the LR of the experts is enough to eliminate most of the forgetting in the network. You can see in that experiment where chess data was the only thing the model read for 524K characters, yet it kept almost the same performance (i.e. held-out loss) on all other domains. If you keep LR the same across the whole network the loss in other domains degrades dramatically - this is a clear sign of catastrophic forgetting in action. What I can say for sure is that any traditional network that does pose a sign of catastrophic forgetting would not be able to learn any patterns from a single stream of data.

        There are no benchmarks published as the model is heavily undertrained, but it is learning. And you can see this clearly in the loss and samples even though they are still barely coherent.

        I am not an academic and am not trying to publish a paper about a “major breakthrough” or something like this. I am just a small person who found a cool thing that clearly works and wants to share it with the world. That’s it.

        1. ilaksh · · focus · HN ↗
          You can&#x27;t claim it &quot;works&quot; if it hasn&#x27;t produced any coherent responses and is still early in your first training attempt.
          1. volotat · · focus · HN ↗
            It is a goalpost that is easy to move. By &quot;works&quot; I mean learning from a continuous single (meaning batch-1) stream of data. The fact that it produces full words and full coherent phrases instead of a random stream of characters that would any typical LM produce if trained under the same training regime.
            1. ilaksh · · focus · HN ↗
              I would be okay if you shared it as a potential idea and possibly interesting early result, but the language you are actually using to characterize it is misleading or delusional.

              Please get a model to the point where it seems like it has some natural language understanding and then share again with reasonable characterization.

              1. volotat · · focus · HN ↗
                For sure. As it will pass through the whole corpus I will share the weights, run it through established benchmarks for small models and share all of this as an update. I am also planning on making a Youtube video explaining in detail how it works on a deeper level and the whole reasoning behind why it is built the way it is. But no promises here.
                1. fuzzfactor · · focus · HN ↗
                  Nothing to be ashamed of if you end up pushing back the release date of your feature film :)

                  I had ideas not completely unlike this so long ago, but one big difference can be summed up in one of your parameters.

                  &gt;Directories are walked, binaries are skipped . . . and each file is read from its beginning to its end because a document has an order.

                  For me it was binaries being walked because text and anything approaching a language model was so much further out-of-reach having such limited computer power.

              2. bigbadfeline · · focus · HN ↗
                &gt; but the language you are actually using to characterize it is misleading or delusional.

                It&#x27;s good enough for me to sense a bright idea with a lot of potential and a pretty good proof of concept. I also see the inspiration and hard work necessary to move it further along, so fingers crossed.

              3. bigbadfeline · · focus · HN ↗
                Is &quot;AGI&quot; the language that bothers you? Well, one has to keep his eyes on the prize and I see a bright idea which could lead to AGI, so, why not describe it as such? I also see the inspiration and hard work necessary to move that idea further along, so fingers crossed.
    2. seanhunter · · focus · HN ↗
      To pick a couple of examples:

         --- chess ---
   prompt: &#x27;&lt;g&gt;1700 1-0 1. e4 e5 2. &#x27;
   [raw]  repeated 8-grams 83%
   Nxd5 Nxd5 Nxd5 Nxd5 Nxd5 Nxd5 Nxd5 Nxd5 Nxd5 Nxd5 Nxd5 Nxd5 Rxd5 Rxd5 Rxd5 Rxd5. Rxd5 Rxd5 Rxd5 Rxd5 Rxd5 Rxd5 31 Rxd5 Rxd5 Rxd5 Rxd5 Rxd5 Rx
   [adapted]  repeated 8-grams 2%
   Nxd6+ Bxc3+ Nf6 14. Qxd5+ Nf6 Rxe3+ Bh1 Nxd5+ Qxc6 Rf3+ Nxd5 Qe4+ Rxf6 Nh1+ Qxd5 Rf3+ Nxe6 Qh1+ Rxd5 Nf6+ Qxe3 Rh1+ Nxd5 Qf6+ Rxg3+ Ne1 Qxd5
      ^ THe model noticed you started the notation of a chess game, but it&#x27;s response is total nonsense. After &quot;1. e4 e5 2.&quot; you can&#x27;t go Nxd6+. For all kinds of reasons. You haven&#x27;t got your knight out yet. Even if you had, it couldn&#x27;t get to d6. Even if it could, there&#x27;s nothing there it could take. If you did somehow in spite of all that manage to play 2 Nxd6+ the opponent couldn&#x27;t play .... Bxc3+ because they haven&#x27;t got their bish out. Even if they had it couldn&#x27;t get to c3 even if it could there isn&#x27;t anything there to take - you only have a pawn on e4 and a magical knight on d6. Even if somehow in spite of that, you could take on c3 it wouldn&#x27;t be check and EVEN IF SOMEHOW ALL OF THAT WERE TRUE YOU ARE IN CHECK. You can&#x27;t move your bishop you need to do something about the Knight on d6 which has you in check.

      All the rest of it is similarly gibberish. I&#x27;m used to model training garbage but this is in no sense AGI. It&#x27;s beyond nonsense to call it that.

  17. imtringued · · focus · HN ↗
    The expert swapping architecture is very nice. Have you considered doing nested reinforcement learning where you use the nesting as a sort of low pass filter?

    The concept is as follows: You train a critic to mimic the datastream and then you train against the critic instead of training against the data. The idea behind this is that the critic will memorize the training data so you do not need to store the full training data anymore. One of the biggest issues with current online stochastic gradient descent is that it is inherently a memory-less technique where the training data acts as the memory.

    You can spin this further by going deeper with the nesting and then dropping the supervised critic. I forgot how to put it in words but the goal is that by having a model train against a critic of the critic, you can then drop the top level critic and instead use the mid level critic itself as your meta learning objective to train the actor against an unlabeled data stream.

    Top level critic: learns to mimic the labeled training data via online SGD, then you add a simple hand written loss function to compare the predicted output with a given input. Basically you build a model specifically for distillation. Mid level critic: learns a reward function that mimics the top level critic directly but only gets to see the unlabeled training data and the result of the top level critic. Actor: The actor is exclusively trained against the mid level critic

    Through this concept you end up with the existing training data stored as objective inside the mid level critic so you end up training not only against the latest data but also the already memorized data which should lower catastrophic forgetting. Of course at some point you might need to update the mid level critic again and to avoid that you might get away with just adding a very very wide Linear RNN &#x2F; State Space Model &#x2F; Mamba &#x2F; Gated Delta Net as the middle critic (shower thought: use internal RNN states to represent LoRA vectors).

  18. K0balt · · focus · HN ↗
    Interesting. I wonder how much could be gained from using tokenization, which makes the model work at a semantic level rather than a syntactic level? I think it’s a force multiplier, but idk if it works here.
  19. bubblegumcrisis · · focus · HN ↗
    Very interesting - I have a tangential question.

    What motivated you decide to release this. OpenAI or Anthropic will just hoover it up, maybe scale it up and use it if they are interested.

    You probably won&#x27;t know if they do, and the chance they will give you something back is near zero. Why did you release rather than try to scale and build yourself?

    1. volotat · · focus · HN ↗
      I have no practical means of scaling it up at any compatible scale. I will not make any money on it either way as well. So there is absolutely no reason for hoarding it. And as I said I did use Claude in the process, so Anthropic already has full access to it anyway and could steal it just as easily if they really want to.

      I also doubt it is really that valuable on the OpenAI&#x2F;Anthropic scale, at the same time if people will use it and it will work for them on the personal scale it is already a major win for me. New ideas and optimizations I could never have thought of might bring this up from a toy model to an actually useful model trained locally. Then people could add RL and RLHF and other cool things to it to make it even better.

      1. bubblegumcrisis · · focus · HN ↗

        [dead]

      2. bubblegumcrisis · · focus · HN ↗
        Hey, do me a favor - can you reply to this and say, just &quot;yes&quot; if you can see it. If you can see my other reply, could you say &quot;yes 2&quot; - thanks
        1. volotat · · focus · HN ↗
          Your both comments are visible.
          1. bubblegumcrisis · · focus · HN ↗
            There are three.

            The first starts with: Thanks for your response. The second starts with: Hey, do me a favor And the third starts with: I had no idea HN censors

            If you can see all three - then you can also see the censorship by starting a private browser and looking at this story.

            There will only be the second and the third.

            I&#x27;ve tested in private sessions on firefox and safari and through a few different ip proxies.

            I&#x27;m going to do some testing in other stories&#x2F;comments to see whether they detect words, or general sentiment. And I&#x27;ll get some statistics on if this is predictable censorship, a one time deal, or whether I just hit a race condition in their code somewhere.

            1. nextaccountic · · focus · HN ↗
              Yes, you have a dead comment. It&#x27;s probably due to some spam filter. <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;threads?id=bubblegumcrisis">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;threads?id=bubblegumcrisis shows up other comments of yours as dead. (at least when logged in with my account)

              Maybe hit up hn@ycombinator.com and ask to remove your shadowban of sorts. Idk how effective is that.

              Anyway something more concerning is that you have at least two flagged comments (in the first page at least). Flagged comments means your comments violated HN rules, at least according to other HN users. It&#x27;s hard to understand the HN social etiquette but in short, if you are being mean to other people, you might get flagged. You may want to read the guidelines <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;newsguidelines.html">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;newsguidelines.html

              1. bubblegumcrisis · · focus · HN ↗
                How do you tell which comments were flagged?
                1. nextaccountic · · focus · HN ↗
                  In my profile settings, I have showdead: yes. It shows up [dead] comments and I guess [flagged] too. (But I think it only applies to comments of other people, not your own comments)

                  Keep in mind that you need karma to do many functions in this site. For example, with enough karma you can flag other people&#x27;s comments, and with enough flags the comments become hidden. With more karma yet, you can vouch for comments so you can make removed comments reappear on the site

                  Actually I just vouched for this comment <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49790164">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49790164 because I think it&#x27;s fine. It was previously [dead] but not anymore

                  (note, it&#x27;s not usual to tell you vouched or flagged a comment, I&#x27;m commenting because it&#x27;s what this tangent is about)

              2. bubblegumcrisis · · focus · HN ↗
                This really explains a lot. Whenever I see all the fan boys for Waymo and Apple (strangely people on this board like apple-vendor-lock-in) - and I think to myself, &quot;who are these people, where is the &#x27;rage against the machine&#x27; that typified the software industry pre-facebook&quot;

                So strange.

                I had this weird epiphany this year - you know the Jan 6th - you know how the republicans refused to impeach Trump. I just couldn&#x27;t wrap my head around the fact they would let someone potentially trying to kill them off the hook.

                And then it dawned on me - they were in on it. If they were in on it, everything makes perfect sense. It&#x27;s the simplest solution.

                But it was such a leap for me.

                All of the &quot;obviously paid for bot comments&quot; on this site. I always thought - they just slip through - but actually, the simplest solution is that this site is propagating a narrative.

                So weird. And so gross. Where did the idealism of the tech industry go? &quot;Don&#x27;t be evil,&quot; they said.

      3. bubblegumcrisis · · focus · HN ↗
        I had no idea HN censors comments. As in they don&#x27;t exist at all. This explains a lot actually. I mean, they censored for ideas, not bad language. I didn&#x27;t write anything accusatory or mean towards you, or towards anyone in particular - just purely for the ideas one of my comments to you doesn&#x27;t exist. So weird.
  20. xtracto · · focus · HN ↗
    This is pretty cool, thanks for sharing. Whe I read it first and saw &quot;continual&quot; I thought for a minute that it was implementing an idea I&#x27;ve been thinking about:

    I want to have an agent that thinks continually&#x2F;non-stop. Imagine a loop of &quot;train of thought&quot; that goes into the LLM and then out. Keep it going so that it &quot;rumiates&quot; thr way we do.

    Then, add some sort of &quot;messages&quot; or IRQs when I want to communicate with it. To ask it things and whatnot. I think that sort of cycle in addition to this learning you are doing is what is missing for real AGI.

    1. codethief · · focus · HN ↗
      Some OpenClaw&#x2F;Hermes-like agents actually work like that. (Can&#x27;t find the link right now.)
  21. Schlagbohrer · · focus · HN ↗
    I wish I could understand what a single graph in that nice graphic of graphs meant. No explanation for any vertical or horizontal axis. Looks pretty though.
  22. abeppu · · focus · HN ↗
    I have not looked carefully but it seems like this is over-promising on avoiding catastrophic forgetting.

    The &quot;trunk learning rate&quot; is set at 0.1x the learning rate for the experts, so learning on different subjects disproportionately happens in the experts, and the trunk portion is comparatively more stable. But the population of experts can grow and shrink:

    &gt; The pool grows when it is short of capacity and shrinks when parts of it stop being asked for.

    So:

    - doesn&#x27;t the trunk then _eventually_ still undergo catastrophic forgetting, it just may take much longer?

    - and before that point, catastrophic forgetting happens in stepwise chunks whenever the expert pool shrinks?

    1. volotat · · focus · HN ↗
      I am not sure about eventually, but it learns on the steady paste so far. The main thing to keep in mind is that it learns on the single STREAM of data. Not randomized batched samples. Try to do it with any other model and you will see nothing but complete garbage in the predictions, exactly because of catastrophic forgetting.

      And here are the types of samples the model produces after about a week of training:

      ==============================================================================

      step 191,447 391.3M of 7,879M characters (4.97%) 15 min 176 experts

      context 4,096 characters of 4,096 reading 1,046 char&#x2F;s still gaining +0.0412 deep into it

      grad norm 0.98 against a clip of 1 under the clip

      train loss 0.6540 lr 2.28e-04 evidence t -0.15 over 65.7 (effect +0.0660) rate x0.753

      held-out loss 0.8012 +&#x2F;-0.0335 nats 1.1559 bits&#x2F;char perplexity 2.23 gap +0.1472

        arithmetic 0.645   chat 0.790   chat_hermes 1.153   chess 0.510   code 0.703   reasoning 0.756   stories 0.596   wikipedia 1.256
      repeats 31% of 8-grams, greedy with no guard

      ==============================================================================

      --- stories ---

      prompt: &#x27;Once upon a time, there was a little boy named Tom. One day he &#x27;

      [raw] repeated 8-grams 2% was walking in the park with his mom. He saw a big box in the ground. He was very sad and sad.

      &quot;Mom, can I have the box to the box?&quot; he ask

      [adapted] repeated 8-grams 5% was playing with his friend, a little girl.

      &quot;Wow, Tom!&quot; said Tom.

      &quot;What&#x27;s your name?&quot;

      Tom said, &quot;I&#x27;m playing with my friend.&quot;

      The little

      --- code ---

      prompt: &#x27;def merge_sorted(a, b):\n &#x27;

      [raw] repeated 8-grams 61% return sorted(a, b)

          def merge_sorted(a, b):
        return sorted(a, b)

    def merge_sorted(a, b):
        return sorted(a, b)
      [adapted] repeated 8-grams 22% &quot;&quot;&quot;Merges the modification from the angles in the argument. This merges the angles in the argument. &quot;&quot;&quot;

          def __init__(self, a):
      --- arithmetic ---

      prompt: &#x27;add 4917 + 388 = &#x27;

      [raw] repeated 8-grams 47% &lt;think&gt; 7+8+0=5c1 1+8+1=0c1 9+3+1=3c1 4+0+1=5c0 &lt;&#x2F;think&gt; 5305 mul 6 * 6 = 36 mul 6 * 6 = 36 mul 6 * 6 = 36 mul 6 * 6 = 36 mul 6 * 6 = 36 mul 6 * 6 = 36 a

      [adapted] repeated 8-grams 3% &lt;think&gt; 7+8+0=5c1 1+8+1=0c1 9+3+1=3c1 4+0+1=5c0 &lt;&#x2F;think&gt; 5305 mul 6287 * 49 = &lt;think&gt; 62879=56583 628740=251480 56583+251480=307063 &lt;&#x2F;think&gt; 307063 mul 9428 * 17 =

      --- chat ---

      prompt: &#x27;&lt;user&gt;\nWhat are you?\n&lt;&#x2F;user&gt;\n&lt;bot&gt;\n&#x27;

      [raw] repeated 8-grams 20% In the given I am trying to find the maximum vertex should be an expression linear that should be given the maximum vertex and the maximum v

      [adapted] repeated 8-grams 8% In the given I, there&#x27;s another part of the given I, whose parts include anything they&#x27;re discussed. &lt;&#x2F;bot&gt; &lt;user&gt; What is the given article by answer

      --- chat_hermes ---

      prompt: &#x27;&lt;user&gt;\nA train travels 60 km in 45 minutes. What is its speed in km&#x2F;h?\n&lt;&#x2F;user&gt;\n&lt;bot&gt;\n&#x27;

      [raw] repeated 8-grams 63% The train travels 60 km&#x2F;h in 45 minutes. The train travels 60 km&#x2F;h in 45 minutes. The train travels 60 km&#x2F;h in 45 minutes. The travels are t

      [adapted] repeated 8-grams 4% The train travels 60 km&#x2F;h, which matches km&#x2F;h. &lt;&#x2F;bot&gt; &lt;user&gt; Write an example of the following article:

      In the subject of the subject, include an imp

      --- reasoning ---

      prompt: &#x27;&lt;user&gt;\nWrite a Python function that returns the largest number in a list.\n&lt;&#x2F;user&gt;\n&lt;bot&gt;\n&lt;think&gt;\n&#x27;

      [raw] repeated 8-grams 35% Okay, let&#x27;s tackle this problem. So, the largest number in a list is a list. The largest number is a list. The largest number is a list. It

      [adapted] repeated 8-grams 20% Okay, let&#x27;s try to figure out this problem. So, we&#x27;ll find the largest number in a list.

      The largest number is always the largest number in

      --- wikipedia ---

      prompt: &#x27;== History ==\nThe [[Roman Empire]] was &#x27;

      [raw] repeated 8-grams 48% a [[computer state]] of [[Computer Empire]] and [[Computer Empire]]. The [[Computer Empire]] was a [[computer state]] of [[Computer Empire]]

      [adapted] repeated 8-grams 42% the [[United States|University]] of [[Candie]]. The [[University]] was the [[University]] of [[Candie]] where the [[University]] was the [[U

      --- chess ---

      prompt: &#x27;&lt;g&gt;1700 1-0 1. e4 e5 2. &#x27;

      [raw] repeated 8-grams 0% 22 legal moves, then Nd3 Nf3 Nc6 3. Bb5 a6 4. Bxc6 dxc6 5. O-O Bg4 6. h3 Bh5 7. g4 Bg6 8. d3 Be7 9. Nbd2 Nf6 10. Nb3 O-O 11. Nc5 Bxc5 12. d4 Bd6 13. Nd3 Bxf3 14. Qxf

      [adapted] repeated 8-grams 0% 16 legal moves, then Ba3 Nf3 d6 3. Bc4 Nf6 4. d3 Be7 5. O-O Nbd7 6. Be3 c6 7. Nbd2 O-O 8. c3 a6 9. Qc2 b5 10. Ba3 Nb6 11. Bxe7 Qxe7 12. Rac1 Bb7 13. Nf1 Rac8 14. Ng3

      --- self-knowledge ---

      prompt: &#x27;&lt;user&gt;\nhow do you decide which experts to use?\n&lt;&#x2F;user&gt;\n&lt;bot&gt;\n&#x27;

      [raw] repeated 8-grams 2% The directory is not a vector of 512, which is why the new chunk is not an expert. That is why my window can be extended by that no matter h

      [adapted] repeated 8-grams 1% The directory is not a vector of 512, which is why. There is not an expert involve &lt;&#x2F;bot&gt; &lt;user&gt; Can you write change_string? It should change the com

  23. jmatthews · · focus · HN ↗
    This is an interesting approach. First of all, thanks for sharing your work. I&#x27;ve done. I want to say similar work in that I have trained continuous learning models and I have also offloaded parametric knowledge to hard drive people underestimate how difficult that is to do in a functional model. I look forward to digging in deeper.
  24. phatbmt4444 · · focus · HN ↗

    [dead]

  25. dnautics · · focus · HN ↗
    I love the idea of this but &quot;It has to not forget. A model that learns continually and overwrites itself is worse than one that does not learn at all.&quot;

    Is highly misguided.

    While the platonic ideal of Lt Commander Data is appealing, The parable of funes the memorious (Jorge Luis Borges) comes to mind.

  26. rescbr · · focus · HN ↗
    I wonder how a RWKV variant of this would fare...
  27. gslepak · · focus · HN ↗
    You are aware that Claude is designed to deliberately sabotage AI projects, right?
  28. HarHarVeryFunny · · focus · HN ↗
    Mini-AGI is a totally inappropriate name - it seems what this project is shooting for, but not delivering on, is being a language model with &quot;continual learning&quot;.

    Where it seems to fail, by design, on this goal is in delivering continual learning that is more than just &quot;memorization with LRU catastrophic forgetting&quot;.

    That said, props to the author for thinking different and actually implementing something. Maybe the project can grow into something more, or inspire different ideas, if they continue to work on it.

    1. OutOfHere · · focus · HN ↗
      In English, it&#x27;s &quot;thinking differently&quot;, not &quot;thinking different&quot;. This isn&#x27;t Apple.
      1. mpalmer · · focus · HN ↗
        Yes, this is Hacker News. Read the commenting guidelines.
        1. [deleted] · · focus · HN ↗

          [deleted]

      2. HarHarVeryFunny · · focus · HN ↗
        I was channeling Apple - presumably most people on a tech forum realize that.
  29. DylanMerigaud · · focus · HN ↗
    Scaling law graph looks promising, shows potential.
  30. scottsiume · · focus · HN ↗
    I&#x27;d love to explore a question. If I have a standard elementary school math textbook, along with all the results of every correct and incorrect answer my child got on the textbook exercises and class tests, is it possible to train a model that can help me figure out what concepts my child is struggling with and have that model provide help?
  31. tnspacetime · · focus · HN ↗
    I read your github page and there&#x27;s mention of continual learning but no argument how catastrophic forgetting is avoided. I think you should explain that better.
    1. volotat · · focus · HN ↗
      &quot;How continual learning works&quot; is the section you are looking for. The main experiment is described there.
      1. tnspacetime · · focus · HN ↗
        Yes I read that one, and that’s why I said the explanation is not clear. Anyway, catastrophic forgetting is theoretically not possible. “ Existing capability must substantially learn new information, so its representation must change, while retaining its still-valid old knowledge”. I think your setup is demonstrating something weaker.
        1. volotat · · focus · HN ↗
          You might be right. I have not measured it on typical CL benchmarks yet. I will try to do that after the reading of the whole corpus. And don&#x27;t forget there still is a normal slow forgetting happening, ofc. But my main evidence of the network doing something right is an ability to learn from a continuous stream of data. There is no other architecture I know of that can do it on a similar scale.
          1. tnspacetime · · focus · HN ↗
            I think as an experiment your setup is interesting. But in realistic systems even standard evals, i.e. making sure things work well for normal use cases, are already enormous, let alone thinking about catastrophic forgetting.
  32. [deleted] · · focus · HN ↗

    [deleted]

  33. SKYNET800 · · focus · HN ↗
    <a href="https:&#x2F;&#x2F;github.com&#x2F;ConsciousGroupMind&#x2F;SKYNET-800---Collective-Intelligence-Forecasting-System" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;ConsciousGroupMind&#x2F;SKYNET-800---Collectiv...
  34. jmatthews · · focus · HN ↗
    I built a smaller scale replication. Most of your claims prove out but the lever is essentially Biderman et als &quot;learn less forget less&quot;. My first pass actually made this mistake initially and the findings didn&#x27;t replicate. After controlling for step density I replicated your findings. Here is a write up:

    <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;dreddnafious&#x2F;mini-agi-replication" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;spaces&#x2F;dreddnafious&#x2F;mini-agi-replicat...

    At the bottom of my write up I added some ideas to pin down the actual dominant parameters. I also added a pr to fix an issue in the codebase:

    PR: <a href="https:&#x2F;&#x2F;github.com&#x2F;volotat&#x2F;mini-AGI&#x2F;pull&#x2F;20" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;volotat&#x2F;mini-AGI&#x2F;pull&#x2F;20

    What it fixes: a crash in upstream&#x27;s GradSNR meter (issue #19), a diagnostic that tracks how much of the gradient is signal versus noise.

  35. katyarailabs · · focus · HN ↗

    [dead]

  36. Jeeetendra · · focus · HN ↗
    training on an 8gb laptop gpu is a fun constraint. i&#x27;d love to see how much it remembers after a long shift in the data, not just the early training curves.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.