‹ BackHN Continuity

Thread

Show HN: TurboGPT: train 22KiB transformer in 13s

56 points · 10 comments · lostmsu

Loading the complete thread in the background. This saved snapshot is available now. Refresh

  1. jey · · focus · HN ↗
    At that scale it seems like you could just solve the KKT conditions directly. Exaggerating but only a little
  2. fleshmonad · · focus · HN ↗
    Who cares. This will not get you hired. Why do these submissions get any points at all. The same people who upvote this are the ones seething AI cannot create anything new. I don't see it. Not to shit on the work that went into this.
    1. kadoban · · focus · HN ↗
      Jesus. Would hate to see the work you _do_ want to shit on.
  3. vjsrinivas · · focus · HN ↗
    Interesting trend of labeling models after how big they are on disk vs how many learnable parameters they have.
  4. pane_poker_11 · · focus · HN ↗

    [dead]

  5. w4yai · · focus · HN ↗
    "hn1g.txt" => not available
    1. lostmsu · · focus · HN ↗
      Just uploaded to <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;datasets&#x2F;lostmsu&#x2F;hn1g&#x2F;tree&#x2F;main" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;datasets&#x2F;lostmsu&#x2F;hn1g&#x2F;tree&#x2F;main

      But it is a byte predictor. You can train it on any file.

  6. _345 · · focus · HN ↗
    Trying to be a little less negative than the guy that got flagged, I too don&#x27;t understand the motivation behind these projects. I&#x27;ve seen a hundred of them at this point- and each of them is probably worse and has less learning value than the one Andrej Karpathy made to teach people the building blocks involved in a GPT

    So, why do people keep making these? Asking genuinely

    1. alightsoul · · focus · HN ↗
      to add it to their resume and &quot;prove&quot; they know how machine learning works
      1. jazzpush2 · · focus · HN ↗
        You mean pushing everything up in one giant commit with Claude isn&#x27;t learning!?
    2. Axodouble · · focus · HN ↗
      Fun? I am unsure why it keeps getting shared though, I too have reinvented the wheel a few times for fun.

      * Edit, I did however just notice literally all of this is just another vibeslopped banger, so I am not quite sure how much fun there really is, feels more like coding for the sake of keeping the wheel turning.

    3. lostmsu · · focus · HN ↗
      [delayed]
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.