‹ BackHN Continuity

Thread

How OpenAI Used Its Own LLMs to Design Its Jalapeño Chip

206 points · 139 comments · maxall4

  1. amelius · · focus · HN ↗
    At some point people will use an LLM to design an Apple M series competitor.
    1. Lramseyer · · focus · HN ↗
      Production grade CPU design is more than just the RTL (the source code.) To achieve the performance numbers that these companies get, you have to do a ton of optimization in your physical design to achieve the power/performance/area (PPA) metrics that make these products competitive. LLMs are not suitable for that kind of work.

      There are people working on PPA optimization and trying to shake up how things are done, just not with LLMs.

      1. menaerus · · focus · HN ↗
        > LLMs are not suitable for that kind of work.

        I wonder why not or you meant not suitable yet?

        1. Systemerror7A69 · · focus · HN ↗
          This is just speculation on my part, but LLMs work best when they get immediate, verifiable feedback on their task, and the kind of physical optimizations they mean might not give that to LLMs.
          1. menaerus · · focus · HN ↗
            Also a speculation but I'm almost certain that physical optimizations are first done through simulators running on a computer.
            1. amelius · · focus · HN ↗
              Yes, they are, but the most important subtasks of designing a CPU are not physics related. They are picking the right parameters for things like: how wide do I make this bus, how many registers do I put in the register file, how large do I make this cache, how deep do I make this pipeline, etc., etc. To find optimal parameters requires a lot of simulations, and humans do this, but LLMs could do them just as well and maybe better because they excel at tedious work.
          2. TeMPOraL · · focus · HN ↗
            The right way is to throw LLMs at building tools that reframe the problem into a shape LLMs are good at navigating, and then have LLMs use those tools to solve it.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.