Thread

How OpenAI Used Its Own LLMs to Design Its Jalapeño Chip

206 points · 139 comments · maxall4

amelius · 1789774081 · focus · HN ↗
At some point people will use an LLM to design an Apple M series competitor.
1. bigyabai · 1789774233 · focus · HN ↗
  They won't, because they'd need an ARM architecture license.
  1. pixl97 · 1789774463 · focus · HN ↗
    I mean you can design anything without a license. Selling it is where the problems come up. Even then there are likely places in China that would still make it for you.
  2. amelius · 1789774700 · focus · HN ↗
    Why, the LLM can make up its own architecture.
    The value lies in the design space exploration, which is what an LLM can easily do.
    <a href="https://en.wikipedia.org/wiki/Design_space_exploration" rel="nofollow">https://en.wikipedia.org/wiki/Design_space_exploration
  3. wmf · 1789775157 · focus · HN ↗
    Arm sells architecture licenses to anybody these days.
    bpicolo · 1789835001 · focus · HN ↗
    Correct me if I'm wrong, but don't legal regulations around monopolistic behavior kind of mandate that?
    wmf · 1789838587 · focus · HN ↗
    There are some investigations starting about this but no rulings yet.
  4. cmrdporcupine · 1789777733 · focus · HN ↗
    Or they'll just build a competitor in RISC-V instead and that's fine.
    Except the problem is not restricted to the actual ISA or its HDL implementation, etc.
    It's even just getting space / time in a fab at that advanced of a process node.
  5. nr378 · 1789778729 · focus · HN ↗
    Qualcomm have an architecture license and the Snapdragon X2 Elite Extreme X2E-96-100 isn't too far off the M5 Pro.
    [1] <a href="https://browser.geekbench.com/processors/snapdragon-x2-elite-extreme-x2e-96-100" rel="nofollow">https://browser.geekbench.com/processors/snapdragon-x2-elite...
    [2] <a href="https://browser.geekbench.com/macs/macbook-pro-14-inch-2026-18c-cpu-20c-gpu" rel="nofollow">https://browser.geekbench.com/macs/macbook-pro-14-inch-2026-...
    bigyabai · 1789782206 · focus · HN ↗
    Are they using LLMs to close that gap, or is this their Nuvia acquisition doing the heavy lifting?
    pazimzadeh · 1789789813 · focus · HN ↗
    watt about in performance per watt?
2. bhouston · 1789775019 · focus · HN ↗
  It is probably doable right not to push a risc-v design into that performance space.
3. Lramseyer · 1789776657 · focus · HN ↗
  Production grade CPU design is more than just the RTL (the source code.) To achieve the performance numbers that these companies get, you have to do a ton of optimization in your physical design to achieve the power/performance/area (PPA) metrics that make these products competitive. LLMs are not suitable for that kind of work.
  There are people working on PPA optimization and trying to shake up how things are done, just not with LLMs.
  1. btown · 1789777640 · focus · HN ↗
    Something that I think is fascinating, though, is that labs are no longer beholden to the limitations of commercial design software. Want to replace your simulator and optimizer with a fully custom verifiable stack of Lean proofs of optimality and correctness? Just throw your unlimited token budget at it.
    xpct · 1789780023 · focus · HN ↗
    I don't work in the business, but my understanding was that even with these companies' budgets, it's still too expensive to do any kind of verified performance optimality.
    thfuran · 1789782292 · focus · HN ↗
    And I think correctness for anything near the size of a CPU is off the table.
  2. menaerus · 1789798733 · focus · HN ↗
    > LLMs are not suitable for that kind of work.
    I wonder why not or you meant not suitable yet?
    Systemerror7A69 · 1789802810 · focus · HN ↗
    This is just speculation on my part, but LLMs work best when they get immediate, verifiable feedback on their task, and the kind of physical optimizations they mean might not give that to LLMs.
    menaerus · 1789808350 · focus · HN ↗
    Also a speculation but I'm almost certain that physical optimizations are first done through simulators running on a computer.
    amelius · 1789814324 · focus · HN ↗
    Yes, they are, but the most important subtasks of designing a CPU are not physics related. They are picking the right parameters for things like: how wide do I make this bus, how many registers do I put in the register file, how large do I make this cache, how deep do I make this pipeline, etc., etc. To find optimal parameters requires a lot of simulations, and humans do this, but LLMs could do them just as well and maybe better because they excel at tedious work.
    TeMPOraL · 1789826106 · focus · HN ↗
    The right way is to throw LLMs at building tools that reframe the problem into a shape LLMs are good at navigating, and then have LLMs use those tools to solve it.
  3. amelius · 1789811487 · focus · HN ↗
    That's exactly where LLMs can shine, because design space exploration requires tedious work and endless simulations.
    Lramseyer · 1790012131 · focus · HN ↗
    Yes, but that's only the first part of it. The LLM can create 100 good, working, and verified designs. You still need to lay them out and optimize the physical designs. That kind of optimization is not something language models are good at. You need something fundamentally different.
  4. IshKebab · 1789830047 · focus · HN ↗
    That's the sort of the AI (including non-LLM AI) is really good at - even more so than the actual design work.
4. xpct · 1789780525 · focus · HN ↗
  Isn't that weird? The full knowledge of how to make such chips may one day be accessible to anyone, yet only the entrenched companies will remain the makers.
  If we imagine machines being able to do the full process end-to-end, and the quality of that process only dependent on capital spent on tokens, I don't see how new companies could ever enter the market.
5. nullc · 1789782225 · focus · HN ↗
  And be super-bankrupted by patent litigation from Apple. I don't think they're worried.
  After all, they successfully threatened Adobe with spurious patent litigation unless they joined w/ apple in illegally fixing wages.
  You don't think a criminal like apple would absolutely decimate any competition given the opportunity? They didn't hold back when it was a unambiguous crime, they surely wouldn't if it was merely bad for the world.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.