Thread

Jeff – Jev-compatible 0.8B decision models, trained at home, ~30 ms

575 points · 225 comments · firelex

adrithmetiqa · 1790632786 · focus · HN ↗
Forgive my lack of understanding but how long before Jev type functionality is just built straight into all frontier models?
1. tbeseda · 1790633333 · focus · HN ↗
  If I had to guess, it's already built and is just waiting on Product's/Marketing's desk. How do you position this without looking like your roadmap is being determined by newcomers? Probably don't want to adopt the same verbiage+acronyms - but also can't be seen to be just sherlocking features.
  1. seizethecheese · 1790633838 · focus · HN ↗
    I think Apple has demonstrated that shipping second has essentially no negative impact if your product is seen as higher quality.
    bigyabai · 1790634141 · focus · HN ↗
    I think Nvidia has demonstrated that shipping first is a multi-trillion dollar opportunity if you don't shy away from a challenge.
    throwaway27448 · 1790634811 · focus · HN ↗
    Chip manufacturing intrinsically comes with one hell of a moat. There's not much parallel in software.
    slashdev · 1790636087 · focus · HN ↗
    That’s kind of funny because Nvidia’s biggest moat is arguably CUDA, the software ecosystem around their chips
    mcmcmc · 1790637193 · focus · HN ↗
    CUDA is a lock-in moat, the infrastructure needed for chip manufacturing is a barrier-to-entry moat. Two different things.
    AtlasBarfed · 1790640196 · focus · HN ↗
    If cuda is an API, and llms make apis effortless, then how big of a moat is cuda?
    robflynn · 1790641446 · focus · HN ↗
    I ran across this a few days ago: <a href="https://zluda.org/" rel="nofollow">https://zluda.org/
    QuantumNomad_ · 1790657744 · focus · HN ↗
    All of the buttons and links on that page redirect to spam pages. Most of the times I clicked, it brings me to some site that wants to sell me a VPN.
    robflynn · 1790696321 · focus · HN ↗
    Oh, yikes, I should've checked those links before posting it here. That's certainly not a good look for them.
    There was a github repo but I have not checked it.
    edit I see, thats an unaffiliated site that latched onto that, my bad, here's the GH that I should've linked: <a href="https://github.com/vosen/ZLUDA" rel="nofollow">https://github.com/vosen/ZLUDA
    [deleted] · 1790696393 · focus · HN ↗
    [deleted]
    bobmarleybiceps · 1790643141 · focus · HN ↗
    IMO, yes a lot of the "nvidia pays lots of people to make non-portable, tightly coupled backends to open source projects" is potentially going to be less of a moat?
    (Though it could turn into "nvidia pay lots of people to use LLMs to make non-portable, tightly coupled backends to _even more_ open source projects")
    trollbridge · 1790644234 · focus · HN ↗
    It turns out the moat is “writing drivers that work”; Nvidia drivers simply work, and Intel’s are poor quality. So if I want stuff that works I need to buy Nvidia gear.
    latentsea · 1790650601 · focus · HN ↗
    It's becoming less of one. Previously I would have shied away from buying an AMD card because of CUDA, but with local LLMs getting good enough to be usable and frontier models becoming as good as they have, I bit the bullet and got an R9700 for local inference. Dealing with working around CUDA used to be more of a manual process, but when you can point an agent at it and get stuff working, it's dramatically less painful and scary than it used to be. Plus, at least in ComfyUI and local LLMs I'm finding support for AMD has gotten really good. Lately I've been witnessing a lot of people using agents to write custom kernels for RDNA4 and improving performance dramatically.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.