This is so interesting to watch. For a couple minutes I was in awe of how quick and cheap it was. Then I saw just how bad the decision are and how it would get stuck in strange loops of going in and out of the same door to no end.
This seems like a technology heading in the right direction but not quiet there yet. Excited for what they are cooking up but probably won't start building around it yet.
This entire conversation around Jev seems weird to me. Like... we started from neural nets that could do basic decision making and classifications pretty well, then trained larger and larger language models to get to where we are now. Now suddenly everyone is going crazy because someone trained a smaller model that is adequate at making decisions? We already went through the "look this AI can play pokemon terribly" phase like a decade ago.
The difference is that you don't need training here;
The decision graphs can be built on the fly by an LLM and contain instructions in plain language.
The magic moment for me from the Jev release was not that there was some system playing doom: Rather it was the moment, they just changed a part of the prompt to "don't shoot, just dodge" and the behavior changed immediately.
This means you can have a system with fast decision-making but still interact with it via language.
You’re kind of screwed on the latency optimization side bc your bottleneck is a language model though. Why wouldn’t you eventually just use a specialized model that isn’t constrained by running a language model under the hood?
True - in the long run. But that's quite expensive. And you'd need a bigger org to even support this.
They even named the model after "Jevons Paradoxon" - They anticipate that their model lowers the cost of adopting this kind of AI significantly, unlocking a lot of use cases.
stusmall · · focus · HN ↗
This seems like a technology heading in the right direction but not quiet there yet. Excited for what they are cooking up but probably won't start building around it yet.
binlog · · focus · HN ↗
Garlef · · focus · HN ↗
The magic moment for me from the Jev release was not that there was some system playing doom: Rather it was the moment, they just changed a part of the prompt to "don't shoot, just dodge" and the behavior changed immediately.
This means you can have a system with fast decision-making but still interact with it via language.
catlifeonmars · · focus · HN ↗
Garlef · · focus · HN ↗
They even named the model after "Jevons Paradoxon" - They anticipate that their model lowers the cost of adopting this kind of AI significantly, unlocking a lot of use cases.