Thread

1. manlymuppet · 1790875177 · focus · HN ↗

   Am I hearing this right, that they made a decision model based on Typesafe's new paradigm, and actually made a model better than Jev based on Typesafe's own ranking?

   And it's only been a few weeks.

   1. segmondy · 1790890663 · focus · HN ↗

      A lot of people claim to have made better than jev, there's a jev benchmark, I have tried many of those models and they eventually end up failing, a non trivial task which doesn't seem like much but reminds me of the svg pelican bench is games, have one of these decision/classifier models play a game, hook it up to the input, most of the ones that are supposedly on jev level end up playing a terrible game, showing that they are very narrow. Cloudflare doesn't compare to the top open bench alternatives, I just finished downloading it and will compare it to jev for non trivial tasks tonight.

      1. verdverm · 1790894963 · focus · HN ↗

         watching Jev play Pokemon demonstrated this too, more hype than meat

         - I'd like a potion, are you sure, no, repeat

         - in and out of doors on loop

         - sisyphean effort in the cave

         - jev-ish level grinding

         It was impressive, beat pokemon for less than $2, but not all that interesting. People asking how different Math.Random plays pokemon would be, and at the other end, regular llms playing games.

Unofficial Hacker News client; not affiliated with Y Combinator.