Thread

1. yipinwong · 1790874457 · focus · HN ↗

   A question someone not trainined in AI/ML field, Is a decision model that easy to crete that there are floods of these JEV alternatives already?

   Or are companies/people already building this based on say an arXiv docs? n

   ---

   The pricing is ... hm more expensive but not at the point I won't give it a try due to the embeded vision encoding

   1. XCSme · 1790874953 · focus · HN ↗

      You can make a basic one in minutes based on existing open-source models.

      Latency won't be that good, but could still work similarly. Simply force the structured output of a LLM to the given schema.

      Probably also easy to train because we can use stronget LLMs to generate input/output data, or even synthetic data is easy to generate.

      It's not really a new technology, it's more like a new use-case.

      1. sigbottle · 1790875938 · focus · HN ↗

         What even are these new "decision models?" Take an existing LLM, feed it a prompt, force it to pick a choice; decode is 1 token (or rather, the whole logit set for only that last token; token implies selecting one logit) so you made a choice. That's it?

         1. orbital-decay · 1790877641 · focus · HN ↗

            Yes but optimized specifically for the purpose. Using that for "decision making" is also not a new use case, but turned out to be new to many people. Which is great, I hope they make something cool with it!

Unofficial Hacker News client; not affiliated with Y Combinator.