Thread

Clef: Open-weight decision models, and new RL fine-tuning platform

637 points · 217 comments · jasondavies

yipinwong · 1790874457 · focus · HN ↗
A question someone not trainined in AI/ML field, Is a decision model that easy to crete that there are floods of these JEV alternatives already?
Or are companies/people already building this based on say an arXiv docs? n
---
The pricing is ... hm more expensive but not at the point I won't give it a try due to the embeded vision encoding
1. XCSme · 1790874953 · focus · HN ↗
  You can make a basic one in minutes based on existing open-source models.
  Latency won't be that good, but could still work similarly. Simply force the structured output of a LLM to the given schema.
  Probably also easy to train because we can use stronget LLMs to generate input/output data, or even synthetic data is easy to generate.
  It's not really a new technology, it's more like a new use-case.
  1. sigbottle · 1790875938 · focus · HN ↗
    What even are these new "decision models?" Take an existing LLM, feed it a prompt, force it to pick a choice; decode is 1 token (or rather, the whole logit set for only that last token; token implies selecting one logit) so you made a choice. That's it?
    redox99 · 1790878746 · focus · HN ↗
    Yes, although you probably want to calibrate your model if you want the probabilities to actually be meaningful.

Unofficial Hacker News client; not affiliated with Y Combinator.