I'm unlocking savings (in both speed and costs) but using a different way of thinking by integrating Decision models:
In short, LLMs spend so many turns on discovery, triage, and safety checks for everyday tasks. A decision model cuts those turns by preparing the relevant context before the prompt and handling the simple judgments itself, so the LLM only does the real work.
Here is the full article I published yesterday with in-house benchmark:
<a href="https://tawfeks.github.io/decisionkit/" rel="nofollow">https://tawfeks.github.io/decisionkit/
I don't mean to be super negative, but I read through this all the way and still have no idea what it does or how it works. I think the problem statement needs to be outlined much better, and concrete examples of turns with/without your solution would be helpful to illustrate the difference.
respectattentio · · focus · HN ↗
I'm unlocking savings (in both speed and costs) but using a different way of thinking by integrating Decision models:
In short, LLMs spend so many turns on discovery, triage, and safety checks for everyday tasks. A decision model cuts those turns by preparing the relevant context before the prompt and handling the simple judgments itself, so the LLM only does the real work.
Here is the full article I published yesterday with in-house benchmark: <a href="https://tawfeks.github.io/decisionkit/" rel="nofollow">https://tawfeks.github.io/decisionkit/
What do you think, guys? I need feedback on this.
RussianCow · · focus · HN ↗