It can't hallucinate, but it doesn't mean it can't make wrong decisions. Just because it adheres to a specific output format at all time, while LLMs have the output format at their mercy, then the claim of not hallucinating is made technically true.
I think that this specific part is not super interesting if your harness just recovers from invalid LLM outputs.
The latency and cost - yes, those are super interesting.
You can get rigid output format from "classic" LLMs <a href="https://docs.vllm.ai/en/latest/features/structured_outputs/" rel="nofollow">https://docs.vllm.ai/en/latest/features/structured_outputs/ though model support is limited.
Would like to have something like in the original post but open weights.
dinobones · · focus · HN ↗
Typesafe.AI sounds like some typescript/structured output type of tool…
What even is “system one” ?
IMO the product/tech is really there, just needs better communication.
toddmorey · · focus · HN ↗
flyinglizard · · focus · HN ↗
I think that this specific part is not super interesting if your harness just recovers from invalid LLM outputs.
The latency and cost - yes, those are super interesting.
mhitza · · focus · HN ↗
Would like to have something like in the original post but open weights.