Thread

1. cbg0 · 1789677069 · focus · HN ↗

   No word on model hallucinations in the blog post.

   <a href="https:&#x2F;&#x2F;artificialanalysis.ai&#x2F;models&#x2F;gpt-6-astra?omniscience=omniscience-hallucination-rate" rel="nofollow">https:&#x2F;&#x2F;artificialanalysis.ai&#x2F;models&#x2F;gpt-6-astra?omniscience...

   1. jrflo · 1789678813 · focus · HN ↗

      Does hallucination matter for this application? We&#x27;ve moved beyond raw recall being that important, it seems like for law specifically all relevant facts will be cited and checked easily by humans.

      1. jordanpg · 1789688986 · focus · HN ↗

         The lawyers I know are very fixated on the problem of hallucinated case citations which is amusing to me as a onetime programmer, since case citations have a well-defined syntax and would be relatively easy to check programmatically.

         1. massysett · 1789691491 · focus · HN ↗

            Which makes it all the more bizarre that LLMs have this problem. Claude Code runs the code it generates through a compiler, why can’t an LLM run its product through a cite checker? I’ve seen LLMs fabricate citations.

            1. heaney-555 · 1789692834 · focus · HN ↗

               A modern frontier model with an agentic harness will check its citations if the system instructions or prompt tell it to.

               You can get an effectively-zero hallucination rate with the right setup already.

Unofficial Hacker News client; not affiliated with Y Combinator.