Does hallucination matter for this application? We've moved beyond raw recall being that important, it seems like for law specifically all relevant facts will be cited and checked easily by humans.
> all relevant facts will be cited and checked easily by humans
I've talked to a lawyer about how they handle this. They do indeed double-check everything, since it'd be embarrassing (or worse) to send hallucinated statements to opposing council or to the court. They still find the assembly a huge time saver
But based on stories in the news on the subject, not everyone has this same level of diligence
cbg0 · · focus · HN ↗
<a href="https://artificialanalysis.ai/models/gpt-6-astra?omniscience=omniscience-hallucination-rate" rel="nofollow">https://artificialanalysis.ai/models/gpt-6-astra?omniscience...
jrflo · · focus · HN ↗
jakevoytko · · focus · HN ↗
I've talked to a lawyer about how they handle this. They do indeed double-check everything, since it'd be embarrassing (or worse) to send hallucinated statements to opposing council or to the court. They still find the assembly a huge time saver
But based on stories in the news on the subject, not everyone has this same level of diligence