‹ BackHN Continuity

Thread

Astra for Law

589 points · 689 comments · vertigoruntime

  1. cbg0 · · focus · HN ↗
    No word on model hallucinations in the blog post.

    <a href="https:&#x2F;&#x2F;artificialanalysis.ai&#x2F;models&#x2F;gpt-6-astra?omniscience=omniscience-hallucination-rate" rel="nofollow">https:&#x2F;&#x2F;artificialanalysis.ai&#x2F;models&#x2F;gpt-6-astra?omniscience...

    1. heaney-555 · · focus · HN ↗
      The benchmark you linked to shows GPT-6 Astra having the lowest hallucination rate of all tested models.
      1. jdiff · · focus · HN ↗
        The blog post makes no mention. If the rate isn&#x27;t 0% it should be mentioned for a field like this.
        1. TomGarden · · focus · HN ↗
          Agreed. Hallucinations and reliability are the main hurdles to anything being &#x27;agi&#x27; in my book
          1. Tanjreeve · · focus · HN ↗
            The definition of AGI is whatever a frontier lab wrote a blog about doing in the last week.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.