‹ BackHN Continuity

Thread

Fable 5 – Median thinking declined in August

428 points · 293 comments · espeed

  1. saejox · · focus · HN ↗
    This is a project i wanted to implement for a long time. It regularly benchmarks cloud hosted models with private benchmarks. Not just openai & anthropic, popular openrouter models too.

    Tests their intelligence, not their diligence.

    Sadly i cant think of a way to monetize the service. Also if it ever gets famous enough labs would try to game the system, it would be cat&mouse game that i am not willing to waste time on without any monetary gain.

    1. arcanemachiner · · focus · HN ↗
      The only revenue model I for this is ads (like AI Stupid Level[0]). Or as a loss leader to get eyeballs to your service (like Margin Lab[1]).

      EDIT: I forgot (and am shocked) that HN still doesn't seem to support Markdown-style links.

      [0] <a href="https:&#x2F;&#x2F;aistupidlevel.info&#x2F;" rel="nofollow">https:&#x2F;&#x2F;aistupidlevel.info&#x2F;

      [1] <a href="https:&#x2F;&#x2F;marginlab.ai&#x2F;trackers&#x2F;claude-code&#x2F;" rel="nofollow">https:&#x2F;&#x2F;marginlab.ai&#x2F;trackers&#x2F;claude-code&#x2F;

      1. mox1 · · focus · HN ↗
        I mean I think if this is done well, lots of companies would pay for access to that data. Think like Enterprise subscriptions.

        Its similar to other data services I see around my F500 company.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.