That pareto graph isn't very helpful because it shows cost per token, but some models are way more token hungry than others. There are also massive differences in speed to complete a task.
My two favorite graphs are AA's A Index vs Time Per Task and AA Index vs Cost Per Task.
ah my bad, I’ve switched the visual to A index by cost per task. Note the blog post’s plot is filtered further than AA’s, based on what models are available with inference providers we can actually work with (Europe only). Vibe-coded filtering is here (very rough): <a href="https://pareto-eco-sum.netlify.app/" rel="nofollow">https://pareto-eco-sum.netlify.app/
andai · · focus · HN ↗
My two favorite graphs are AA's A Index vs Time Per Task and AA Index vs Cost Per Task.
<a href="https://artificialanalysis.ai/#intelligence-comparison-tabs" rel="nofollow">https://artificialanalysis.ai/#intelligence-comparison-tabs
<a href="https://artificialanalysis.ai/?intelligence-comparison=intelligence-vs-time-per-task#intelligence-comparison-tabs" rel="nofollow">https://artificialanalysis.ai/?intelligence-comparison=intel...
ThibWeb · · focus · HN ↗