That pareto graph isn't very helpful because it shows cost per token, but some models are way more token hungry than others. There are also massive differences in speed to complete a task.
My two favorite graphs are AA's A Index vs Time Per Task and AA Index vs Cost Per Task.
andai · · focus · HN ↗
My two favorite graphs are AA's A Index vs Time Per Task and AA Index vs Cost Per Task.
<a href="https://artificialanalysis.ai/#intelligence-comparison-tabs" rel="nofollow">https://artificialanalysis.ai/#intelligence-comparison-tabs
<a href="https://artificialanalysis.ai/?intelligence-comparison=intelligence-vs-time-per-task#intelligence-comparison-tabs" rel="nofollow">https://artificialanalysis.ai/?intelligence-comparison=intel...
ericpauley · · focus · HN ↗