The Two MMLU Scores: What a Benchmark Name Does Not Fix
Thread
Loading the complete thread in the background. This saved snapshot is available now. Refresh
Unofficial Hacker News client; not affiliated with Y Combinator.
The Two MMLU Scores: What a Benchmark Name Does Not Fix
Loading the complete thread in the background. This saved snapshot is available now. Refresh
Unofficial Hacker News client; not affiliated with Y Combinator.
bbstats · · focus · HN ↗
entrope · · focus · HN ↗
And I have to think hard to guess what it probably meant by "Comparability is a property of the reference the results are traceable to, not of the number". I don't think "[X and Y] are different scopes by canonical bytes" even makes sense.
mpalmer · · focus · HN ↗