Thread

1. esafak · 1791119742 · focus · HN ↗

   Has anyone calculated the effective intelligence of these quantized models?

   I think publishing benchmarks with quantized models should become standard practice.

   1. mkl · 1791120236 · focus · HN ↗

      There's some info in the README, including:

      > Coder: a coding version with half of the experts removed. It reaches 91% of the full model's SWE-bench Verified score (measured by its authors) and fits 32 GB of RAM.

      <a href="https:&#x2F;&#x2F;github.com&#x2F;Niko1221&#x2F;Strata#which-model-should-i-pick" rel="nofollow">https:&#x2F;&#x2F;github.com&#x2F;Niko1221&#x2F;Strata#which-model-should-i-pick

      1. nisarg2 · 1791122890 · focus · HN ↗

         92% is halfway to 99%

         Holds up pretty well

Unofficial Hacker News client; not affiliated with Y Combinator.