As an update to this, Lemire absolutely crushed it! I benchmarked his change today. Here is my PR comment:<a href="https://github.com/jadidbourbaki/llama.cpp/pull/12#issuecomment-5856228676" rel="nofollow">https://github.com/jadidbourbaki/llama.cpp/pull/12#issuecomm...
jadidbourbaki · · focus · HN ↗
<a href="https://github.com/jadidbourbaki/llama.cpp/pull/12#issuecomment-5856228676" rel="nofollow">https://github.com/jadidbourbaki/llama.cpp/pull/12#issuecomm...