Fun update to this: Daniel Lemire added another optimization to make this even faster. <a href="https://github.com/jadidbourbaki/llama.cpp/pull/12" rel="nofollow">https://github.com/jadidbourbaki/llama.cpp/pull/12
I’ll benchmark his change and add it to the article, crediting him for this improvement.
jadidbourbaki · · focus · HN ↗
I’ll benchmark his change and add it to the article, crediting him for this improvement.