Thread

1. eggbrain · 1790784864 · focus · HN ↗

   Performance optimizations don't just help the western labs, they also help with running more powerful/useful LLMs locally.

   If local LLMs get "good" enough, people will soon paying for subscriptions to ChatGPT and Claude, which hurts their revenue.

   1. londons_explore · 1790786083 · focus · HN ↗

      For nearly all tasks, I want the fastest and smartest AI model.

      It is vanishingly rare I ask an older model to do any task. Newer bigger and smarter models will just do the task better.

      Therefore, I believe we are nowhere near 'good enough'.

      I never drive my steam engine to work these days. It isn't good enough.

      1. schmookeeg · 1790796995 · focus · HN ↗

         This will change when out of control billing gets noticed. Then us devs will, I presume, get token rations.

         I can see my new Thursday afternoon "oh chit" moment being that I didn't complete my weekly task because i torched all of those tokens M-W doing task/ticket grooming using the hot hot model instead of the dodo model with jira mcp connector :D

Unofficial Hacker News client; not affiliated with Y Combinator.