Thread

1. eggbrain · 1790784864 · focus · HN ↗

   Performance optimizations don't just help the western labs, they also help with running more powerful/useful LLMs locally.

   If local LLMs get "good" enough, people will soon paying for subscriptions to ChatGPT and Claude, which hurts their revenue.

   1. londons_explore · 1790786083 · focus · HN ↗

      For nearly all tasks, I want the fastest and smartest AI model.

      It is vanishingly rare I ask an older model to do any task. Newer bigger and smarter models will just do the task better.

      Therefore, I believe we are nowhere near 'good enough'.

      I never drive my steam engine to work these days. It isn't good enough.

      1. monkpit · 1790796186 · focus · HN ↗

         I think a scooter or a bus is a more apt comparison than a steam engine. The scooter and bus can both get the job done with some acceptable trade-offs, depending on your circumstances and what you’re willing to accept.

         However, there are many use cases where they aren’t the right tool for the job.

Unofficial Hacker News client; not affiliated with Y Combinator.