Thread

1. jmiskovic · 1789557527 · focus · HN ↗

   Incredibly important research. We've reached the point where local LLMs are good enough! It takes less time for local model to take the first action on your task than it does for Claude to validate your login, put you into queue and start issuing the commands. Local models are persistent and 100% predictable unlike any cloud offering. It's better for the power system for the demand to be distributed. During the winter time the GPU also doubles as a 300W in-house heater. Not to mention avoiding personal data collection and re-selling.

   1. rpozarickij · 1789565958 · focus · HN ↗

      > During the winter time the GPU also doubles as a 300W in-house heater

      There could be a service that works in reverse where if someone needs a heater for a few months, they could rent a portable server (e.g. using older repurposed GPUs) with a built-in 5G modem that would run inference on LLM queries. As an incentive perhaps renting itself could be free (or you could earn money?), but you'd still have to pay your electricity bill.

      1. stymaar · 1789572165 · focus · HN ↗

         I saw a company pitching almost exactly this on linkedin earlier this month. Except not as a portable heater but as your house's central heating system.

Unofficial Hacker News client; not affiliated with Y Combinator.