Thread

1. jmiskovic · 1789557527 · focus · HN ↗

   Incredibly important research. We've reached the point where local LLMs are good enough! It takes less time for local model to take the first action on your task than it does for Claude to validate your login, put you into queue and start issuing the commands. Local models are persistent and 100% predictable unlike any cloud offering. It's better for the power system for the demand to be distributed. During the winter time the GPU also doubles as a 300W in-house heater. Not to mention avoiding personal data collection and re-selling.

   1. rpozarickij · 1789565958 · focus · HN ↗

      > During the winter time the GPU also doubles as a 300W in-house heater

      There could be a service that works in reverse where if someone needs a heater for a few months, they could rent a portable server (e.g. using older repurposed GPUs) with a built-in 5G modem that would run inference on LLM queries. As an incentive perhaps renting itself could be free (or you could earn money?), but you'd still have to pay your electricity bill.

      1. HPsquared · 1789571645 · focus · HN ↗

         I remember a company that sold or used bitcoin mining rigs as swimming pool heaters.

         1. teamonkey · 1789585406 · focus · HN ↗

            There was one that tried to sell them as free heating for the elderly.
      2. stymaar · 1789572165 · focus · HN ↗

         I saw a company pitching almost exactly this on linkedin earlier this month. Except not as a portable heater but as your house's central heating system.
      3. hunter2_ · 1789578402 · focus · HN ↗

         > you'd still have to pay your electricity bill.

         I should only have to pay 1/3 of what it adds to my bill, given that it's 1/3 as efficient as a heat pump. And that coefficient is to be adjusted as outside temp changes (assuming air source heat pump; water source would have a stable COP).

Unofficial Hacker News client; not affiliated with Y Combinator.