Thread

1. dbeley · 1790075630 · focus · HN ↗

   If I'm understanding correctly, each calls to a LLM makes a 3000W GPU run at full speed during the time of inference (let's say from 5 to 60 sec) while Google searches are historically mostly cached so very inexpensive for most searches.

   Isn't the environmental impact 10 to 100 times what we were used to?

   1. mvcosta91 · 1790075901 · focus · HN ↗

      To be honest, the only way to make it more efficient is to use it more, creating an economic incentive to improve the system as a whole. The cognitive impact on future generations is far more important than that.

Unofficial Hacker News client; not affiliated with Y Combinator.