‹ BackHN Continuity

Thread

Wall Street is growing skeptical of the data center boom

72 points · 87 comments · mikhael

  1. lil-lugger · · focus · HN ↗
    Is there anyone serious who thinks that the future is local models anyway? All computers used to be the size of rooms like these data centers and then they got smaller and faster until the home computer came. Is that not a possibility down the line as we improve efficiency of the models and increase compute?
    1. Zetaphor · · focus · HN ↗
      I have a shoebox sized computer (Framework Desktop) running Qwen 3.8 Flash Next. It has completely replaced my use of proprietary models in my personal life. 6 months ago I would have told you this was impossible. Based on the current trajectory I expect 6 months from now I'll have a Mythos class model at home. The best part is not having to concern myself with token cost has unlocked all kinds of experimentation and use cases. I have been pushing over a billion tokens per week for multiple weeks now, all for the $52/year it costs to keep this machine running 24/7
      1. lostmsu · · focus · HN ↗
        What's the output rate and config?
        1. Zetaphor · · focus · HN ↗
          Asked my agent to dump this to pastebin from my phone since I won't be home for a while

          <a href="https:&#x2F;&#x2F;pastebin.com&#x2F;bBXbpDyu" rel="nofollow">https:&#x2F;&#x2F;pastebin.com&#x2F;bBXbpDyu

          Here&#x27;s the chat template I use:

          <a href="https:&#x2F;&#x2F;huggingface.co&#x2F;froggeric&#x2F;Qwen-Fixed-Chat-Templates" rel="nofollow">https:&#x2F;&#x2F;huggingface.co&#x2F;froggeric&#x2F;Qwen-Fixed-Chat-Templates

          1. mizzao · · focus · HN ↗
            Are you using Linux or a different OS, and what GPU &#x2F; how much did it cost?
            1. science4sail · · focus · HN ↗
              From the paste, it&#x27;s pretty obvious that they&#x27;re using Linux with a custom llama.cpp fork. The Framework Desktop uses the AMD Strix Halo chipset, which is a unified memory system with an integrated GPU. I think that it goes for around $3000 in these inflated times.
              1. Zetaphor · · focus · HN ↗
                Every day I am grateful that I only paid $1800
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.