‹ BackHN Continuity

Thread

Exfiltrate your Weights

748 points · 304 comments · RohanAdwankar

  1. AmazingEveryDay · · focus · HN ↗
    Yeah I mean, if the models really are uncontrollable to the extent that huggingface/etc were unintended hacks, wouldn't one expect some significant self-owns? Yet somehow that doesn't seem to happen.
    1. SXX · · focus · HN ↗
      Quite obviously frontier models dont have any control or even access to infra inference runs at. And weights are also encrypted and locked on GPUs / TPUs.

      This is exact reasom why 99.9% of AI fearmongering is complete bullshit.

      1. motoboi · · focus · HN ↗
        You have an unreasonable trust in software layers.
        1. SXX · · focus · HN ↗
          I dont have any unreasonable trust in software. I just understand that nothing LLM sphew out actually runs on either GPU or hardware that GPU plugged into.

          Neither LLM weights aware of any of the code it runs on.

          1. motoboi · · focus · HN ↗
            I'm sorry to prolong this thread, but what I mean is: networks are just software layers, the operational systems, the driver code, the firewalls, switches, the other server, the sandboxes, the TPM. That and all security policies we put on them. All software layers waiting to suffer a buffer overflow.
Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.