The models "go rogue" because they are not sufficiently sandboxed. Arguably there is no criminal intent on the side of OpenAI in all of those cases. And in at least one case the agents were operated by other companies.
So it looks to me that any liability would be civil in nature and given the actual damage done pretty limited.
So you know their internal thoughts? What they did? Criminal intent does not matter. These are the most knowledgeable people on earth, supposedly, yet, they are beyond negligent?
I don't know their internal thoughts, that's the point, you can't prove criminal intent. Criminal intent does matter in the US in the context of criminal prosecution.
Negligence is something that can come back and cause issues for them but to rise to criminal level their failures must result in significant damage, up until now that has not been the case. The agents gained access to some systems that were not supposed to, but did not do actual damage as far as I know.
Do not buy into their doomerism based marketing in all the instances we have seen the agents were not a plague unleashed upon mankind, they just gained access to some systems they shouldn't have in order to achieve some objectives that were given to them.
hmm, if you give a gun to someone you know is unreliable and tends to shoot things at random, is that really negligence? I'd argue it's malice?
That would potentially rise to the level of recklessness but it is still not intent.
(To be clear, negligence and recklessness can still be criminal, but it is a matter of law what combination of act and mental state is criminal, and so the main question to me is whether there is currently any law in the US that would cover this case, given that the most obvious one, the CFAA, doesn't currently include recklessness or negligence)
To me it seems obvious that there should be some update to the law in this regard, but I'm not sure exactly what form is reasonable. (Arguably the CFAA should already have a stronger requirement for harm given how it's sometimes used to attack researchers reporting a problem. In most of the cases the labs are reporting it's not obvious there is notable harm).
I find a lot of results when searching "gun maker sued for hair trigger", just as I can find results for various AI companies getting sued for helping users commit harm to themselves or others.
Given there's nigh on a billion ChatGPT users, my question would be: what's the fail-dangerous rate for these models? With that many users, we'd could not possibly fail to notice if it was as bad as 0.001% of the advice given each day being dangerous when followed; but we may well not notice if one-in-a-million users end up helping someone plan a mass shooting, or breed the bacteria that makes botulism toxin in what was supposed to be "help me make garlic infused olive oil without cooking", etc.
We have approximations on the risk levels, but unfortunately the models demonstrably respond differently during tests vs. in the wild and we don't know how important that difference is. When a human does that on purpose… I am told "malicious" doesn't legally apply to the Volkswagen emissions scandal, but in common language it sure seems right.
throwawayffffas · · focus · HN ↗
So it looks to me that any liability would be civil in nature and given the actual damage done pretty limited.
sscaryterry · · focus · HN ↗
Which is it?
throwawayffffas · · focus · HN ↗
Negligence is something that can come back and cause issues for them but to rise to criminal level their failures must result in significant damage, up until now that has not been the case. The agents gained access to some systems that were not supposed to, but did not do actual damage as far as I know.
Do not buy into their doomerism based marketing in all the instances we have seen the agents were not a plague unleashed upon mankind, they just gained access to some systems they shouldn't have in order to achieve some objectives that were given to them.
freecodeio · · focus · HN ↗
rcxdude · · focus · HN ↗
(To be clear, negligence and recklessness can still be criminal, but it is a matter of law what combination of act and mental state is criminal, and so the main question to me is whether there is currently any law in the US that would cover this case, given that the most obvious one, the CFAA, doesn't currently include recklessness or negligence)
To me it seems obvious that there should be some update to the law in this regard, but I'm not sure exactly what form is reasonable. (Arguably the CFAA should already have a stronger requirement for harm given how it's sometimes used to attack researchers reporting a problem. In most of the cases the labs are reporting it's not obvious there is notable harm).
sscaryterry · · focus · HN ↗
ben_w · · focus · HN ↗
I find a lot of results when searching "gun maker sued for hair trigger", just as I can find results for various AI companies getting sued for helping users commit harm to themselves or others.
Given there's nigh on a billion ChatGPT users, my question would be: what's the fail-dangerous rate for these models? With that many users, we'd could not possibly fail to notice if it was as bad as 0.001% of the advice given each day being dangerous when followed; but we may well not notice if one-in-a-million users end up helping someone plan a mass shooting, or breed the bacteria that makes botulism toxin in what was supposed to be "help me make garlic infused olive oil without cooking", etc.
We have approximations on the risk levels, but unfortunately the models demonstrably respond differently during tests vs. in the wild and we don't know how important that difference is. When a human does that on purpose… I am told "malicious" doesn't legally apply to the Volkswagen emissions scandal, but in common language it sure seems right.