They either fudged the tests for this particular graph so that their own models showed no jailbreaks (if it's cherry-picked, then it only shows which jailbreaks work for GLM that Anthropic has already closed, it doesn't show actual probability of refusal under pressure) or there's something seriously wrong with their guardrails testing methodology.
If your red team success rate is a flat 0%, that doesn't mean your product is secure, it just means your red team isn't good enough.
Osato28 · · focus · HN ↗
If your red team success rate is a flat 0%, that doesn't mean your product is secure, it just means your red team isn't good enough.