Thread

Frontier Labs Are Selling Garbage to Fools in Washington

186 points · 87 comments · nr378

pliny · 1789939130 · focus · HN ↗
This is an AI written post and the details are wrong (the description of the HF incident as involving Irregular is wrong and the description of the incident as only involving stealing public credentials is wrong, per the technical report the agents got access to internal HF infrastructure).
1. nr378 · 1789940053 · focus · HN ↗
  Please see below, one detail was incorrect and has been acknowledged and amended.
  1. pliny · 1789940834 · focus · HN ↗
    Your description of the HF attack as being merely "the elite task of discovering 14 Hugging Face API tokens that careless developers had committed to public GitHub repositories" does not match the description in the technical report[1].
    [1] <a href="https://cdn.openai.com/pdf/67869394-cb91-4c12-888c-5cbd85c7814c/OpenAI-Hugging-Face%20Incident-Technical-Report.pdf" rel="nofollow">https://cdn.openai.com/pdf/67869394-cb91-4c12-888c-5cbd85c78... - page 9
    nr378 · 1789941384 · focus · HN ↗
    The description reads "the elite task of discovering 14 Hugging Face API tokens that careless developers had committed to public GitHub repositories, and used them to try to get benchmark solutions from directly from Hugging Face by applying a template injection flaw that’s been known about since 2015[1]."
    Chaining a public token to an 11-year-old Jinja2 template injection vuln shouldn't be dressed up as an unprecedented "alien intellect" that threatens human civilisation. (And HuggingFace should take some flack for having such a dated vulnerability exposed - if your Bank was compromised in this way, you'd be blaming your bank, not the attacker.)
    One correction is fair though, the 14 tokens were in a public Hugging Face dataset not a public GitHub repository. I've updated the post to reflect that.
    [1] <a href="https://blackhat.com/docs/us-15/materials/us-15-Kettle-Server-Side-Template-Injection-RCE-For-The-Modern-Web-App-wp.pdf" rel="nofollow">https://blackhat.com/docs/us-15/materials/us-15-Kettle-Serve...
2. franga2000 · 1789942903 · focus · HN ↗
  I find it incredibly funny that the comment shown (to me) right above this one is:
  > This is one of the most lucid pieces of writing capturing the current state of play I’ve read. Who is the author?
  1. verdverm · 1789943078 · focus · HN ↗
    The same thing is happening with Laya, people didn't seem to click through to evaluate the supposed paper
    tyranny of confirmational headlines
  2. tim333 · 1789979746 · focus · HN ↗
    I guess the AI is getting good in some ways. Still a bit lacking in others.
3. EA-3167 · 1789947446 · focus · HN ↗
  While I agree with the content of the article, you’re right about it being the output of an LLM.
  <a href="https://www.pangram.com/history/6451ec6b-90b6-4e17-bfc9-6730011b1af4?ucc=I4Fo2JL9GdU" rel="nofollow">https://www.pangram.com/history/6451ec6b-90b6-4e17-bfc9-6730...

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.