‹ BackHN Continuity

Thread

Stay discoverable in search while disallowing AI training

87 points · 50 comments · djfergus

  1. 1vuio0pswjnm7 · · focus · HN ↗
    "Cloudflare classifies bots by behavior, and a single bot can exhibit more than one behavior."

    Is that really true

    CF classifies anyone not using a popular browser with Javascript enabled as a "bot"

    CF fingerprints www users

    As an example, look at CF's Permissions-Policy HTTP response header on a site with CF "bot protection", i.e., the "checking your browser" CAPTCHA nonsense (challenges.cloudflare.com). Then look at IA's Permissions-Policy response header. One CDN is advertiser-focused, the other is user-focused

    IA = Internet Archive

    1. userbinator · · focus · HN ↗
      CF classifies anyone not using a popular browser with Javascript enabled as a "bot"

      This is my biggest complaint about CF. They are implicitly supporting user-agent discrimination in favour of Big Browser, instead of discriminating on actual behaviour.

      ...and of course there are already companies running tons of VMs with "officially sanctioned" browser + OS stacks, that can get past all these "protections", for a fee.

      "AI bots" is the newest boogeyman they came up with to take away freedom.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.