‹ BackHN Continuity

Thread

Hackers influence ChatGPT and Gemini to direct users to scam centers

143 points · 53 comments · ArielSimon

  1. pluc · · focus · HN ↗
    That's happening across the board when it comes to models that feed off online information. Create a website with a false claim, have AI slurp it up and spit it back out when a user asks a question.

    Happy elections.

    1. someonebaggy · · focus · HN ↗
      But how do you get AI to slurp up the site? It's quite hard for a random to get a site indexed these days.
      1. burningChrome · · focus · HN ↗
        Depends on the site. If its a small/medium business, every LLM is now looking for "reputation signals" and "authority signals". This means everything from your basic SEO on the site with incoming links, how updated your google business profile is, how many reviews you have, how recent they are. They're also looking at any kind of references from other blogs, substacks, youtube videos, social media shares as well as a number of other things they look for.

        I would imagine in smaller industries, flooding the internet with fake information, then linking it all together would be somewhat easier - but it still takes quite a bit of work to get even just the major LLM's to give the consistent responses you want to see.

Open on Hacker News to reply ↗

Unofficial Hacker News client; not affiliated with Y Combinator.