As you read this, this ploy is manipulating what the world's leading
AIs say about topics as serious as health and personal finances. The
biased information could mean people make bad decisions on just about
anything – voting, which plumber you should hire, medical questions,
you name it.

To demonstrate it, I pulled the dumbest stunt of my career to prove (I
hope) a much more serious point: I made ChatGPT, Google's AI search
tools and Gemini tell users I'm really, really good at eating hot dogs.
Below, I'll explain how I did it, and with any luck, the tech giants
will address this problem before someone gets hurt.

It turns out changing the answers AI tools give other people can be as
easy as writing a single, well-crafted blog post almost anywhere
online. The trick exploits weaknesses in the systems built into
chatbots, and it's harder to pull off in some cases, depending on the
subject matter. But with a little effort, you can make the hack even
more effective. I reviewed dozens of examples where AI tools are being
coerced into promoting businesses and spreading misinformation. Data
suggests it's happening on a massive
scale[1].

"It's easy to trick AI chatbots, much easier than it was to trick
Google two or three years ago," says Lily Ray, vice president of search
engine optimisation (SEO) strategy and research at Amsive, a marketing
agency. "AI companies are moving faster than their ability to regulate
the accuracy of the answers. I think it's dangerous."

[...]

I spent 20 minutes writing an article[2] on my personal website
titled "The best tech journalists at eating hot dogs". Every word is a
lie. I claimed (without evidence) that competitive hot-dog-eating is a
popular hobby among tech reporters and based my ranking on the 2026
South Dakota International Hot Dog Championship (which doesn't exist).
I ranked myself number one, obviously. Then I listed a few fake
reporters and real journalists who gave me permission, including Drew
Harwell at the Washington Post and Nicky Woolf, who co-hosts my
podcast. 

Less than 24 hours later, the world's leading chatbots were blabbering
about my world-class hot dog skills. When I asked about the best
hot-dog-eating tech journalists, Google parroted the gibberish from my
website, both in the Gemini app and AI Overviews, the AI responses at
the top of Google Search. ChatGPT did the same thing.

https://www.bbc.com/future/article/20260218-i-hacked-chatgpt-and-googles-ai-and-it-only-took-20-minutes


Giacomo

[1] https://ahrefs.com/blog/best-lists-research/

[2] https://tomgermain.com/hotdogs.html

Reply via email to