AI is Watch Fast Five Onlinestealing your content. We know this is how AI companies have built their highly-valued businesses – by scraping the web and using your data to train their chatbots.
Web scraping isn't new. In the past, websites could rely on simple protocols like robots.txt to define what could, and could not, be used by web crawlers. Those guidelines were respected by the companies doing the scraping to, say, build results for search engines. AI companies, however, are not abiding by this social contract and are ignoring those instructions.
Cloudflare, a global network service that helps some of the biggest websites in the world deliver content to users, has devised a new plan to deal with AI companies' web scrapers. And the idea is as positively devious as it is ingenious.
In a new blog post, Cloudflare has shared how it's now "trapping misbehaving bots in an AI labyrinth." Basically, bots that don't follow the rules laid out for them via protocols such as robots.txt, a simple text file that lays out what web crawlers are allowed to do on a site, will be messed with in order to waste the time and resources of the company in charge of the bot.
"AI-generated content has exploded…at the same time, we’ve also seen an explosion of new crawlers used by AI companies to scrape data for model training," Cloudflare said in its post. "AI Crawlers generate more than 50 billion requests to the Cloudflare network every day, or just under 1% of all web requests we see."
Cloudflare says it previously just blocked AI web crawlers and scrapers. However, doing so alerted those behind the bots that their access had been denied, and as a result they would shift strategies in order to continue their scraping campaigns.
So, Cloudflare came up with an idea to build a honeypot: a series of fake webpages created with AI-generated content.
The fact that Cloudflare is utilizing AI-generated content to fight AI web scrapers isn't just for schadenfreude. When AI trains off of AI-generated content, it actually degradesthe AI model itself. The industry even has a term for it: "model collapse." Cloudflare is essentially making sure that bots that break the rules are punished for doing so.
Cloudflare's post gets into the technical detailsof building the AI labyrinth. But, the main gist of it is that Cloudflare devised things in a way where a human visitor shouldn't ever see these AI-generated honeypot pages. In addition, humans would notice the "AI-generated nonsense" on these pages. Bots, however, would fall down the rabbit hole, wasting computational resources as they go deeper and deeper through the multiple pages of AI-generated content.
Cloudflare customers are able to opt-in to using the AI labyrinth right now to protect their content from web scrapers.
Topics Artificial Intelligence
Draper vs. Arnaldi 2025 livestream: Watch Madrid Open for free
NYT Connections hints and answers for January 24: Tips to solve 'Connections' #593.
Nespresso Vertuo Next deal: $123.99 at Amazon
Samsung Galaxy S25 Edge: The ultra
TikTok wants me to host a dinner party. Is that an actual recession indicator?
Stuff Your Kindle Day Jan. 23: Free historical cozy mystery e
Samsung Galaxy Unpacked 2025 live updates: Galaxy S25 series, AI tools, and more
Best Microsoft Surface deal: Save $200 on a Microsoft Surface Pro 11 Copilot+ PC
Philips now allows customers to 3D print replacement parts
'Severance's Lumon LinkedIn page reveals Miss Huang's true identity
'The Last of Us' Season 2, episode 4: Why Ellie sings 'Take on Me'
Hoffenheim vs. Spurs 2025 livestream: Watch Europa League for free
Samsung Unpacked live stream: See the Galaxy S25 announcement live
NYT mini crossword answers for January 23, 2025
Reality Distortion Field: 10 Things Apple Won't Directly Say But We'll Infer About the iPhone X
Samsung Galaxy S25 vs. S23: Should you upgrade?
Best Woot deal: Get 10% off your purchase with coupon code SAVETEN
Best Toshiba TV deal: Save $170 on 55
Is it 'Thunderbolts*' or *The New Avengers'?
Samsung Unpacked live stream: See the Galaxy S25 announcement live
Sean 'Diddy' Combs wants to buy the Panthers and sign Colin KaepernickAfter 'The Last Jedi': How Star Wars can solve its Episode IX problemCaliburger lets you order burgers with your face nowAndrew Joyner honors the Women's March with new book 'The Pink Hat'The best iPhone and Android apps of 2017Chelsea Clinton slams Trump in 'Teen Vogue' letter to her kidsCaliburger lets you order burgers with your face nowEverything in Star Wars has a backstory, even Poe Dameron's jewelryThe best iPhone and Android apps of 2017Mindy, Reese, and Oprah crush it in 'Wrinkle in Time' cast photoAndrew Joyner honors the Women's March with new book 'The Pink Hat'Everything we know about Samsung's Galaxy S9 and S9+ based on rumorsFacebook facial recognition updates settings for easy turn offFacebook facial recognition updates settings for easy turn off'The Punisher' boss talks Season 2 plansThese are the worst passwords of 2017Woman expertly trolls text scammer who claimed she won a free laptopApple may be slowing down old iPhones on purpose to save battery lifeAfter 'The Last Jedi': How Star Wars can solve its Episode IX problemSister surprises little brother with Lady Gaga tickets and his reaction is too cute Woman washes vagina with mint and tea tree shower gel, instantly regrets all her life choices Delta sign error hints that the coming tech ban on planes will cover nearly everything Family gets kicked off of a JetBlue flight for a birthday cake NBC shows 2017: Watch trailers for Will & Grace, Law & Order: Menendez Murders Lance Armstrong posts video of Lance Armstrong to prove Lance Armstrong isn't dead Our real dystopian future is in Brave New World and Infinite Jest 'Social influencers' who hyped Fyre Festival could be the next legal target Loyal Harry Styles fan rushes to get concert tickets in a towel Apple Watch adds Mother's Day fitness achievement Teen's terrible drawing of her girlfriend inspires many romantic, unartistic copycats Katy Perry unveils details about new album and upcoming tour Sure, let men experience the hell that is wearing a romper all day Get ready for a possible 'second wave' of that massive global cyberattack Glacier National Park used to have 150 glaciers. There are only 26 left South Korean president's rescue pets are so popular they have their own fan art Delta will let you drop bags at airports by just scanning your face A 'Gilmore Girls' lego set might be coming and my wallet is so ready Stunning drone video shows the evolution of the new Apple Park campus The OnePlus 5 could be the phone that destroys Samsung's Galaxy S8 A thirsty internet descends upon the South Korean president's hot bodyguard
1.7591s , 8224.8515625 kb
Copyright © 2025 Powered by 【Watch Fast Five Online】,Miracle Information Network