Back to Search Start Over

Cloudflare offers simpler way to stop AI bots.

Authors :
Barker, Paul
Source :
Computerworld (Online Only). 7/4/2024, p1-1. 1p. 2 Color Photographs.
Publication Year :
2024

Abstract

Cloudflare, a content distribution network, has introduced a new feature that allows customers to block AI bots from their websites with one click. This is in response to the rise of badly behaved AI bots that scrape content for their training. Cloudflare's previous method of blocking bots involved adding a "robots.txt" file, but the new feature simplifies the process. The company has identified the top four AI webcrawlers visiting sites protected by Cloudflare, including Bytespider, operated by ByteDance, which visited 40.4% of protected websites. Cloudflare suggests that enterprises hide intellectual property behind a paywall and pursue legal action against unwanted web scraping. [Extracted from the article]

Details

Language :
English
ISSN :
00104841
Database :
Academic Search Index
Journal :
Computerworld (Online Only)
Publication Type :
Periodical
Accession number :
178347968