Several companies are currently grappling with the issue of scrapers attempting to harvest their text, marking the latest battleground in a growing conflict between websites that host textual content and AI firms eager to use it for training their algorithms.

The surge in artificial intelligence development has spurred a demand for large amounts of text, essential for training advanced AI models like ChatGPT.

This demand has driven some companies to scrape text from websites without permission, prompting objections from website owners who argue that this practice not only violates their data rights but also degrades internet performance.

Elon Musk has highlighted concerns about X (formerly Twitter), suggesting it receives significant traffic from such scraping activities, the Independent has reported.

To combat this, many sites have implemented strict “rate limiting” measures to curb excessive bot access, though critics claim these measures sometimes mask underlying issues with site functionality.

Written by B.C. Begley