Wiki operators are facing significant operational challenges due to aggressive AI scraping bots that are driving up costs and causing service disruptions. These bots are becoming increasingly sophisticated at mimicking human behavior, making them difficult to block while consuming up to 10x more resources than legitimate human traffic. The issue has become so severe that it accounts for approximately 95% of all server issues in the wiki ecosystem, with some smaller wikis being forced offline entirely.
Background
As AI companies race to gather training data, they're deploying increasingly sophisticated web scrapers that are overwhelming website infrastructure. This has become particularly problematic for wiki platforms, which are rich sources of structured information but weren't designed to handle the scale of modern AI data collection.
- Source
- Lobsters
- Published
- May 21, 2026 at 11:51 AM
- Score
- 7.0 / 10