The Linux kernel mailing list administrator reports that AI scrapers generate enough traffic to tie up 14 CPU cores across their infrastructure, spending more cycles rendering commits for scrapers than all legitimate access combined. The irony is that LLMs could simply clone the git repos but instead crawl HTML pages, creating unnecessary load on kernel.org.
Background
kernel.org serves as the central hosting platform for Linux kernel development, including git repositories and the LKML discussion archives. The rise of AI data scraping has become a growing concern for open-source infrastructure maintainers worldwide.
- Source
- Lobsters
- Published
- Aug 30, 2026 at 12:25 AM
- Score
- 7.0 / 10