28
Technology2h 12m ago

Ahrefs analyzed 137,000 domains and found that 97% of llms.txt files received zero requests, with AI retrieval bots accounting for only 1% of total requests.

web

Who
Ahrefs
What
Ahrefs analyzed 137,000 domains and found that 97% of llms.txt files received zero requests, with AI retrieval bots accounting for only 1% of total requests.
When
Tue, 16 Jun 2026 04:01:02 GMT · 2h 12m ago
Where
web ·
Why
The study aims to understand the adoption and usage patterns of llms.txt files by various bots, including AI retrieval bots, and to align with Google's perspective on these files.
The Frontline Impact

How this affects you

The data suggests that the broader web's adoption of llms.txt files is low, and AI search and retrieval bots rarely request these files, indicating a potential mismatch between industry expectations and actual usage.

Story chain

1 event in this thread
No related history yet - this is the origin event.

Verified Sources & Citations

Credibility ratings reflect the AI ingestion pipeline's assessment of source provenance.