Live Data

AI Crawler Traffic Index

Live, first-party data — tracking AI crawlers since Jul 16, 2026 (96 days of data)

Every OpenAI, Anthropic, Perplexity, and other AI crawler hit on our blog is logged server-side by user agent, not pulled from a third-party survey. Here's exactly what we see.

AI crawler hits by engine

Data last updated Oct 20, 2026
AI LabSocial MediaAI SearchE-commerceData Aggregator
OpenAIAI Lab
OpenAI — AI Lab: 16,104 hits (29.9%)16,104 · 29.9%
ByteDanceSocial Media
ByteDance — Social Media: 13,177 hits (24.5%)13,177 · 24.5%
PerplexityAI Search
Perplexity — AI Search: 8,434 hits (15.7%)8,434 · 15.7%
AmazonE-commerce
Amazon — E-commerce: 7,018 hits (13.1%)7,018 · 13.1%
AnthropicAI Lab
Anthropic — AI Lab: 5,528 hits (10.3%)5,528 · 10.3%
MetaSocial Media
Meta — Social Media: 3,072 hits (5.7%)3,072 · 5.7%
Common CrawlData Aggregator
Common Crawl — Data Aggregator: 444 hits (0.8%)444 · 0.8%
53,777AI crawler hits
187,301Search engine bot hits
241,078Total bot hits tracked

22.3% of all bot traffic tracked is AI crawlers

Referral traffic from AI engines

AI engines crawl us heavily to train on and cite our content — but click-through referral traffic sending real visitors back to the site is still nascent: 36 so far.

By engine

OpenAI · 17Anthropic · 9Perplexity · 6Microsoft · 3Google · 1

Methodology

This index comes from our own server-side bot detection on blog pageviews — user agents matched against known AI crawler signatures, not a third-party panel. An engine needs a small minimum number of hits before it appears as its own bar; low-volume crawlers still count toward the totals above. The cached aggregate refreshes every few hours.

Get the traffic your content earns

AI-filtered residential and mobile proxies across 195+ countries — for scraping, monitoring, and making sure your own content shows up everywhere it should.

Get Started

No credit card required to sign up