Live Data

AI Crawler Traffic Index

Live, first-party data — tracking AI crawlers since Jul 16, 2026 (51 days of data)

Every OpenAI, Anthropic, Perplexity, and other AI crawler hit on our blog is logged server-side by user agent, not pulled from a third-party survey. Here's exactly what we see.

AI crawler hits by engine

Data last updated Sep 5, 2026
AI LabSocial MediaE-commerceAI Search
OpenAIAI Lab
OpenAI — AI Lab: 11,155 hits (39.8%)11,155 · 39.8%
ByteDanceSocial Media
ByteDance — Social Media: 5,858 hits (20.9%)5,858 · 20.9%
AmazonE-commerce
Amazon — E-commerce: 4,528 hits (16.2%)4,528 · 16.2%
AnthropicAI Lab
Anthropic — AI Lab: 3,124 hits (11.1%)3,124 · 11.1%
MetaSocial Media
Meta — Social Media: 2,182 hits (7.8%)2,182 · 7.8%
PerplexityAI Search
Perplexity — AI Search: 1,177 hits (4.2%)1,177 · 4.2%
28,024AI crawler hits
81,159Search engine bot hits
109,183Total bot hits tracked

25.7% of all bot traffic tracked is AI crawlers

Referral traffic from AI engines

AI engines crawl us heavily to train on and cite our content — but click-through referral traffic sending real visitors back to the site is still nascent: 22 so far.

By engine

OpenAI · 11Anthropic · 5Microsoft · 3Perplexity · 2Google · 1

Methodology

This index comes from our own server-side bot detection on blog pageviews — user agents matched against known AI crawler signatures, not a third-party panel. An engine needs a small minimum number of hits before it appears as its own bar; low-volume crawlers still count toward the totals above. The cached aggregate refreshes every few hours.

Get the traffic your content earns

AI-filtered residential and mobile proxies across 148+ countries — for scraping, monitoring, and making sure your own content shows up everywhere it should.

Get Started

No credit card required to sign up