Live Data

AI Crawler Traffic Index

Live, first-party data — tracking AI crawlers since Jul 16, 2026 (58 days of data)

Every OpenAI, Anthropic, Perplexity, and other AI crawler hit on our blog is logged server-side by user agent, not pulled from a third-party survey. Here's exactly what we see.

AI crawler hits by engine

Data last updated Sep 12, 2026
AI LabSocial MediaE-commerceAI SearchData Aggregator
OpenAIAI Lab
OpenAI — AI Lab: 11,773 hits (36.7%)11,773 · 36.7%
ByteDanceSocial Media
ByteDance — Social Media: 6,695 hits (20.9%)6,695 · 20.9%
AmazonE-commerce
Amazon — E-commerce: 5,285 hits (16.5%)5,285 · 16.5%
AnthropicAI Lab
Anthropic — AI Lab: 4,131 hits (12.9%)4,131 · 12.9%
MetaSocial Media
Meta — Social Media: 2,183 hits (6.8%)2,183 · 6.8%
PerplexityAI Search
Perplexity — AI Search: 1,921 hits (6%)1,921 · 6%
Common CrawlData Aggregator
Common Crawl — Data Aggregator: 107 hits (0.3%)107 · 0.3%
32,095AI crawler hits
91,587Search engine bot hits
123,682Total bot hits tracked

25.9% of all bot traffic tracked is AI crawlers

Referral traffic from AI engines

AI engines crawl us heavily to train on and cite our content — but click-through referral traffic sending real visitors back to the site is still nascent: 26 so far.

By engine

OpenAI · 15Anthropic · 5Microsoft · 3Perplexity · 2Google · 1

Methodology

This index comes from our own server-side bot detection on blog pageviews — user agents matched against known AI crawler signatures, not a third-party panel. An engine needs a small minimum number of hits before it appears as its own bar; low-volume crawlers still count toward the totals above. The cached aggregate refreshes every few hours.

Get the traffic your content earns

AI-filtered residential and mobile proxies across 148+ countries — for scraping, monitoring, and making sure your own content shows up everywhere it should.

Get Started

No credit card required to sign up