Bot Traffic

See which AI bots read your website

DidYouSEO's bot traffic tracker shows every visit from ChatGPT, Claude, Perplexity, Googlebot, and ~30 other crawlers - which pages they read, when, and whether they're who they claim to be. Google Analytics can't see any of this, because bots don't run JavaScript.

Your analytics has a blind spot

AI tools now read websites before users ever click. When someone asks ChatGPT about your product, it fetches your pages to answer. When Perplexity cites a competitor instead of you, that decision was made by a crawler you never saw. Browser-based analytics misses all of it - these visitors never execute the tracking script.

DidYouSEO tracks bots server-side with a tiny snippet (or our npm package), classifies each visitor, and shows you a plain-English report. Human visitors are never stored.

What you'll see

AI answers

ChatGPT reading your pricing page to answer a user's question about you - proof that real people are asking AI about your product.

AI search & indexing

PerplexityBot, OAI-SearchBot, Googlebot, and Bingbot building the indexes that decide whether you get cited and ranked.

AI training crawlers

GPTBot, ClaudeBot, Bytespider, and CCBot collecting public pages for model training - the data that teaches future AI models your brand exists.

Plus search indexing, SEO tools (Ahrefs, Semrush), and link-preview fetchers - six categories in total, each explained in the dashboard.

Two things most trackers miss

Impostor detection

Anyone can claim to be Googlebot. We verify Google, Bing, and Apple crawler IPs via reverse DNS and flag the fakes - so you know whether that "Googlebot" spike was indexing or a scraper.

Missing-page signals

When crawlers repeatedly request a page that 404s - like /docs or /free-trial - something out there expects that page to exist. That's free content strategy: we highlight those requests in red.

Frequently asked questions

What is bot traffic?+

Bot traffic is every automated visitor to your website: search engines indexing pages, AI assistants reading content to answer user questions, AI companies collecting training data, SEO tools building databases, and link-preview fetchers. On many sites, bots now read more pages than humans do.

Why doesn't Google Analytics show AI bots?+

Bots request your pages' raw HTML but don't run JavaScript, and browser-based analytics tools only count visitors who execute their tracking script. Server-side tracking is the only way to see them - which is how DidYouSEO's bot traffic feature works.

Which AI bots visit websites?+

The most active are OpenAI's GPTBot and ChatGPT-User, Anthropic's ClaudeBot, PerplexityBot, Google-Extended and Googlebot, Bingbot, ByteDance's Bytespider, Apple's Applebot, and Common Crawl's CCBot. DidYouSEO recognizes ~30 crawlers across six categories and keeps the list updated server-side.

Should I block AI crawlers from my site?+

It depends on your goal. Blocking search crawlers (Googlebot, Bingbot) hurts rankings - almost never do that. Blocking AI training bots (GPTBot, ClaudeBot) keeps your content out of future models but also means AI assistants may know less about your brand when users ask. Seeing who actually visits, and what they read, is the first step to deciding.

How do I know a bot is really Googlebot and not a scraper?+

Anyone can fake a user-agent string. DidYouSEO verifies Google, Bing, and Apple crawler IPs with reverse-DNS lookups against the companies' official ranges, and flags visits that claim a famous bot name from an unverified IP.

Find out who's reading your site

Included on every plan. Free accounts see the last 3 days of bot visits; paid plans keep full history. Setup takes about five minutes.

Related: llms.txt and AI visibility · all features · setup guide