SearchChampSearchChamp
Feature ReferenceAI Visibility

Crawler logs

When AI bots actually visited your site — and whether the visit was genuine.

Citations tell you what AI engines said. Crawler logs tell you what they fetched. Track when GPTBot, ClaudeBot, PerplexityBot, GoogleExtended and others visit your pages.

The Crawler logs tab with bot visit counts and verification

Setting it up

Setup Tracking walks you through installing the tracker. Once it's in, a green Capture working banner confirms a self-test reached it and that real bot visits will now be recorded.

What you get

  • AI Bot Visits — visit counts per bot over 7, 30, or 90 days. How much history you keep depends on your plan.
  • Breakdown by crawler — visits grouped by what each bot is doing, with unclassified bots listed separately.
  • Crawled vs. cited — two lists that are the whole point of the tab:
    • Crawled but never cited — the bots read these pages and never used them.
    • Cited but never crawled — the engine cited you without fetching the page, usually from its training data or a third-party source.

Verified, spoofed, unverifiable

Every visit is checked against the bot's published address ranges and labelled Verified, Spoofed, or Unverifiable. Anyone can set a user-agent string to GPTBot; only the real one comes from OpenAI's network. Treat spoofed traffic as what it is — someone else's scraper wearing a costume.

Fan-Out

The sub-queries an AI engine generates before it answers your prompt.

Alerts

Notable changes in your AI visibility, worth a look.

On this page

Setting it upWhat you getVerified, spoofed, unverifiableRelated articles