Search Sign in

SpyderBot Documentation

Define Critical Pages & Goals

Critical pages and goals focus AI Traffic on pages and outcomes that matter to the business.

Critical pages

Mark pages that should receive AI discovery or access attention—for example product, category, pricing, documentation, or trust pages. Inventory can come from CMS import, sitemap, or manual entry.

  • Critical Page Coverage compares AI activity on marked pages against the eligible critical set.
  • No observed AI activity on a critical page is a signal to investigate—not proof the page is invisible or blocked.

Goals

Configure primary and secondary goals when you need human-outcome measurement (for example signup, demo request, or purchase-related events).

  • Goals are available after configuration.
  • Do not display conversion conclusions before goal mapping is complete.
  • AI Goal Sessions count AI referral sessions that contain configured goals.