Search Sign in

SpyderBot Documentation

Cloudflare for AI Traffic

Cloudflare is used when request-level infrastructure evidence is required and the supported connection is available.

What Cloudflare may provide

  • Observed requests and requested URLs
  • Response or access outcomes
  • Bot or network identity signals
  • Policy or block context
  • Source freshness and coverage information

Cloudflare request evidence does not prove content understanding, citation, recommendation, training use, or human referral outcomes.

Setup checklist

  1. Confirm the website uses a supported Cloudflare configuration for the workspace.
  2. Connect Cloudflare with the applicable account permissions.
  3. Verify Measurement Health shows connected and receiving for bot/request signals.
  4. Compare a known request or block outcome against the AI & Bot Activity view.