SpyderBot Documentation

Benchmark Observatories

A Benchmark Observatory is still a Prompt Observatory, with an additional AI Visibility Benchmark profile and four headline metrics.

A Benchmark Observatory is still a Prompt Observatory.

It uses the same underlying continuous-intelligence architecture, with an additional AI Visibility Benchmark profile.

Benchmark Observatory keeps:

Overview
Prompts
Changes
Sources
Evidence

and adds Benchmark-specific intelligence inside that architecture.


Benchmark Overview

Benchmark intelligence includes exactly four headline metrics:

Discovery Visibility
Controlled AI Sentiment
Competitive Capture
Visibility Gap

Primary longitudinal charts include:

AI Visibility Over Time
Visibility Gap Over Time
AI Sentiment Over Time
Sentiment Mix Over Time

Use actual eligible observation dates.


Benchmark composition

Benchmark Core/Supplemental composition is managed in Prompt Universe.

Do not edit Benchmark Core membership from the Observatory Prompts view.


Benchmark version boundaries

When Benchmark scope changes materially, SpyderBot should preserve historical meaning rather than silently rewriting prior history.

A version boundary can affect Comparability.


Next step

If you need to change scope safely, read Change measurement scope safely.


Common interpretation rules

Use these rules across Prompt Intelligence:

0% can be a valid observed value.
Missing is not 0%.
Unknown is not Neutral.
Not Applicable is not poor performance.
Not Observed is not Brand absence.
No AI Answer is not Brand absence.
Not Comparable is not No Change.
A citation is not proof of causality.
A higher Prompt Priority does not increase an observed outcome.
More raw executions do not automatically mean stronger evidence.

Getting help from the Evidence

When a finding matters to a business decision:

  1. Confirm the Measurement Scope.
  2. Check Applicability.
  3. Check Evidence Strength.
  4. Check AI-system coverage.
  5. Check Comparability for temporal claims.
  6. Open Evidence.
  7. Review exact responses/citations/observations.
  8. Then decide whether action is justified.

This sequence is especially important for competitor recommendation changes, sentiment/portrayal changes, source ecosystem changes, Benchmark gap movement, and cross-system disagreement.

SpyderBot observes AI outputs and supporting evidence. It does not have access to the private internal reasoning of third-party AI systems. Prompt Intelligence distinguishes observed outcome, observed association, measured contributor, evidence-supported driver, and causal explanation. A citation appearing alongside a recommendation does not by itself prove that the citation caused the recommendation.

Measurement Scope describes what a result represents. Applicability answers whether a metric makes sense for this measurement scope. Comparability answers whether observation periods can be compared normally. Evidence Strength indicates how strongly eligible observations support a finding. Keep these meanings separate from Prompt Priority and Monitoring Health.