SpyderBot Documentation
Benchmark Observatories
A Benchmark Observatory is still a Prompt Observatory, with an additional AI Visibility Benchmark profile and four headline metrics.
A Benchmark Observatory is still a Prompt Observatory.
It uses the same underlying continuous-intelligence architecture, with an additional AI Visibility Benchmark profile.
Benchmark Observatory keeps:
Overview Prompts Changes Sources Evidence
and adds Benchmark-specific intelligence inside that architecture.
Benchmark Overview
Benchmark intelligence includes exactly four headline metrics:
Discovery Visibility Controlled AI Sentiment Competitive Capture Visibility Gap
Primary longitudinal charts include:
AI Visibility Over Time Visibility Gap Over Time AI Sentiment Over Time Sentiment Mix Over Time
Use actual eligible observation dates.
Benchmark composition
Benchmark Core/Supplemental composition is managed in Prompt Universe.
Do not edit Benchmark Core membership from the Observatory Prompts view.
Benchmark version boundaries
When Benchmark scope changes materially, SpyderBot should preserve historical meaning rather than silently rewriting prior history.
A version boundary can affect Comparability.
Next step
If you need to change scope safely, read Change measurement scope safely.
Common interpretation rules
Use these rules across Prompt Intelligence:
0% can be a valid observed value. Missing is not 0%. Unknown is not Neutral. Not Applicable is not poor performance. Not Observed is not Brand absence. No AI Answer is not Brand absence. Not Comparable is not No Change. A citation is not proof of causality. A higher Prompt Priority does not increase an observed outcome. More raw executions do not automatically mean stronger evidence.
Getting help from the Evidence
When a finding matters to a business decision:
- Confirm the Measurement Scope.
- Check Applicability.
- Check Evidence Strength.
- Check AI-system coverage.
- Check Comparability for temporal claims.
- Open Evidence.
- Review exact responses/citations/observations.
- Then decide whether action is justified.
This sequence is especially important for competitor recommendation changes, sentiment/portrayal changes, source ecosystem changes, Benchmark gap movement, and cross-system disagreement.
SpyderBot observes AI outputs and supporting evidence. It does not have access to the private internal reasoning of third-party AI systems. Prompt Intelligence distinguishes observed outcome, observed association, measured contributor, evidence-supported driver, and causal explanation. A citation appearing alongside a recommendation does not by itself prove that the citation caused the recommendation.
Measurement Scope describes what a result represents. Applicability answers whether a metric makes sense for this measurement scope. Comparability answers whether observation periods can be compared normally. Evidence Strength indicates how strongly eligible observations support a finding. Keep these meanings separate from Prompt Priority and Monitoring Health.