SpyderBot Documentation

Find AI referral pages worth improving or expanding

AI referral traffic is reaching your website. Which landing pages deserve investment, and which need a better experience?

Your outcome: a page-level decision grounded in measured human visits and relevant outcomes, with a specific improvement or a reason to wait.

1. Confirm what the traffic data represents

In AI Traffic, review Measurement health and the source used for human referrals. Confirm freshness, coverage, and the primary human analytics source. If GA4 and Script are both connected, do not add their sessions together as independent audiences.

Keep human referral sessions separate from machine requests. A bot accessing a product page does not establish that a prospective buyer visited it.

Check whether the relevant goals or commerce measurements are configured. If not, evaluate the engagement evidence currently available and set up outcome measurement before claiming conversion performance.

2. Start with the page findings and opportunities

Review AI Referrals & Outcomes and the available high-value landing-page or low-engagement findings. Start with a page that matters to a business objective and has evidence you can interpret.

Use relevant platform, page-type, or market breakdowns where available. Compare sessions and outcomes within the same source, period, and scope.

PatternInitial decision
Meaningful visitor activity and supported goal completionProtect the experience; investigate a relevant expansion.
Visitors arrive but often fail to take the intended next stepInspect content fit and conversion friction.
A high apparent rate comes from very little activityTreat it as a lead to investigate, not a proven winning page.
Attribution or collection changes suddenlyInvestigate measurement before page performance.
The page receives visits but has no configured outcomeDefine and instrument the relevant next step.

Use the counts and evidence behind a rate. One completion from one session is not enough to establish a repeatable advantage over a page with substantial traffic.

3. Inspect the page as a visitor destination

Open Page Intelligence and the page itself. Confirm the canonical URL, market, language, and page role. Review the finding and the available engagement or goal evidence.

Then inspect the experience needed for the decision:

  • Does the page answer the task its content promises?
  • Are capability, price conditions, availability, or requirements clear?
  • Is the relevant next step easy to find and complete?
  • Does that step work on the intended device and market?

A recorded referring platform does not reveal the exact user prompt or AI model. Use the landing page and available evidence to form a hypothesis about intent; do not present that hypothesis as an observed conversation.

If technical failure is supported, follow the page-repair playbook. Weak engagement alone is not a reason to run every GEO Audit.

4. Assign one improvement with a clear outcome

Illustrative example. A product integration page receives AI-referred human visits, but few visitors reach its setup guide. The team confirms that goal tracking works and finds that the setup link is buried below unrelated material.

The task is to make the setup path visible where the user evaluates compatibility, while keeping the eligibility conditions clear. The acceptance check verifies the link and tracking. The later outcome check reviews setup-guide visits or the configured goal within the same measurement scope.

Page: the integration landing page.
Evidence: the relevant referral finding and configured goal observations.
Hypothesis: eligible visitors have difficulty finding setup instructions.
Change: clarify the next step near the compatibility information.
Owner: web/content team.
Check: the path works; later comparable human outcomes are reviewed alongside session counts.

For a strong page, expansion might mean improving a related underserved use case with its own evidence. Do not duplicate the page across many topics solely because one URL performs well.

For example, a retailer may see supported human goal completion on its size guide. A useful next investigation is whether a related product range lacks equally clear sizing information. Preserve the working guide and verify the new range's need before commissioning another asset. The favorable pattern identifies a hypothesis to test, not a guarantee that copying the format will reproduce its results.

5. Review without overstating attribution

Record implementation and measurement changes. Review later comparable sessions and outcomes, considering volume and other events that could affect them.

If measurement breaks, fix it before concluding the page lost effectiveness. If traffic remains too sparse, keep the hypothesis open and define a review checkpoint. If the path works but outcomes remain weak, revisit relevance and eligibility rather than repeatedly changing button styling.

Observed AI-referral revenue, when measured, is a business outcome. It does not by itself establish incremental revenue caused by GEO work. Keep the attribution statement as narrow as the data supports.

You are done when the page has a justified improvement, expansion, measurement task, or monitoring decision, with an owner and outcome check.

Next: use Evaluate progress after an improvement to assess the implemented change.