AI Search

How AI Search Results Work: AI Overviews, AI Mode, ChatGPT and Perplexity

How the main AI answer systems find, choose and cite web pages, and which parts you can influence.

AI search products look different on the surface, but they share a pattern: find relevant pages, read them, write an answer, and link to some of the sources. The details matter, because they decide which controls work and what a site owner can actually influence.

This guide explains each step using the platforms’ own documentation, and flags where they behave differently.

Short answer: AI search systems retrieve relevant web pages from an index, use them to generate an answer, and link to some sources. Google’s AI Overviews and AI Mode use Google’s search index and run multiple related searches (query fan-out); pages must be indexed and snippet-eligible. ChatGPT search and Perplexity use their own crawlers (OAI-SearchBot, PerplexityBot). Site owners influence eligibility, clarity and trust, not selection.

Key Takeaways

  • Retrieval comes first: if a system can’t crawl or index your page, it can’t cite it.
  • Google’s AI features use the Google index and query fan-out across subtopics.
  • ChatGPT search and Perplexity rely on their own search crawlers, controlled in robots.txt.
  • Snippet controls (nosnippet, max-snippet, data-nosnippet) limit what Google shows from your pages.
  • Selection of sources is per query and not guaranteed.

The basic pipeline

  1. Crawling and indexing: the platform’s crawler fetches pages it’s allowed to access and stores them.
  2. Understanding the question: the system interprets the query, sometimes breaking it into subquestions.
  3. Retrieval: it searches its index for relevant pages and passages.
  4. Generation: a language model writes an answer grounded in what was retrieved.
  5. Attribution: some sources are shown as links or citations.

Google AI Overviews and AI Mode

Google’s AI features use its normal search infrastructure. Google says AI Overviews appear only when its systems decide they add to classic results; AI Mode is designed for deeper exploration and comparisons. Both use query fan-out: multiple related searches across subtopics and data sources, which Google says lets it show a wider and more diverse set of links.

  • Eligibility: the page must be indexed and eligible to show with a snippet.
  • No special markup, files or optimizations are required, per Google.
  • Controls: nosnippet, data-nosnippet, max-snippet and noindex limit what Google shows.
  • Reporting: included in Search Console’s Performance report under Web.

If you add a snippet control and content still appears, Google suggests checking the control is visible to Googlebot with URL Inspection, then allowing time for recrawling, which can take days to months.

OpenAI uses OAI-SearchBot to surface websites in ChatGPT’s search features. Sites that disallow it won’t appear in ChatGPT search answers, though they may still appear as navigational links. GPTBot is a separate crawler for model training; blocking it doesn’t affect ChatGPT search. ChatGPT-User visits pages when a user asks, and OpenAI notes robots.txt rules may not apply to those user-initiated visits. OpenAI says robots.txt changes for search take about 24 hours.

Perplexity

PerplexityBot crawls to surface and link websites in Perplexity’s results and, according to Perplexity, isn’t used for training foundation models. Perplexity-User fetches pages when a user’s question needs them and generally ignores robots.txt, because the fetch was user-requested.

Why some pages get cited

No platform publishes a full selection formula, so be skeptical of anyone claiming one. What the documentation and the GEO research suggest is consistent with general SEO:

  • The page is accessible to that platform’s crawler and indexed.
  • It answers the specific question or subquestion clearly.
  • The relevant passage makes sense on its own.
  • The information is specific, accurate and supported.
  • The source looks trustworthy for the topic.

See how to make content easier to cite for applying this.

What you can and can’t control

You can controlYou can’t control
Which crawlers can access your siteWhich sources a system picks for a given query
Whether pages are indexable and snippet-eligibleHow an answer is worded
How clearly and accurately you state informationWhether a link is shown for every use
Consistency of your brand factsWhen AI features appear for a query

For crawler rules, see robots.txt mistakes; for the bigger picture, AI SEO vs traditional SEO.

Frequently asked questions

Do AI Overviews use a separate index?

Google’s documentation describes AI Overviews and AI Mode as part of Search and requires pages to be indexed and snippet-eligible.

Does blocking GPTBot remove me from ChatGPT search?

No. OpenAI says ChatGPT search uses OAI-SearchBot; GPTBot is for training.

Can I stop Google using my content in AI Overviews?

Snippet controls such as nosnippet, data-nosnippet and max-snippet limit what Google shows; noindex removes the page from Search entirely. Google-Extended doesn’t affect Search.

Why does Perplexity visit pages I’ve blocked?

Perplexity-User fetches pages when a user asks and, per Perplexity, generally ignores robots.txt. PerplexityBot, its search crawler, follows robots.txt.

Want your content ready for AI search?

We review how your pages, entities and structured data hold up in AI-powered search, and fix the SEO foundations those features rely on.

Sources

Last reviewed October 12, 2026.

Similar Posts

Leave a Reply

Your email address will not be published. Required fields are marked *