Sourced guide
How AI answer engines find and choose the businesses they cite
A plain-language summary, from each company's own documentation, of how Google AI Overviews and AI Mode, ChatGPT search, Perplexity, Claude, Microsoft Copilot and Apple's Siri and Spotlight find web pages to use as sources.
Most AI answers are built from live search results
The AI tools people use to ask for recommendations mostly look things up on the web when they answer, and then show links to the pages they used. That means the first step is the same as in ordinary search: a page has to be crawlable, indexed and useful before any AI tool can cite it.
Google says there are no additional requirements or special optimizations needed to appear in AI Overviews or AI Mode. To be eligible as a supporting link, a page must be indexed and eligible to be shown in Google Search with a snippet, and Google adds that meeting the requirements does not guarantee that a page will be crawled, indexed or shown.
Each AI company uses its own search crawler
OpenAI uses a crawler called OAI-SearchBot for ChatGPT search, separate from GPTBot, which relates to model training. A site can allow OAI-SearchBot to appear in search results while disallowing GPTBot.
Perplexity says PerplexityBot is designed to surface and link websites in its search results and is not used to crawl content for AI foundation models, and it recommends allowing PerplexityBot in robots.txt.
Anthropic says Claude-SearchBot indexes content to improve Claude's search results, and that blocking it may reduce a site's visibility and accuracy in those results.
Microsoft says that when web search is on, Copilot sends a short query to Bing and uses the results to ground its answer, with a Sources button showing what it used. Being findable in Bing therefore matters for Copilot.
Apple says Applebot powers search features in Spotlight, Siri and Safari, and that allowing Applebot lets content appear in those results.
What this means in practice
There is no secret file or single trick that makes an AI tool recommend a business. The documented basics are: let the search crawlers in, keep pages indexable, state facts clearly and consistently, and keep important information current.
Microsoft's own Bing guidance now mentions generative engine optimization by name and says it does not guarantee citations, just as SEO does not guarantee rankings. Any provider, including us, should be judged on whether these basics are done well, not on promises of placement.
Illustration only, not a client result: a homeowner asks an AI assistant for a remodeler near them. The assistant runs a web search, reads the pages it finds, and lists a few businesses with links. A business whose pages are blocked to that assistant's crawler, or whose name, phone and services differ from page to page, gives the assistant less to work with.
Sources (checked Nov 18, 2026)
- Google Search Central: AI features and your website
- OpenAI: Overview of OpenAI crawlers
- Perplexity: Perplexity crawlers
- Anthropic: Does Anthropic crawl data from the web, and how can site owners block the crawler?
- Microsoft: How web search works in Microsoft Copilot Chat and agents
- Apple: About Applebot
- Search Engine Journal: Bing adds GEO to official guidelines