Research · SEO · AI Search

From Ranked Lists to Evidence Assembly: How Search Changed from 2020 to 2025

After 15 years in organic search — managing sites up to 6 billion URLs, building SEO automation tools, and working across every major CMS — I watched this shift happen from the inside. Here’s what actually changed, what it means, and what most people are getting wrong.
By Hana Omori  |  March 2026  |  12 min read
Google's dual-purpose technical SEO standards — user benefits vs operational reality for Google's infrastructure

Search didn’t die. It evolved from ranking documents to assembling evidence.

The Biggest Shift in 20 Years

Between 2020 and 2025, search underwent its most fundamental transformation since Google introduced PageRank. The change wasn’t a single event. It was a sequence of compounding shifts that moved search from ranking documents to assembling evidence for answers.

Most coverage of this shift focuses on one piece — AI Overviews, or ChatGPT, or “SEO is dead” panic. But the real story is structural. And understanding it requires recognizing something most AI search commentary misses entirely: Google didn’t just rank the web. Google built the web.

I’ve spent 15 years doing organic search across Shopify, WordPress, Magento, Drupal, Joomla, Wix, Adobe Experience Manager, .NET, and proprietary platforms. I’ve managed technical SEO for sites scaling past 6 billion indexed URLs. I’ve configured nginx and Apache for crawl optimization, built programmatic SEO automation tools, and worked in every CMS environment that matters. This analysis comes from that practitioner perspective — not from reading about search, but from doing it at scale.

Google Didn’t Just Rank the Web. Google Built It.

Before we talk about AI search, we need to talk about something the AI search conversation almost always skips: Google shaped the physical and technical structure of the internet itself.

Every major “technical SEO” standard Google pushed over the past 15 years served a dual purpose. The public framing was user benefit. The operational reality was that it also made the web easier, faster, and cheaper for Google to crawl, index, and understand. And because ranking depended on compliance, the entire web rebuilt itself to Google’s specifications.

Google StandardPublic FramingOperational Reality
Page Speed / Core Web VitalsBetter user experience, faster load timesFaster, lighter pages = cheaper to crawl at scale. Fewer resources per page means Google can index more of the web for less.
Mobile-First IndexingMost users are on mobile devicesA single canonical version (mobile) instead of maintaining parallel desktop/mobile indexes. Simplifies Google’s crawl and index infrastructure.
HTTPS EverywhereUser security and privacyEncrypted connections protect Googlebot’s crawl data in transit. Also makes the web more trustworthy as a data source for AI training.
Structured Data / SchemaRich results and better SERP featuresMachine-readable metadata means Google doesn’t have to guess what content means. Sites literally label their data for Google’s parsers.
Helpful Content SystemReward content “written by people, for people”Filter out low-signal pages before they reach the index. Reduces noise in the retrieval layer that AI Overviews now depend on.
Passage Indexing (2020)Better answers from long-form contentGoogle can now extract and rank individual fragments, not just whole pages. This is the direct precursor to AI answer assembly.
The pattern is clear: Every technical SEO “best practice” Google promoted made the web simultaneously better for users AND better for Google’s infrastructure. That wasn’t a coincidence. It was strategy. And it worked — the entire web restructured itself around Google’s needs.

This matters for the AI search conversation because every AI system that crawls the web today is crawling a Google-engineered web. The pages are fast because Google demanded speed. They’re mobile-friendly because Google switched to mobile-first indexing. They’re structured because Google rewarded schema markup. They’re HTTPS because Google made it a ranking signal.

Google didn’t just rank content. It shaped what content looked like, how it was built, and what infrastructure it sat on. That’s the foundation every AI search system inherits — whether they acknowledge it or not.

What AI Search Fragments

Here’s the tension: those technical standards were enforced by a single decision-maker (Google) through a single incentive (rankings). Now, with ChatGPT, Claude, Perplexity, and Gemini each using different retrieval systems and different selection logic, the web no longer has one optimization target.

The standards Google established still matter — fast, structured, mobile-friendly, secure pages are universally better for any retrieval system. But the ranking incentives are now split across multiple players with different architectures, different trust models, and different criteria for what gets cited. That fragmentation is the real disruption — not AI answers themselves, but the loss of a single coherent optimization target that the entire web had aligned to for two decades.

Query fan-out process illustrates how a user query breaks down into multiple sub-queries for AI answer assembly

AI search doesn’t match one query to one page. It decomposes your question into sub-queries and retrieves from multiple sources simultaneously.

Query Fan-Out: The Architecture Most People Underestimate

Google’s documentation now confirms that both AI Overviews and AI Mode use query fan-out — issuing multiple related searches across subtopics and data sources, then identifying supporting pages during response generation.

This is the single most important mechanical change in modern search. Here’s what it means in practice:

Example: “Best supplements for brain fog caused by stress”

Instead of retrieving pages that match this exact query, AI Mode likely decomposes it into hidden sub-queries:

  1. Causes of brain fog from stress
  2. Supplements proven for cognitive clarity
  3. Adaptogens and cortisol research
  4. Safety profiles of common supplements
  5. Comparison of options

Each sub-query retrieves different pages. The LLM merges results into one synthesized answer and selects sources that support the narrative.

The implication is profound: you are no longer competing for one keyword. You are competing across an invisible query graph. Sites that cover an entire topic cluster — definitions, comparisons, edge cases, FAQs — have far more entry points into the answer than sites optimized for a single head term.

User Query Decompose (Fan-Out) Retrieve (Multi-Source) Filter & Validate Synthesize Answer Attach Citations
Visual breakdown of query fan-out showing sub-queries, multiple sources retrieved per sub-query, and final synthesis into a composite answer

You’re no longer competing for one keyword. You’re competing across an invisible query graph.

How Five AI Search Systems Actually Work

All major AI search systems converge on the same basic architecture: LLM + retrieval + source selection + answer composition + citations. But they differ in where the center of gravity sits.

SystemCore ModelRetrieval SourceKey MechanismCenter of Gravity
Google AIO / AI ModeGemini 2.5Google IndexQuery fan-out + synthesisSearch-native
ChatGPT SearchGPT-4o (fine-tuned)3rd-party + partnersIterative search + reasoningModel-first
ClaudeClaude 3.xBrave Search / externalDynamic filtering + code executionFilter-first
PerplexityMulti-model (Sonar)Proprietary indexMulti-query retrieval + citationsRetrieval-first
Gemini API (Grounding)GeminiGoogle SearchGrounded responses with citationsSearch-integrated

What This Means for Content Creators

Google/Gemini is search-native: trust is inherited from Google’s ranking systems, spam detection, and E-E-A-T signals. The AI selects from a pre-trusted pool. Trust first, then generate.

ChatGPT Search is model-first: the model decides when to search, may reformulate queries, and can override raw ranking based on reasoning coherence. Reason first, then trust.

Claude has the most explicit post-retrieval filtering layer. It can programmatically discard sources via logic and code execution. Filter first, then compose.

Perplexity is the most overtly search-native answer engine: a ranked index plus extraction plus synthesis. Classic retrieval features like domain authority, freshness, and extractable passages matter most here.

AI search systems compared across the shared pipeline: retrieve, filter, reason, synthesize, cite — showing where each platform concentrates its weight

Same pipeline, different priorities. Each AI search system weights a different stage of the retrieve → synthesize → cite process.

Structural Dependency: Why “They All Use Google” Is Wrong (and Right)

A common misconception is that all AI systems “use Google.” They don’t — not technically. ChatGPT uses third-party search providers (likely Bing). Claude uses Brave Search. Perplexity maintains its own index. None of them query google.com directly (except Gemini).

But as we established earlier, they all retrieve from a web that Google engineered. The pages are fast, mobile-friendly, structured, and HTTPS — because Google made those the conditions for ranking. The content is organized around topics and intent — because Google’s Helpful Content system punished everything else. The metadata is machine-readable — because Google rewarded schema markup.

The dependency is structural, not technical. AI systems don’t call Google. They call search providers that index a Google-shaped web. The training data was Google-influenced. The content standards are Google-enforced. The web itself is a Google artifact.

This creates a critical distinction: being #1 on Google does not guarantee you appear in AI answers. Google ranks pages. AI systems select evidence. Those are different operations. A page can rank #15 on Google but be extremely clear and quotable — and the AI may prefer it over the #1 result.

That gap — between Google ranking and AI selection — is where the new competitive advantage lives. And it’s why practitioners who understand both traditional technical SEO and AI retrieval logic have an edge that pure SEO strategists or pure AI enthusiasts don’t.

The Six Signals AI Uses to Select Sources

If AI doesn’t just follow Google rankings, how does it choose what to include in answers? Across GPT, Claude, Gemini, and Perplexity, the selection pipeline looks roughly like this:

Retrieve Candidates Score Relevance Extract Passages Evaluate Trust Assemble Answer Select Citations

Google ranking mostly affects step one. Everything after that is AI-specific selection logic. Six signal groups appear to drive that selection:

1. Semantic Relevance

Not keyword matching. The AI asks: “Does this directly answer the intent of the question?” It rewards direct explanation over symptom-listing. “Stress increases cortisol, which impairs cognitive clarity” beats “brain fog after stress symptoms include…”

2. Extractability

This is massive and under-discussed. AI favors content that is clearly structured, logically chunked, and easy to quote. Definitions, bullet points, short paragraphs, and clear claims win. Long storytelling, vague intros, and SEO padding lose.

3. Answer Density

AI prefers pages where signal outweighs noise. High ratio of useful information, minimal filler. “Brain fog from stress is primarily caused by elevated cortisol disrupting hippocampal function” gets pulled into answers. “In today’s fast-paced world, many people experience…” does not.

4. Internal Consistency

AI checks whether a page contradicts itself and whether its claims align with other sources. Pages that make unusual claims, are internally inconsistent, or disagree with broad consensus get downweighted or ignored.

5. Cross-Source Agreement

AI systems compare sources. If multiple sources converge on similar claims, those ideas get promoted into the answer. Unique claims from a single source may be ignored unless the source is exceptionally authoritative. This creates a consensus amplification effect.

6. Authority (Redefined)

Authority still matters — but not as backlink count. It’s more like: “Is this source reliable and consistent with others?” Signals likely include known brands, consistent topic coverage, and factual stability across pages.

AI source selection funnel showing six signals evaluation process that narrows candidates from hundreds to a handful of cited sources

AI doesn’t follow Google rankings. It runs every candidate through six evaluation layers before selecting what to cite.

The Hidden Super-Signal: Quotability

Across all six signals, one meta-pattern emerges. AI systems are essentially asking:

“Can I safely copy this into an answer?”

Content that wins: clear claims, standalone sentences, factual statements with specific data. Content that loses: vague language, opinionated fluff, hedging without substance.

AI-FriendlyAI-Unfriendly
“Magnesium glycinate is commonly used to reduce stress-related brain fog due to its role in nervous system regulation.”“Some people have found that certain supplements might help with stress.”
“AI Overviews reduced CTR for position-one results by approximately 34.5% in Ahrefs’ 2024 study.”“Many experts believe AI search is changing how people find information online.”

This is the cleanest mental model for the entire shift: Google ranks pages. AI extracts sentences.

The Human vs. Machine Paradox

There’s an uncomfortable tension here. AI selection logic (extractability, answer density, quotability) can feel “anti-human.” Google historically rewarded “human-first” content. Are these in conflict?

Not exactly.

Google’s “human-first” never actually meant “write rambling, conversational fluff.” It meant: satisfy the user quickly and clearly. Over time, the SEO industry distorted “human-first” into long intros, conversational filler, and engagement-optimized padding. AI Overviews didn’t change what Google wanted — they exposed it.

The real shift isn’t anti-human. It’s anti-friction.

What AI kills: unnecessary buildup, vague language, buried answers. What AI rewards: clarity, precision, usefulness. These were always the qualities Google valued — AI search just made them non-negotiable.

Storytelling still matters for engagement, retention, branding, and differentiation. But it’s no longer the retrieval layer. The winning structure is layered:

  1. Direct answer — AI-retrievable (the extractable layer)
  2. Structured explanation — serves both AI and human readers
  3. Expanded narrative — human-only value (story, context, experience)

The Traffic Question: Who Was Right?

The 2024 belief split — Google saying “better discovery” vs. SEOs saying “traffic collapse” — deserves a clear answer.

Both were partly right. They were measuring different things.

~34.5%
CTR drop for #1 with AIO (Ahrefs)
56% → 69%
Zero-click rise May 2024–2025 (Similarweb)
6.49% → 24.61%
AIO keyword coverage Jan–Jul 2025 (Semrush)
-2.5%
Overall organic traffic change (Graphite/Similarweb)

The synthesis: AIO reduces clicks on simple informational queries that can be answered in-SERP. AIO may increase click quality on complex queries when users do click. AIO broadens the set of domains that can be cited while shrinking the payoff of being the single blue-link winner.

The old distribution model was winner-takes-most. The new model is fractional exposure across 5–10 sources. That’s why Google says “more diverse clicks” and SEOs say “less traffic.” The total click pool barely changed. The distribution did.

Google’s Silent Intent Segmentation

Google is no longer treating search as one query producing one type of result. It’s moving toward predicting which mode the user needs before they express it:

User IntentSearch ExperienceAIO Behavior
Quick factual answerAI OverviewTriggers — high confidence
Structured understandingAI Overview / AI ModeTriggers — synthesis
Deep comparisonAI ModeTriggers with fan-out
Subjective / experientialTraditional web resultsSuppressed — low confidence
YMYL without consensusTraditional web resultsSuppressed — risk

Google isn’t pivoting to “only concise instructional content.” It’s pivoting to “serve concise answers when confidence is high.” That distinction matters enormously. The web results layer still exists for depth, nuance, and experience. AI is the front door. The web is the deeper exploration layer.

How People Actually Search Now: A Behavior Model

The most underrated signal in this entire shift isn’t algorithmic. It’s behavioral. I noticed it in my own workflow first — after years of using Google as my primary research tool, I caught myself reaching for AI systems for an entirely different class of question. When I mapped out why, the pattern was clear. People are already splitting their information-seeking across multiple systems without being told to.

The Modern Knowledge Loop

Feeds (LinkedIn, YouTube, newsletters) → passive signal absorption

AI (ChatGPT, Claude) → synthesis, exploration, model-building

Search (Google) → verification, retrieval of known material

AI again → decision support for complex purchases or architecture questions

Marketplace (Amazon, etc.) → targeted execution

The key behavioral insight: people only Google things they already know exist. For exploration, synthesis, and undefined questions, they go to AI first. Google has become the verification layer, not the thinking layer. AI has become the thinking layer, not just the answering layer.

This has direct implications for content strategy. If you only optimize for Google, you’re optimizing for the verification step. You’re missing the earlier stage where people form their understanding — which increasingly happens in AI interfaces, not search results pages.

What This Means Strategically

The old SEO playbook was: rank for keyword, optimize page, build backlinks. The new playbook requires a fundamentally different approach:

1. Become Extractable

Clear, structured answers. Direct statements. No fluff. Front-load the answer in the first 1–2 sentences of every section.

2. Win Sub-Queries

Cover definitions, comparisons, edge cases, and FAQs. Each section of your content is a potential entry point into the query fan-out graph.

3. Be Quotable

AI pulls concise claims, statistics, and definitions — not long narratives. Write “claim sentences” that are strong, factual, and standalone.

4. Build Topical Authority Clusters

Not single pages. Entire knowledge graphs of interlinked content. The more sub-queries your site can answer, the more surface area you have in the retrieval graph.

5. Optimize for Trust Signals

Citations, clarity, factual consistency across pages. Cross-source agreement amplifies your content. Align with established consensus — and when you have original data, present it clearly with methodology.

6. Layer Your Content

Direct answer (AI layer) → structured explanation (AI + human) → expanded narrative (human-only value). Serve both extraction and engagement in the same piece.

The Core Insight

The deepest change from 2020 to 2025 is this: Google and the major AI search players moved from document ranking to task completion using document evidence.

Google’s own language around AI Overviews and AI Mode — especially query fan-out and “supporting links gathered during response generation” — makes this explicit. OpenAI, Anthropic, and Perplexity all show the same broad architecture in different forms: retrieve, filter, reason, synthesize, cite.

The old belief was: “Win the SERP.”
The 2025 belief is: “Win the hidden retrieval graph behind the answer.”

Content is no longer consumed in one way. AI consumes structure. Humans consume meaning. The winners will be practitioners who can serve both — in layers, with clarity, at scale.