GEO Course
How RAG, Retrieval and Chunking Affect What AI Cites
By Sanita | Generative Engine Optimization Specialist
How retrieval-augmented generation works, why passages are split into chunks and how to write self-contained, specific sections that AI search can retrieve.
Updated 11 November 2026 · Part of the GEO guide series
Short answer: Retrieval-augmented generation, or RAG, is a common way for AI tools to answer questions with fresh information. The system first retrieves relevant pages or passages, then a language model writes an answer using them. Because retrieval often works on short passages and not on whole pages, the sections of your pages need to make sense on their own: 1 topic per section, the subject named clearly, a specific fact stated plainly and a heading that says what the section covers. The exact methods differ by product and are not published in detail, so treat the points below as a practical model, not a spec.
What RAG Is
A language model learns from a fixed set of training data, so on its own it does not know about pages published after training. RAG adds a lookup step. When a question arrives, a retrieval system finds relevant documents from a search index or a private collection, and the model uses them as context for its answer. The idea was described in a 2020 research paper by Lewis and colleagues, and variations of it are now common in AI search products and in company chatbots.
For site owners, the main consequence is that a page does not need to be part of a model's training data to be used in an answer. It needs to be reachable and indexed by the retrieval source that the product uses, and it needs to be relevant and clear at the moment of the question.
Example: a financial firm publishes an article about this year's Roth IRA contribution limits. A model trained before the article existed does not know it, but a RAG-based tool that retrieves from a live search index can find and use it, if the page is indexed and the retrieval system judges it relevant and trustworthy.
The Retrieval Step, in Outline
- The question is interpreted. The system may rewrite it or split it into several search queries.
- Candidates are found. It searches an index, which might be a web search engine or the product's own index, and gets a set of pages or passages.
- Passages are scored. The system compares passages with the question and keeps the best ones.
- The model writes the answer from the selected passages and may show links to the sources.
How many sources are used, how they are ranked and how they are shown differs by product and by question. Details are not public, and they change.
What Chunking Is
Long pages are usually split into smaller pieces called chunks before they are compared with a question. Systems split text by headings, paragraphs or a fixed length, and the sizes vary a lot. Only the chunks that look relevant are passed to the model, not the whole page.
That has 3 practical consequences:
- A long page is not a long answer. Only the part that matches the question counts.
- If a section mixes several topics, its signal gets blurred, and it matches no single question well.
- If a section depends on earlier text to make sense, it can be unclear when read alone.
You cannot control the chunking method, but you can write in a way that survives most methods.
Semantic and Keyword Matching
Many retrieval systems turn text into numerical representations called embeddings, which capture meaning, so that a passage can match a question even when the words differ. Many also use classic keyword matching, which is useful for exact names, product codes and technical terms. Systems that combine both are sometimes called hybrid retrieval.
The practical lesson is to cover the topic in natural language and use the precise terms your audience uses. A page about drug-drug interactions should use that term, and also explain it in plain words and mention related concepts, so that it can match both exact and loosely worded questions.
Reranking
Some systems apply a second stage that looks more carefully at the best candidates and orders them, using a more detailed model. They may prefer passages that directly answer the question, contain specific facts and read as reliable, and may down-rank text that is vague or promotional. This is not published for most products, but it matches how many retrieval systems are built, so the safest writing habit is to be specific and useful.
Example: asked how long it takes to form an LLC, passage A says, "Forming an LLC typically takes some time depending on the state." Passage B says, "In many US states, an online LLC filing is processed within about 1 to 10 business days, while some states take several weeks; expedited options usually cost extra." Passage B is concrete and answers the question, so it is more likely to be useful, provided that the facts are accurate and sourced.
What Makes a Passage Easy to Retrieve and Quote
- One topic. The passage covers one sub-topic and nothing else.
- A named subject. It says "A Roth IRA..." instead of "It...".
- A specific fact. It includes a number, condition, date or definition that can be checked.
- A heading that matches. The heading says what the section answers.
- Standalone meaning. The passage does not depend on "as mentioned above".
- A clear source. It names where the fact comes from, where relevant.
- Reasonable length. Long enough to be complete, short enough to stay on one point. Many writers find that 1 well-developed paragraph of 50 to 200 words works well, but there is no universal number.
How to Structure a Page for Chunking
- Use an H2 for each major sub-topic and an H3 for parts within it, so natural boundaries line up with topics.
- Start each section with a short direct answer, then add detail.
- Use lists and tables for steps, options and comparisons, written as real HTML, not images.
- Split long blocks that wander across several topics.
- Keep important facts in the main body text, not only in images, PDFs or tabs that load on click.
Chunk-fragile: "This is because the rate at which it compounds determines how quickly the balance grows. The formula depends on whether it is daily, monthly or annual."
Chunk-friendly: "Compound interest grows a balance faster the more often it is compounded. For example, $1,000 at 5% a year grows to about $1,051.16 after 1 year with monthly compounding and $1,050.00 with simple annual interest."
The second version names its subject, includes a checkable example and works when quoted alone. Check the arithmetic and sources for any number you publish.
Metadata and Page Signals
Retrieval systems may also use page-level information, such as the title, headings, publication or update date and structured data, to judge what a page is about and how current it is. It is sensible to:
- write a descriptive title that says what the page covers, such as "How to Choose a Health Insurance Deductible", not "Our Guide";
- show a real update date and keep it honest;
- use structured data that matches the visible content, such as Article, Organization and author details.
Our guide to entity clarity explains how consistent names and details help systems understand who is behind the content.
Make Sure the Page Can Be Retrieved at All
None of the writing advice helps if the page is not reachable. Check that:
- the page is indexed and not blocked by robots.txt, a login or a firewall rule;
- the main content is in the HTML, not only added by JavaScript after the page loads;
- the page loads quickly and works on mobile.
The AI crawler access check shows whether crawlers such as GPTBot, ClaudeBot and PerplexityBot are blocked on your site, and a free SEO audit checks the title, headings, load time and other basics.
How to Test Retrievability
- The paragraph test. Copy a paragraph into a blank document and read it cold. Does it say what it is about, and does it make sense without the rest of the page?
- The question test. Ask an AI tool the question your page answers, and check whether your page is cited. The AI visibility checker shows how assistants rate your site overall, and the AI citation analyzer shows which pages Google's AI Overview cites for a question.
- The comparison test. Read the cited pages. What is clearer, newer or more specific than yours?
Results vary from run to run, so test several times and look at trends.
What Not to Do
- Do not stuff pages with keywords or repeat the same sentence in many sections to "give retrieval more chances". It makes the page worse for readers and can look like spam.
- Do not split useful content into hundreds of thin pages just to create more chunks.
- Do not write fake statistics or made-up quotes to look specific. Specific has to mean true.
- Do not hide important text in places that crawlers cannot read.
Action Checklist
- Pick 1 important page and list the questions it should answer.
- Give each question its own heading and a short direct answer.
- Rewrite paragraphs that begin with "this" or "it" so they name their subject.
- Add 1 specific, sourced fact to each key section.
- Check crawler access and basic SEO with the free tools above.
- Test 5 related questions in AI tools and record the results.
Practice Task
| Paragraph | Names its subject? | Self-contained? | Has a specific fact? | Action |
|---|---|---|---|---|
| Example: paragraph 3 | No (starts with "This") | No | No | Rewrite with the subject and a sourced figure |
| Your paragraph | Fill in | Fill in | Fill in | Fill in |
Related Guides
For technical depth, see the original RAG research paper by Lewis and colleagues (2020).
FAQs
Can a Page Be Used Before It Ranks Well in Search?
It can, if the retrieval source has indexed it and finds it relevant, because some systems retrieve by relevance more than by authority. But authority and trust still help, and a new page with no signals competes against established ones.
Can I Control How My Content Is Chunked?
Not directly. Clear headings, focused paragraphs and self-contained sections create natural boundaries that most methods can use, but each system chooses its own method.
Does the Length of a Page Matter?
Only through the quality of its parts. A long page with many clear, focused sections gives retrieval more to match, while a long page that rambles gives it little. Write as much as the topic needs.
Are Keywords Still Important?
Yes. Meaning-based matching does not remove the value of using the exact terms your audience uses, and many systems also use keyword matching. Use them naturally.
Does RAG Mean I Do Not Need to Be in Training Data?
For tools that search live, yes, a page can appear without being in the training data. For answers that come from training alone, brand and facts must be widely and consistently described, which takes longer to change.
How Do I Know If a Page Is Being Retrieved?
Ask the question in several AI tools and see whether your page is cited, check your analytics for visits from AI domains and use the free checkers above. No tool can show you the full retrieval process of another company's system.