How does AI turn a pile of passages into one answer?
The surviving passages are assembled into a prompt: the model is handed your question plus those passages and instructed to answer using them. This is the ‘generation’ half of retrieval-augmented generation, and the key instruction is grounding, base the answer on the supplied passages rather than on the model’s own memory. A well-grounded, or faithful, answer is one whose claims are supported by the retrieved text.
Crucially, the model doesn’t paste your text back. It writes an original answer that merges and paraphrases across all the passages at once. Google describes its AI answers as combining retrieval and generation to produce an original response rather than copying. So the sentence a user reads is usually a blend: your fact, reworded, sitting alongside facts pulled from two or three other sources.
The model rewrites; it doesn’t quote. Optimizing for one perfect sentence is the wrong goal, because that sentence will be paraphrased. Optimize for being the clearest source of the underlying fact.
Sources & further reading
- Grounding with Google Search, Gemini API docs, AI answers combine retrieval and generation into an original, grounded response.
- Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks (Lewis et al., 2020), The generator conditions its output on the retrieved passages.
