Context Window
Context Window is the maximum amount of text an LLM can process in a single request, measured in tokens. It determines how much of a document the model can read before having to truncate or summarize.
Definition
Modern LLMs have context windows ranging from 4,000 tokens to over 200,000 tokens. A larger context window allows the model to consider longer documents, more conversation history, or multiple source documents simultaneously when generating answers. Earlier models had much smaller windows, forcing aggressive summarization of source material.
When an AI search engine uses your website to answer a query, the context window limits how much content it can process from you at once. If your product page is longer than the available context, the engine may only read the first section, potentially missing important information or citations that appear later in the document.
Why it matters for AI visibility
A larger context window means AI search engines can process your full content when answering queries. Your brand's visibility improves if your key claims appear early or fit within the engine's context budget. As context windows grow, so does the opportunity for deeper, more nuanced citations of your expertise.
Related terms
Tokens
Tokens are the smallest units of text that LLMs process, roughly equivalent to words or word fragments. Most LLMs process input and output as sequences of tokens rather than whole words.
AILarge Language Model (LLM)
Large Language Models are neural networks trained on massive text datasets to predict and generate human language. They form the foundation of modern AI search and answer engines.
AIEmbeddings
Embeddings are numerical representations of text, converting words, phrases, or documents into lists of numbers that capture their meaning. AI search engines use embeddings to find relevant sources for answers.
AIRetrieval-Augmented Generation (RAG)
RAG is the technique of retrieving relevant documents at answer time, then using them to ground an LLM's response. It enables AI search engines to cite sources while generating answers.