What is an AI context window?
The maximum amount of text an AI model can process and remember during an interaction.
In brief
- Measured in tokens
- Varies by model
- Size varies by model
Context window is the maximum amount of text an AI model can process and remember during a single conversation or interaction.
Recent models have increasingly large context windows (in the hundreds of thousands of tokens), allowing processing of more information at once.
Frequently asked questions
What takes up the context window?
Everything the model must keep in mind to answer: instructions, conversation history, the question, and the pages or documents retrieved during a search. It is measured in tokens.
How does it relate to GEO?
When an AI searches the web, it often reads only excerpts of the pages it finds so they fit in its context. A page that gives its answer early and clearly is more likely to have the right passage kept.
Does a larger window give better answers?
Not necessarily. It allows more text to be processed at once, but quality also depends on how well the model finds the useful information in a long context.