What is Context Window?

Everything an AI uses to produce an answer has to fit in its context window. Larger windows let the model consider longer documents or conversations, but more context isn't always better: irrelevant information can distract the model and increase cost.

Well-designed AI systems choose what goes into the context carefully: the right instructions, the most relevant retrieved information and only the conversation history that matters.