From 7ec049e0c7ff9aefe94f26ff1398f21e9e4f9ee3 Mon Sep 17 00:00:00 2001 From: Sydney Runkle Date: Mon, 28 Jul 2025 16:15:56 -0400 Subject: [PATCH] note on window --- docs/docs/agents/context.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/docs/docs/agents/context.md b/docs/docs/agents/context.md index 94bb27616..482f8bc3c 100644 --- a/docs/docs/agents/context.md +++ b/docs/docs/agents/context.md @@ -27,7 +27,10 @@ Runtime context is for immutable data like user metadata, tools, db connections, !!! note "'Context' is an overloaded term" Runtime context refers to local context: data and dependencies your code needs to run. - It does not refer to the LLM context, which is the data passed into the LLM's prompt. + + It does not refer to: + * The LLM context, which is the data passed into the LLM's prompt. + * The "context window", which is the maximum number of tokens that can be passed to the LLM. You likely want to use the local context to optimize the llm's context window. For example, you could use a user_id to fetch a user's name and information from a database to populate the context window with relevant memories.