WEBDIENSTE/langgraph
1
0
Fork 0
mirror of https://github.com/langchain-ai/langgraph.git synced 2026-08-17 21:25:46 +02:00
Code Issues Packages Projects Releases Wiki Activity

note on window

Browse Source
This commit is contained in:
Sydney Runkle
2025-07-28 16:15:56 -04:00
parent 1923ff8d85
commit 7ec049e0c7
1 changed files with 4 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
docs/docs/agents/context.md
+4 -1
View File
@@ -27,7 +27,10 @@ Runtime context is for immutable data like user metadata, tools, db connections,
!!! note "'Context' is an overloaded term"
Runtime context refers to local context: data and dependencies your code needs to run.
It does not refer to the LLM context, which is the data passed into the LLM's prompt.
It does not refer to:
* The LLM context, which is the data passed into the LLM's prompt.
* The "context window", which is the maximum number of tokens that can be passed to the LLM.
You likely want to use the local context to optimize the llm's context window. For example, you
could use a user_id to fetch a user's name and information from a database to populate the context window with relevant memories.