mirror of
https://github.com/langchain-ai/langgraph.git
synced 2026-08-17 21:25:46 +02:00
Apply suggestions from code review
Co-authored-by: Lauren Hirata Singh <lauren@langchain.dev>
This commit is contained in:
co-authored by
Lauren Hirata Singh
parent
3af857922a
commit
14949c81c8
@@ -24,14 +24,14 @@ Runtime context is for immutable data like user metadata, tools, db connections,
|
||||
|
||||
The `Runtime` object is recommended to access static context and runtime-specific information like the store and stream writer.
|
||||
|
||||
!!! note "'Context' is an overloaded term"
|
||||
!!! note
|
||||
|
||||
Runtime context refers to local context: data and dependencies your code needs to run. It does not refer to:
|
||||
|
||||
* The LLM context, which is the data passed into the LLM's prompt.
|
||||
* The "context window", which is the maximum number of tokens that can be passed to the LLM.
|
||||
|
||||
You likely want to use the local context to optimize the llm's context window. For example, you
|
||||
You likely want to use the local context to optimize the LLM's context window. For example, you
|
||||
could use a user_id to fetch a user's name and information from a database to populate the context window with relevant memories.
|
||||
|
||||
Specify static context via the `context` argument to `invoke` / `stream`, which is reserved for this purpose:
|
||||
|
||||
Reference in New Issue
Block a user