Commit Graph
6716 Commits
Author SHA1 Message Date
Nuno Campos c00e8c2b46 Fix 2024-09-11 12:17:56 -07:00
Vadym BardaandGitHub ee28fd3324 docs: update how-tos to support pydantic v1 and v2 (#1682) 2024-09-11 19:16:00 +00:00
Nuno Campos 710b4179da Add ci job 2024-09-11 12:14:06 -07:00
Nuno Campos f577529356 Add benchmark/profile commands 2024-09-11 11:44:18 -07:00
David DuongandGitHub 0fa10d67f5 Merge pull request #1681 from langchain-ai/dqbd/sdk-js-0.0.9
fix(sdk-js): bump to 0.0.9
2024-09-11 19:44:57 +02:00
Tat Dat Duong a60a4606fb fix(sdk-js): bump to 0.0.9 2024-09-11 19:41:51 +02:00
Vadym BardaandGitHub 229765c4a5 ci: update link check (#1680) 2024-09-11 13:16:55 -04:00
gbaian10andGitHub bf6ad19963 refactor: Type narrowing for ToolNode.name (#1678)
Avoid type incompatibility when using `add_node` to add a `ToolNode`.
2024-09-11 13:11:39 -04:00
Vadym BardaandGitHub 4c59a5e249 ci: ignore link check for storm tutorial (#1679) 2024-09-11 13:08:46 -04:00
Vadym BardaandGitHub 1f9273b136 docs: put documentation in the docs folder instead of examples (#1674) 2024-09-11 12:27:31 -04:00
Vadym BardaandGitHub f3b5d804ab ci: fix kafka scheduler, split langgraph and kafka into separate test jobs (#1677) 2024-09-11 10:55:11 -04:00
Nuno Campos 26f23ea26c Add benchmark script 2024-09-10 17:32:47 -07:00
Nuno CamposandGitHub e3ca7bb3e9 Merge pull request #1630 from langchain-ai/nc/5sep/scheduler-kafka
Implement LangGraph Scheduler for Kafka
2024-09-10 17:31:58 -07:00
Nuno Campos 34d530d5d8 Fix 2024-09-10 17:24:24 -07:00
Nuno Campos 2b09c284d4 Remove empty build job 2024-09-10 17:22:48 -07:00
Nuno Campos 77083bf634 Disable test jobs for now 2024-09-10 17:22:06 -07:00
Nuno Campos 5de46f7472 Update stop condition for drain 2024-09-10 16:52:09 -07:00
vbarda bb10acbe28 update cache keys 2024-09-10 19:51:23 -04:00
Nuno Campos bdabb723b0 Add langgraph dep 2024-09-10 16:39:34 -07:00
Nuno Campos edc0fd0210 Remove extraneous asserts 2024-09-10 16:20:45 -07:00
Nuno Campos 3886b76771 Lint 2024-09-10 16:17:22 -07:00
Nuno Campos 3a65460767 Use anyio for timeout in dran test helper 2024-09-10 16:17:22 -07:00
Nuno Campos 5e0273886e Lint 2024-09-10 16:17:22 -07:00
Nuno Campos 943cc4d83a Add readme, lint 2024-09-10 16:17:22 -07:00
Nuno Campos fed6499a2e Run ci for kafka lib 2024-09-10 16:17:22 -07:00
Nuno Campos 270559b880 Implement changes in sqlite checkpointer 2024-09-10 16:17:22 -07:00
Nuno Campos 98b8595a94 Move to dev deps 2024-09-10 16:17:22 -07:00
Nuno Campos f7dffa023c Implement subgraph delegation for distributed arch 2024-09-10 16:17:22 -07:00
Nuno Campos 7dc69a543d Rename 2024-09-10 16:17:22 -07:00
Nuno Campos 8f91402642 Use thread_id for partition key, ignore tasks for stale checkpoints 2024-09-10 16:17:22 -07:00
Nuno Campos 030d6d2def Fix subgraph test 2024-09-10 16:17:22 -07:00
Nuno Campos ad7dd0dbb7 Add drain_topics test helper 2024-09-10 16:17:22 -07:00
Nuno Campos 0eb11a3cf9 Remove is_resuming arg 2024-09-10 16:17:22 -07:00
Nuno Campos 1ce8d628f2 In update state skip nodes not found in instance
eg, because removed since
2024-09-10 16:17:22 -07:00
Nuno Campos 5e6b58f847 Remove double shield usage
- we already shield from cancellation in PregelLoop so shouldnt be repeating in AsyncBackgroundExecutor
2024-09-10 16:17:22 -07:00
Nuno Campos b13db42568 WIP Subgraphs 2024-09-10 16:17:22 -07:00
Nuno Campos 83d36761a4 Rename compose projects 2024-09-10 16:17:22 -07:00
Nuno Campos d206621230 Rename test 2024-09-10 16:17:22 -07:00
Nuno Campos 8e6caab78c Add test for interrupts 2024-09-10 16:17:22 -07:00
Nuno Campos ad463ec90a Add more test assertions 2024-09-10 16:17:22 -07:00
Nuno Campos 2d02e5e0c5 Add error topic, add retries (eg for checkpointer database exceptions) 2024-09-10 16:17:22 -07:00
Nuno Campos 5b3bd920d8 Catch errors thrown by nodes run by Executor 2024-09-10 16:17:22 -07:00
Nuno Campos f09b130837 Use pool for postgres checkpointer 2024-09-10 16:17:22 -07:00
Nuno Campos e6d6f565a5 Improvements to consumer and producer patterns
- await future returned by send() instead of flush()
- use consumer groups by default
- process tasks in batches by default, configurable
- manually commit offsets when batch is processed
2024-09-10 16:17:22 -07:00
Nuno Campos dc5be3fd58 Rename 2024-09-10 16:17:22 -07:00
Nuno Campos 381ea9cec8 Rename 2024-09-10 16:17:22 -07:00
Nuno Campos 841aabf5b3 Implement LangGraph Scheduler for Kafka
- Orchestrator and Executor classes to run LangGraph in a distributed fashion using Kafka as a message bus for communication
- Orchestrator and Executor run on-demand when a new message is published to the topic they listen to
- Orchestrator is responsible for running the Pregel algorithm (deciding next tasks to run) and sending messages to the executor topic
- Executor is responsible for executing each task (node), and sending messages to the orchestrator topic when done
2024-09-10 16:17:22 -07:00
Vadym BardaandGitHub 5d4b276af2 ci: remove preview step (#1675) 2024-09-10 18:25:13 +00:00
jessicaouandGitHub acd8325402 adding langchain academy link (#1643) 2024-09-10 12:04:19 -04:00
Vadym BardaandGitHub ed0f55af85 docs: clean up how-to docs to make them runnable (#1666) 2024-09-10 01:56:51 +00:00