From 07cd4d83e1215d9cff6f9ccce9ac63fed3f6df7e Mon Sep 17 00:00:00 2001 From: Andrew Nguonly Date: Thu, 3 Jul 2025 16:04:27 -0700 Subject: [PATCH] docs: Add note about preemptive compute infra (#5339) * Add note about preemtive compute infra. * Fix spelling error. --- docs/docs/concepts/langgraph_control_plane.md | 33 +++++++++++++++---- 1 file changed, 26 insertions(+), 7 deletions(-) diff --git a/docs/docs/concepts/langgraph_control_plane.md b/docs/docs/concepts/langgraph_control_plane.md index f3562516c..ebc880ce5 100644 --- a/docs/docs/concepts/langgraph_control_plane.md +++ b/docs/docs/concepts/langgraph_control_plane.md @@ -46,21 +46,40 @@ For simplicity, the control plane offers two deployment types with different res | **Deployment Type** | **CPU/Memory** | **Scaling** | **Database** | |---------------------|-----------------|---------------------|----------------------------------------------------------------------------------| -| Development | 1 CPU, 1 GB RAM | Up to 1 container | 10 GB disk, no backups | -| Production | 2 CPU, 2 GB RAM | Up to 10 containers | Autoscaling disk, automatic backups, highly available (multi-zone configuration) | +| Development | 1 CPU, 1 GB RAM | Up to 1 replica | 10 GB disk, no backups | +| Production | 2 CPU, 2 GB RAM | Up to 10 replicas | Autoscaling disk, automatic backups, highly available (multi-zone configuration) | -CPU and memory resources are per container. +CPU and memory resources are per replica. !!! warning "Immutable Deployment Type" Once a deployment is created, the deployment type cannot be changed. -!!! info "Resource Customization" - For `Production` type deployments, resources can be manually increased on a case-by-case basis depending on use case and capacity constraints. Contact support@langchain.dev to request an increase in resources. +!!! info "Self-Hosted Deployment" + Resources for [Self-Hosted Data Plane](../concepts/langgraph_self_hosted_data_plane.md) and [Self-Hosted Control Plane](../concepts/langgraph_self_hosted_control_plane.md) deployments can be fully customized. Deployment types are only applicable for [Cloud SaaS](../concepts/langgraph_cloud.md) deployments. - For `Development` types deployments, database disk size can be manually increased on a case-by-case basis depending on use case and capacity constraints. For most use cases, [TTLs](../how-tos/ttl/configure_ttl.md) should be configured to manage disk usage. Contact support@langchain.dev to request an increase in resources. +#### Production - Resources for [Self-Hosted Data Plane](../concepts/langgraph_self_hosted_data_plane.md) and [Self-Hosted Control Plane](../concepts/langgraph_self_hosted_control_plane.md) deployments can be fully customized. +`Production` type deployments are suitable for "production" workloads. For example, select `Production` for customer-facing applications in the critical path. + +Resources for `Production` type deployments can be manually increased on a case-by-case basis depending on use case and capacity constraints. Contact support@langchain.dev to request an increase in resources. + +#### Development + +`Development` type deployments are suitable development and testing. For example, select `Development` for internal testing environments. `Development` type deployments are not suitable for "production" workloads. + +!!! danger "Preemptible Compute Infrastructure" + `Development` type deployments (API server, queue server, and database) are provisioned on preemptible compute infrastructure. This means the compute infrastructure **may be terminated at any time without notice**. This may result in intermittent... + + - Redis connection timeouts/errors + - Postgres connection timeouts/errors + - Failed or retrying background runs + + This behavior is expected. Preemptible compute infrastructure **significantly reduces the cost to provision a `Development` type deployment**. By design, LangGraph Server is fault-tolerant. The implementation will automatically attempt to recover from Redis/Postgres connection errors and retry failed background runs. + + `Production` type deployments are provisioned on durable compute infrastructure, not preemptible compute infrastructure. + +Database disk size for `Development` type deployments can be manually increased on a case-by-case basis depending on use case and capacity constraints. For most use cases, [TTLs](../how-tos/ttl/configure_ttl.md) should be configured to manage disk usage. Contact support@langchain.dev to request an increase in resources. ### Database Provisioning