langgraph/docs/docs/cloud/deployment/self_hosted_control_plane.md

How to Deploy Self-Hosted Control Plane (Beta)

Before deploying, review the conceptual guide for the Self-Hosted Control Plane deployment option.

Prerequisites

1. You are using Kubernetes.

2. You have self-hosted LangSmith deployed.

3. Use the LangGraph CLI to test your application locally.

4. Use the LangGraph CLI to build a Docker image (i.e. langgraph build) and push it to a registry your Kubernetes cluster has access to.

5. KEDA is installed on your cluster.

     helm repo add kedacore https://kedacore.github.io/charts 
     helm install keda kedacore/keda --namespace keda --create-namespace
   

6. Ingress Configuration (recommended)

   1. Install Ingress Nginx to serve as a reverse proxy for your deployment.

       helm repo add ingress-nginx https://kubernetes.github.io/ingress-nginx
       helm repo update
       helm install ingress-nginx ingress-nginx/ingress-nginx
      

   2. Provision a root domain that will suffix all domains for your workloads (e.g. us.langgraph.app).

   3. Provision wildcard certificates to terminate TLS for your deployments.

   4. Note: If this step is skipped, you will need to provision domains/certs for each of your deployments.

7. You have slack space in your cluster for multiple deployments. Cluster-Autoscaler is recommended to automatically provision new nodes.

Setup

1. As part of configuring your Self-Hosted LangSmith instance, you enable the langgraphPlatform option. This will provision a few key resources.

   1. listener: This is a service that listens to the control plane for changes to your deployments and creates/updates downstream CRDs.
   2. LangGraphPlatform CRD: A CRD for LangGraph Platform deployments. This contains the spec for managing an instance of a LangGraph platform deployment.
   3. operator: This operator handles changes to your LangGraph Platform CRDs.
   4. host-backend: This is the control plane.

2. Two additional images will be used by the chart.

    hostBackendImage:
      repository: "docker.io/langchain/hosted-langserve-backend"
      pullPolicy: IfNotPresent
      tag: "0.9.80"
    operatorImage:
      repository: "docker.io/langchain/langgraph-operator"
      pullPolicy: IfNotPresent
      tag: "aa9dff4"
   

3. In your values.yaml file, enable the langgraphPlatform option.

    config:
      langgraphPlatform:
        enabled: true
        langgraphPlatformLicenseKey: "YOUR_LANGGRAPH_PLATFORM_LICENSE_KEY"
        rootDomain: "YOUR_ROOT_DOMAIN"
   

4. You can also configure base templates for your agents by overriding the base templates here.

5. You create a deployment from the Control Plane UI.