Kubernetes Deployment

Deploy DeerFlow on Kubernetes for production-grade isolation and scalability. The provisioner service dynamically creates sandbox pods for each execution context.

Architecture

┌────────────┐  HTTP  ┌─────────────┐  K8s API  ┌──────────────┐
│  Backend   │ ─────▸ │ Provisioner │ ────────▸ │  K8s API     │
│ (Gateway/  │        │   :8002     │           │  Server      │
│ LangGraph) │        └─────────────┘           └──────┬───────┘
└────────────┘                                          │ creates
                                                        │
                          ┌─────────────┐         ┌────▼─────┐
                          │   Backend   │ ──────▸ │  Sandbox │
                          │   (via      │ NodePort│  Pod(s)  │
                          │   network)  │         └──────────┘
                          └─────────────┘

How It Works

Backend requests sandbox: POST /api/sandboxes with sandbox_id and thread_id
Provisioner creates Pod: Deploys sandbox container with mounted volumes
Service created: NodePort service exposes pod on dynamic port
Backend accesses sandbox: Direct HTTP access via http://NODE_HOST:{NodePort}
Cleanup: DELETE /api/sandboxes/{sandbox_id} removes pod and service

Prerequisites

Kubernetes Cluster

You need a running Kubernetes cluster. Supported options:

Docker Desktop with Kubernetes enabled
OrbStack (macOS) with built-in K8s
minikube for local development
kind for local development
k3s for lightweight production
Cloud providers: EKS, GKE, AKS

Enable Kubernetes in Docker Desktop

Open Docker Desktop settings
Go to “Kubernetes” tab
Check “Enable Kubernetes”
Click “Apply & Restart”
Wait for Kubernetes to start (green indicator)

Enable Kubernetes in OrbStack

Open OrbStack settings
Go to “Kubernetes” tab
Check “Enable Kubernetes”

Verify Cluster

# Check cluster status
kubectl cluster-info

# Verify nodes
kubectl get nodes

# Check current context
kubectl config current-context

Configuration

1. Configure Sandbox Mode

Edit config.yaml to enable provisioner mode:

sandbox:
  use: src.community.aio_sandbox:AioSandboxProvider
  provisioner_url: http://provisioner:8002

2. Set Environment Variables

Edit docker/docker-compose-dev.yaml to configure provisioner:

provisioner:
  environment:
    # Kubernetes namespace for sandbox resources
    - K8S_NAMESPACE=deer-flow
    
    # Sandbox container image
    - SANDBOX_IMAGE=enterprise-public-cn-beijing.cr.volces.com/vefaas-public/all-in-one-sandbox:latest
    
    # Host paths (must be absolute paths on your machine)
    - SKILLS_HOST_PATH=${DEER_FLOW_ROOT}/skills
    - THREADS_HOST_PATH=${DEER_FLOW_ROOT}/backend/.deer-flow/threads
    
    # Path to kubeconfig inside container
    - KUBECONFIG_PATH=/root/.kube/config
    
    # Host that backend uses to reach NodePort services
    - NODE_HOST=host.docker.internal
    
    # Override K8s API server URL (if needed)
    - K8S_API_SERVER=https://host.docker.internal:6443

3. Set Host Paths

Important: SKILLS_HOST_PATH and THREADS_HOST_PATH must be absolute paths on your host machine:

# Set environment variable before starting
export DEER_FLOW_ROOT=$(pwd)

# Or hardcode in docker-compose-dev.yaml:
# SKILLS_HOST_PATH=/Users/yourname/deer-flow/skills
# THREADS_HOST_PATH=/Users/yourname/deer-flow/backend/.deer-flow/threads

Provisioner Service

Docker Compose Configuration

The provisioner service is defined in docker/docker-compose-dev.yaml:

provisioner:
  profiles:
    - provisioner
  build:
    context: ./provisioner
    dockerfile: Dockerfile
  container_name: deer-flow-provisioner
  volumes:
    - ~/.kube/config:/root/.kube/config:ro
  environment:
    - K8S_NAMESPACE=deer-flow
    - SANDBOX_IMAGE=enterprise-public-cn-beijing.cr.volces.com/vefaas-public/all-in-one-sandbox:latest
    - SKILLS_HOST_PATH=${DEER_FLOW_ROOT}/skills
    - THREADS_HOST_PATH=${DEER_FLOW_ROOT}/backend/.deer-flow/threads
    - KUBECONFIG_PATH=/root/.kube/config
    - NODE_HOST=host.docker.internal
    - K8S_API_SERVER=https://host.docker.internal:6443
  extra_hosts:
    - "host.docker.internal:host-gateway"
  networks:
    - deer-flow-dev
  restart: unless-stopped
  healthcheck:
    test: ["CMD", "curl", "-f", "http://localhost:8002/health"]
    interval: 10s
    timeout: 5s
    retries: 6
    start_period: 15s

Provisioner Dockerfile

From docker/provisioner/Dockerfile:

FROM python:3.12-slim

# Install system dependencies
RUN apt-get update && apt-get install -y --no-install-recommends \
    curl \
    && rm -rf /var/lib/apt/lists/*

# Install Python dependencies
RUN pip install --no-cache-dir \
    fastapi \
    "uvicorn[standard]" \
    kubernetes

WORKDIR /app
COPY app.py .

EXPOSE 8002

CMD ["uvicorn", "app:app", "--host", "0.0.0.0", "--port", "8002"]

Deployment

Start with Provisioner

# Start all services including provisioner
make docker-start

# The script automatically detects provisioner mode from config.yaml
# and starts provisioner only when needed

Verify Provisioner

# Check provisioner health
curl http://localhost:8002/health

# Expected output:
# {"status":"ok"}

# Check provisioner logs
docker logs deer-flow-provisioner

Verify Namespace

# Check if namespace was created
kubectl get namespace deer-flow

# Expected output:
# NAME        STATUS   AGE
# deer-flow   Active   1m

Sandbox Pod Configuration

Pod Specification

Each sandbox runs as a Kubernetes Pod with:

spec:
  containers:
    - name: sandbox
      image: enterprise-public-cn-beijing.cr.volces.com/vefaas-public/all-in-one-sandbox:latest
      imagePullPolicy: IfNotPresent
      ports:
        - name: http
          containerPort: 8080
          protocol: TCP
      
      # Resource limits
      resources:
        requests:
          cpu: 100m
          memory: 256Mi
          ephemeral-storage: 500Mi
        limits:
          cpu: 1000m
          memory: 1Gi
          ephemeral-storage: 500Mi
      
      # Volume mounts
      volumeMounts:
        - name: skills
          mountPath: /mnt/skills
          readOnly: true
        - name: user-data
          mountPath: /mnt/user-data
          readOnly: false
      
      # Health checks
      readinessProbe:
        httpGet:
          path: /v1/sandbox
          port: 8080
        initialDelaySeconds: 5
        periodSeconds: 5
      
      livenessProbe:
        httpGet:
          path: /v1/sandbox
          port: 8080
        initialDelaySeconds: 10
        periodSeconds: 10
  
  # Volumes (HostPath)
  volumes:
    - name: skills
      hostPath:
        path: /absolute/path/to/skills
        type: Directory
    - name: user-data
      hostPath:
        path: /absolute/path/to/threads/{thread_id}/user-data
        type: DirectoryOrCreate

Service Specification

Each sandbox gets a NodePort service:

spec:
  type: NodePort
  selector:
    sandbox-id: abc-123
  ports:
    - name: http
      port: 8080
      targetPort: 8080
      protocol: TCP
      # nodePort: auto-allocated by Kubernetes (30000-32767)

API Reference

Health Check

GET /health

Response:

{
  "status": "ok"
}

Create Sandbox

POST /api/sandboxes
Content-Type: application/json

{
  "sandbox_id": "abc-123",
  "thread_id": "thread-456"
}

Response:

{
  "sandbox_id": "abc-123",
  "sandbox_url": "http://host.docker.internal:32123",
  "status": "Pending"
}

Status Values:

Pending - Pod is being created
Running - Pod is ready
Succeeded - Pod completed successfully
Failed - Pod failed to start
Unknown - Status cannot be determined

Get Sandbox Status

GET /api/sandboxes/{sandbox_id}

Response:

{
  "sandbox_id": "abc-123",
  "sandbox_url": "http://host.docker.internal:32123",
  "status": "Running"
}

List Sandboxes

GET /api/sandboxes

Response:

{
  "sandboxes": [
    {
      "sandbox_id": "abc-123",
      "sandbox_url": "http://host.docker.internal:32123",
      "status": "Running"
    }
  ],
  "count": 1
}

Delete Sandbox

DELETE /api/sandboxes/{sandbox_id}

Response:

{
  "ok": true,
  "sandbox_id": "abc-123"
}

Testing

Manual Testing

# 1. Create a sandbox
curl -X POST http://localhost:8002/api/sandboxes \
  -H "Content-Type: application/json" \
  -d '{"sandbox_id":"test-001","thread_id":"thread-001"}'

# 2. Check sandbox status
curl http://localhost:8002/api/sandboxes/test-001

# 3. Verify pod and service
kubectl get pod,svc -n deer-flow -l sandbox-id=test-001

# 4. Check pod logs
kubectl logs -n deer-flow sandbox-test-001

# 5. Access sandbox from backend
SANDBOX_URL=$(curl -s http://localhost:8002/api/sandboxes/test-001 | jq -r .sandbox_url)
docker exec deer-flow-gateway curl -s $SANDBOX_URL/v1/sandbox

# 6. Delete sandbox
curl -X DELETE http://localhost:8002/api/sandboxes/test-001

Integration Testing

Test through the DeerFlow application:

Open http://localhost:2026
Create a new thread
Send a message that requires code execution (e.g., “Create a Python script”)
Monitor pod creation:
```
watch kubectl get pods -n deer-flow
```

Check sandbox logs:

kubectl logs -n deer-flow -l app=deer-flow-sandbox --follow

Troubleshooting

Kubeconfig Not Found

Symptom: Kubeconfig not found at /root/.kube/config Solution:

# Verify kubeconfig exists
ls -la ~/.kube/config

# Check volume mount in docker-compose
# Should be: ~/.kube/config:/root/.kube/config:ro

# Verify inside container
docker exec deer-flow-provisioner ls -la /root/.kube/config

Connection Refused to K8s API

Symptom: Connection refused when connecting to Kubernetes API Solution:

Check kubeconfig server address:

kubectl config view --minify -o jsonpath='{.clusters[0].cluster.server}'

If it’s localhost or 127.0.0.1, set K8S_API_SERVER:

environment:
  - K8S_API_SERVER=https://host.docker.internal:6443

For Docker Desktop, the port is usually 6443
For k3s/OrbStack, check the actual port

Invalid HostPath

Symptom: Unprocessable Entity when creating pod Solution:

Use absolute paths only:

# Good
SKILLS_HOST_PATH=/Users/yourname/deer-flow/skills

# Bad
SKILLS_HOST_PATH=../skills
SKILLS_HOST_PATH=~/deer-flow/skills

Verify paths exist:

ls -la /Users/yourname/deer-flow/skills
ls -la /Users/yourname/deer-flow/backend/.deer-flow/threads

Pod Stuck in ContainerCreating

Symptom: Pod stays in ContainerCreating state Diagnosis:

kubectl describe pod -n deer-flow sandbox-XXX

Common causes:

Pulling sandbox image (wait or pre-pull with make docker-init)
HostPath volume not accessible
Insufficient resources on node

Solution:

# Pre-pull image
make docker-init

# Check node resources
kubectl top nodes

# Check events
kubectl get events -n deer-flow --sort-by='.lastTimestamp'

Cannot Access Sandbox URL

Symptom: Backend cannot reach http://host.docker.internal:{NodePort} Solution:

Verify service exists:
```
kubectl get svc -n deer-flow
```

Test from host:

curl http://localhost:NODE_PORT/v1/sandbox

Check extra_hosts in docker-compose (Linux only):

extra_hosts:
  - "host.docker.internal:host-gateway"

Verify NODE_HOST environment variable

Production Considerations

Resource Limits

Adjust pod resource limits based on workload:

# In provisioner app.py, modify _build_pod()
resources=k8s_client.V1ResourceRequirements(
    requests={
        "cpu": "500m",      # Increase for CPU-heavy tasks
        "memory": "512Mi",  # Increase for memory-heavy tasks
        "ephemeral-storage": "1Gi",
    },
    limits={
        "cpu": "2000m",
        "memory": "2Gi",
        "ephemeral-storage": "2Gi",
    },
)

Persistent Storage

For production, consider using PersistentVolumes instead of HostPath:

volumes:
  - name: user-data
    persistentVolumeClaim:
      claimName: sandbox-pvc-${sandbox_id}

Network Policies

Restrict sandbox network access:

apiVersion: networking.k8s.io/v1
kind: NetworkPolicy
metadata:
  name: sandbox-network-policy
  namespace: deer-flow
spec:
  podSelector:
    matchLabels:
      app: deer-flow-sandbox
  policyTypes:
    - Ingress
    - Egress
  ingress:
    - from:
      - podSelector:
          matchLabels:
            app: deer-flow-backend
  egress:
    - to:
      - namespaceSelector: {}

Automatic Cleanup

Implement TTL for stale sandboxes:

# Add to provisioner app.py
from datetime import datetime, timedelta

@app.on_event("startup")
async def cleanup_old_sandboxes():
    # Run every hour
    while True:
        await asyncio.sleep(3600)
        await cleanup_stale_sandboxes(max_age=timedelta(hours=2))

Monitoring

Integrate with Prometheus:

apiVersion: v1
kind: Service
metadata:
  name: provisioner-metrics
  namespace: deer-flow
  annotations:
    prometheus.io/scrape: "true"
    prometheus.io/port: "8002"
    prometheus.io/path: "/metrics"
spec:
  selector:
    app: deer-flow-provisioner
  ports:
    - port: 8002

Overview

Core Concepts

Configuration

Guides

Deployment

​Architecture

​How It Works

​Prerequisites

​Kubernetes Cluster

​Enable Kubernetes in Docker Desktop

​Enable Kubernetes in OrbStack

​Verify Cluster

​Configuration

​1. Configure Sandbox Mode

​2. Set Environment Variables

​3. Set Host Paths

​Provisioner Service

​Docker Compose Configuration

​Provisioner Dockerfile

​Deployment

​Start with Provisioner

​Verify Provisioner

​Verify Namespace

​Sandbox Pod Configuration

​Pod Specification

​Service Specification

​API Reference

​Health Check

​Create Sandbox

​Get Sandbox Status

​List Sandboxes

​Delete Sandbox

​Testing

​Manual Testing

​Integration Testing

​Troubleshooting

​Kubeconfig Not Found

​Connection Refused to K8s API

​Invalid HostPath

​Pod Stuck in ContainerCreating

​Cannot Access Sandbox URL

​Production Considerations

​Resource Limits

​Persistent Storage

​Network Policies

​Automatic Cleanup

​Monitoring

​Next Steps

Production Deployment

Docker Deployment

​See Also

Build docs developers (and LLMs) love

Architecture

How It Works

Prerequisites

Kubernetes Cluster

Enable Kubernetes in Docker Desktop

Enable Kubernetes in OrbStack

Verify Cluster

Configuration

1. Configure Sandbox Mode

2. Set Environment Variables

3. Set Host Paths

Provisioner Service

Docker Compose Configuration

Provisioner Dockerfile

Deployment

Start with Provisioner

Verify Provisioner

Verify Namespace

Sandbox Pod Configuration

Pod Specification

Service Specification

API Reference

Health Check

Create Sandbox

Get Sandbox Status

List Sandboxes

Delete Sandbox

Testing

Manual Testing

Integration Testing

Troubleshooting

Kubeconfig Not Found

Connection Refused to K8s API

Invalid HostPath

Pod Stuck in ContainerCreating

Cannot Access Sandbox URL

Production Considerations

Resource Limits

Persistent Storage

Network Policies

Automatic Cleanup

Monitoring

Next Steps

See Also