Deploy DeepSeek R2 + Ollama on Kubernetes: Local AI Stack
Tags:
DeepSeekkuberneteskubekanvasLLMAI
Created by:
Siddiqui
13 uses
Running a local LLM requires a model server, persistent weight storage, and a browser interface behind an ingress. This template deploys DeepSeek R2 via Ollama with Open WebUI on Kubernetes, producing an offline-capable AI stack accessible at a local domain.
| Component | Type | Port | Role |
|---|---|---|---|
| Namespace | Namespace | - | Isolates all resources under deepseek |
| ollama-ds-pv | PersistentVolume | - | 30 GB hostPath volume for model weights |
| ollama-ds-pvc | PersistentVolumeClaim | - | Binds Ollama to model storage |
| webui-ds-pv | PersistentVolume | - | 5 GB hostPath volume for WebUI data |
| webui-ds-pvc | PersistentVolumeClaim | - | Binds WebUI to its data storage |
| ollama-ds-config | ConfigMap | - | Ollama runtime env vars |
| webui-ds-config | ConfigMap | - | Open WebUI env vars |
| ollama | Deployment | 11434 | Ollama inference server running DeepSeek R2 |
| ollama-ds-service | Service (NodePort) | 11434 / 30112 | Exposes Ollama internally and via NodePort |
| open-webui | Deployment | 8080 | Browser chat interface |
| open-webui-service | Service (NodePort) | 8080 / 30081 | Exposes WebUI internally and via NodePort |
| nginx | IngressClass | - | Declares NGINX as default ingress class |
| deepseek-ingress | Ingress | 80 | Routes deepseek.local to WebUI, ollama-ds.local to API |
| open-webui-hpa | HorizontalPodAutoscaler | - | Scales WebUI on CPU or memory pressure |
| deepseek-quota | ResourceQuota | - | Caps CPU, memory, and pod count in namespace |
| deepseek-limits | LimitRange | - | Sets per-container resource defaults and ceilings |
| ollama-network-policy | NetworkPolicy | 11434 | Restricts Ollama to WebUI pods and ingress controller |
Ollama runs as a single replica with a 30 GB PersistentVolume for model weights. An init container pulls DeepSeek R2 on first boot using the Ollama CLI directly. Open WebUI reaches Ollama via internal ClusterIP DNS. NGINX Ingress routes deepseek.local to the WebUI and ollama-ds.local to the raw API, with buffering off for token streaming. A NetworkPolicy restricts Ollama to WebUI pods and the ingress controller only.
.wslconfigingress-nginx namespace127.0.0.1 deepseek.local ollama-ds.local added to C:\Windows\System32\drivers\etc\hostsingress-nginx before applying..wslconfig sets memory=12GB and restart Docker Desktop if you changed it.hostPath.path values in both PersistentVolume specs to match your storage path. Kubernetes creates the directories automatically on first mount.kubectl apply -f deepseek-k8s-final.yaml.kubectl logs -n deepseek -l app=ollama -c model-puller -f and confirm Pull complete and Init done appear before the main container starts.http://deepseek.local and confirm the Open WebUI interface loads.http://ollama-ds.local/api/tags and confirm the JSON response lists deepseek-r2.http://ollama-ds.local for local inference with no data leaving the machine.This template configures a 17-resource Kubernetes stack that runs DeepSeek R2 via Ollama, exposes it through a streaming-optimized NGINX Ingress, and enforces namespace-level resource and network controls.