Kymata Labs/The Living IndexesBuilt by tekvisions ↗
The Gateway Index / Self-Hosted Platforms / #106
hwdsl2

hwdsl2/self-hosted-ai-stack

by hwdsl2 · Self-Hosted Platforms · updated today

Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64.

57
momentum
160
stars
33
forks
#106
rank
aiai-stackcudadockerdocker-composedoclingembeddingslinuxlitellmllmlocal-aimcp
View on GitHub →