hwdsl2/self-hosted-ai-stack

by hwdsl2 · Self-Hosted Platforms · updated 4d ago

Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway. Local-first, private by default, with lightweight stacks, optional HTTPS and NVIDIA CUDA acceleration. Multi-arch: amd64, arm64.

More in Self-Hosted Platforms

ruoyi-ai

ageerle

19

Self-Hosted Platforms

An enterprise AI development framework for building AI agents. It provides unified managem

TokenHub

astaxie

35

Self-Hosted Platforms

TokenHub gives enterprises a private gateway to unify AI model access and governance, maki

AIHelms

beizhu-1209

46

Self-Hosted Platforms

企业级 AI 资源纳管平台，提供统一 AI网关、Token调度能力，纳管 OpenAI、Azure、Claude、DeepSeek 等主流模型，并支持 MCP 工具与 Skill

OmniKey-AI-Unified-Key-Manager

Felix-au

116

Self-Hosted Platforms

A self-hosted LLM proxy and failover gateway supporting OpenAI & Gemini compatible endpoin