Kymata Labs/The Living IndexesBuilt by tekvisions ↗
The Gateway Index / Routers / #190
peva3

peva3/SmarterRouter

by peva3 · Routers · updated 4mo ago

SmarterRouter: An intelligent LLM gateway and VRAM-aware router for Ollama, llama.cpp, and OpenAI. Features semantic caching, model profiling, and automatic failover for local AI labs.

34
momentum
152
stars
19
forks
#190
rank
ai-cacheai-gatewaydockerfastapigpu-monitoringllmllm-proxyllm-routerlocal-llmmodel-servingollamaollama-api
View on GitHub →