The Gateway Index / Routers / #90
thushan/olla
by thushan · Routers · updated 20d ago
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
57
momentum
298
stars
44
forks
#90
rank
aiamdgolangintelllama-cppllamacppllm-inferencellm-proxyllm-routerllm-routinglmstudiolocal-ai
View on GitHub →