The Gateway Index / Routers / #78
thushan/olla
by thushan · Routers · updated today
High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.
60
momentum
319
stars
59
forks
#78
rank
aiamdgolangintelllama-cppllamacppllm-inferencellm-proxyllm-routerllm-routinglmstudiolocal-ai
View on GitHub →