The Gateway Index / Routers / #17
vllm-project/semantic-router
by vllm-project · Routers · updated today
A programmable Mixture-of-Models router for heterogeneous LLM inference
75
momentum
5,735
stars
935
forks
#17
rank
ai-gatewayguardrailsinferencekubernetesllmllmroutermixture-of-modelspytorchsemantic-routertransformervllm
View on GitHub →