Kymata Labs/The Living IndexesBuilt by tekvisions ↗
The Gateway Index / Routers / #17
vllm-project

vllm-project/semantic-router

by vllm-project · Routers · updated today

A programmable Mixture-of-Models router for heterogeneous LLM inference

75
momentum
5,735
stars
935
forks
#17
rank
ai-gatewayguardrailsinferencekubernetesllmllmroutermixture-of-modelspytorchsemantic-routertransformervllm
View on GitHub →