The Gateway Index / Gateways & Proxies / #120
majiayu000/litellm-rs
by majiayu000 · Gateways & Proxies · updated 7d ago
Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.
54
momentum
121
stars
18
forks
#120
rank
ai-gatewayanthropicapi-clientasync-rustaws-bedrockembeddingsgeminillmload-balancingmulti-providerollamaopenai
View on GitHub →
More in Gateways & Proxies
OmniRoute
cheaper-inference
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ mo
litellm
BerriAI
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o
new-api
QuantumNous
A unified AI model hub for aggregation & distribution. It supports cross-converting variou
kong
Kong
🦍 The API and AI Gateway