The Gateway Index / Gateways & Proxies / #2
BerriAI/litellm
by BerriAI · Gateways & Proxies · updated today
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
86
momentum
58,562
stars
11,378
forks
#2
rank
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenai
View on GitHub →
More in Gateways & Proxies
OmniRoute
diegosouzapw
Never stop coding. Free MIT AI gateway: one endpoint, 352 providers (150+ free), 1200+ mod
new-api
QuantumNous
A unified AI model hub for aggregation & distribution. It supports cross-converting variou
kong
Kong
🦍 The API and AI Gateway
pangolin
fosrl
Modern networking and security platform providing secure access and connectivity to apps,