The Gateway Index / Gateways & Proxies / #1
BerriAI/litellm
by BerriAI · Gateways & Proxies · updated today
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
87
momentum
50,241
stars
8,845
forks
#1
rank
ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenai
View on GitHub →