The Gateway Index / Gateways & Proxies / #102
neul-labs/fast-litellm
by neul-labs · Gateways & Proxies · updated 6d ago
High-performance Rust acceleration for LiteLLM - providing significant performance improvements for connection pooling, rate limiting, and memory-intensive workloads.
50
momentum
45
stars
4
forks
#102
rank
ai-infrastructureconnection-pooldrop-inlitellmllm-gatewayneul-labsperformancepypipythonrate-limitingrust
View on GitHub →
More in Gateways & Proxies
litellm
BerriAI
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format,
kong
Kong
🦍 The API and AI Gateway
new-api
QuantumNous
A unified AI model hub for aggregation & distribution. It supports cross-converting variou
apisix
apache
The Cloud-Native API Gateway and AI Gateway