majiayu000/litellm-rs

by majiayu000 · Gateways & Proxies · updated today

Self-hosted Rust LLM gateway with OpenAI-compatible APIs, load balancing, failover, and a reusable Rust kernel.

More in Gateways & Proxies

OmniRoute

diegosouzapw

01

Gateways & Proxies

Never stop coding. Free MIT AI gateway: one endpoint, 359 providers (150+ free), 1200+ mod

litellm

BerriAI

02

Gateways & Proxies

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o

new-api

QuantumNous

03

Gateways & Proxies

A unified AI model hub for aggregation & distribution. It supports cross-converting variou

kong

Kong

04

Gateways & Proxies

🦍 The API and AI Gateway