thushan/olla

by thushan · Routers · updated today

High-performance lightweight proxy and load balancer for LLM infrastructure. Intelligent routing, automatic failover and unified model discovery across local and remote inference backends.

More in Routers

freellmapi

tashfeenahmed

04

Routers

OpenAI-compatible proxy that stacks the free tiers of 16 LLM providers (~1.7B tokens/month

plano

katanemo

09

Routers

Plano is an AI-native proxy and data plane for agentic apps — with built-in orchestration,

gateway

Portkey-AI

10

Routers

A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardra

ClawRouter

BlockRunAI

11

Routers

The agent-native LLM router for OpenClaw. 41+ models, <1ms routing, USDC payments on Base