smg-project/smg

by smg-project · Routers · updated today

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across vLLM, TRT-LLM, TokenSpeed, SGLang, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

More in Routers

freellmapi

tashfeenahmed

04

Routers

7.4 billion tokens per month. 34 free LLM providers. 635 free model endpoints. All behind

AIClient2API

justlovemaki

12

Routers

Self-hosted multi-protocol AI API proxy for Antigravity, Codex, Grok, Kiro, OpenAI, Claude

plano

katanemo

15

Routers

Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, obs

ClawRouter

BlockRunAI

16

Routers

The agent-native LLM router for autonomous agents. Every frontier model behind one wallet,