kanchengw/cnllm

by kanchengw · Gateways & Proxies · updated 4mo ago

Python toolkit for Chinese LLMs, with flexible batch capacity, structured real-time visulization and automated accumulation for streaming, and explicit feedback on vendor-native parameter validation.

More in Gateways & Proxies

OmniRoute

cheaper-inference

01

Gateways & Proxies

Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ mo

litellm

BerriAI

02

Gateways & Proxies

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o

new-api

QuantumNous

03

Gateways & Proxies

A unified AI model hub for aggregation & distribution. It supports cross-converting variou

kong

Kong

05

Gateways & Proxies

🦍 The API and AI Gateway