kanchengw/cnllm

by kanchengw · Gateways & Proxies · updated today

Python toolkit for Chinese LLMs, with flexible batch capacity, structured real-time visulization and automated accumulation for streaming, and explicit feedback on vendor-native parameter validation.

More in Gateways & Proxies

litellm

BerriAI

01

Gateways & Proxies

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format,

kong

Kong

02

Gateways & Proxies

🦍 The API and AI Gateway

new-api

QuantumNous

03

Gateways & Proxies

A unified AI model hub for aggregation & distribution. It supports cross-converting variou

apisix

apache

05

Gateways & Proxies

The Cloud-Native API Gateway and AI Gateway