The Gateway Index / Gateways & Proxies / #59
VecSzn/lobes
by VecSzn · Gateways & Proxies · updated 2d ago
An experimental local AI runtime. It relays one request through five small models with one job each, on a single 8 GB consumer GPU.
64
momentum
86
stars
22
forks
#59
rank
consumer-gpuggufllama-cppllm-inferencelocal-ailocal-llmmodel-routingon-device-aiopenai-compatible-api
View on GitHub →
More in Gateways & Proxies
OmniRoute
diegosouzapw
Never stop coding. Free MIT AI gateway: one endpoint, 359 providers (150+ free), 1200+ mod
litellm
BerriAI
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o
new-api
QuantumNous
A unified AI model hub for aggregation & distribution. It supports cross-converting variou
kong
Kong
🦍 The API and AI Gateway