aws-solutions-library-samples/guidance-for-multi-provider-generative-ai-gateway-on-aws

by aws-solutions-library-samples · Gateways & Proxies · updated 21d ago

This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gateway based on OpenAI API standards

More in Gateways & Proxies

OmniRoute

cheaper-inference

01

Gateways & Proxies

Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ mo

litellm

BerriAI

02

Gateways & Proxies

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (o

new-api

QuantumNous

03

Gateways & Proxies

A unified AI model hub for aggregation & distribution. It supports cross-converting variou

kong

Kong

05

Gateways & Proxies

🦍 The API and AI Gateway