aws-solutions-library-samples/guidance-for-multi-provider-generative-ai-gateway-on-aws

by aws-solutions-library-samples · Gateways & Proxies · updated 1mo ago

This Guidance demonstrates how to streamline access to numerous large language models (LLMs) through a unified, industry-standard API gateway based on OpenAI API standards

More in Gateways & Proxies

litellm

BerriAI

01

Gateways & Proxies

Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format,

kong

Kong

02

Gateways & Proxies

🦍 The API and AI Gateway

new-api

QuantumNous

03

Gateways & Proxies

A unified AI model hub for aggregation & distribution. It supports cross-converting variou

apisix

apache

05

Gateways & Proxies

The Cloud-Native API Gateway and AI Gateway