messkan/prompt-cache

by messkan · Caching & Cost · updated 1mo ago

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

More in Caching & Cost

ThinkWatch

ThinkWatchProject

25

Caching & Cost

Enterprise AI bastion host for secure AI API and MCP access, with unified proxying, RBAC,

litemaas

rh-aiservices-bu

109

Caching & Cost

LiteMaaS is a proof-of-concept application for managing LLM subscriptions, API keys, and u

tokenfirewall

Ruthwik000

110

Caching & Cost

Scalable LLM cost enforcement middleware for Node.js with budget protection and multi-prov