messkan/prompt-cache

by messkan · Caching & Cost · updated 26d ago

Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response

More in Caching & Cost

ThinkWatch

ThinkWatchProject

54

Caching & Cost

Enterprise AI bastion host for secure AI API and MCP access, with unified proxying, RBAC,

proxy

RelayPlane

82

Caching & Cost

Local-first LLM proxy that meters what every agent run costs and kills runaways before the

inferock-bench

inferock

92

Caching & Cost

Local LLM cost-tracking proxy for OpenAI, Anthropic, Gemini, and pinned OpenRouter calls w

edgee

edgee-ai

103

Caching & Cost

Official Edgee CLI to interract with Edgee's Agent Gateway. Route Claude Code, Codex, Curs