Otari

Otari is an open-source LLM gateway and control plane you self-host. One OpenAI-compatible endpoint sits in front of 40+ providers, so your apps keep a single stable API while you swap models behind it. It handles virtual API keys, per-key budgets, usage tracking, and request-level guardrails like prompt-injection detection. Prompts and responses never leave your infrastructure; only metadata is stored. It is built on any-llm, which calls providers through their official SDKs instead of reimplementing each interface, and is licensed under Apache 2.0. A hosted version runs at otari.ai for teams that would rather not operate it.