

Otari
Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.
Cost / License
- Free
- Open Source (Apache-2.0)
Platforms
- Self-Hosted
- Docker
- Online
- Software as a Service (SaaS)
Features
Properties
- Privacy focused
Features
- No Tracking
- Gateway
Otari News & Activities
Recent activities
Otari information
What is Otari?
Otari is an open-source LLM gateway and control plane you self-host. One OpenAI-compatible endpoint sits in front of 40+ providers, so your apps keep a single stable API while you swap models behind it. It handles virtual API keys, per-key budgets, usage tracking, and request-level guardrails like prompt-injection detection. Prompts and responses never leave your infrastructure; only metadata is stored. It is built on any-llm, which calls providers through their official SDKs instead of reimplementing each interface, and is licensed under Apache 2.0. A hosted version runs at otari.ai for teams that would rather not operate it.




