Apps similar to operatorLM include liteLLM, which is open source with a free version. Other options are VoidLLM, OmniRoute, boldrouter and GoModel. In total there are five Large Language Model (LLM) Tools like operatorLM for self-hosting, Mac, Windows, Linux and the web.
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].
United States
Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.
Germany
EU
Free AI gateway allows your AI to work none stop: one endpoint, 350 providers (90+ free), 1200+ models Quota-aware, auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 450+ contributors.
Brazil
A unified, OpenAI-compatible gateway to every major LLM provider. One endpoint, one key, one bill - with automatic routing and failover.
Switzerland
