Apps similar to App AI Gateway include Experiential, which is open source with a free version. Other options are OpenRouter, Spillway, liteLLM and VoidLLM. In total there are seven Large Language Model (LLM) Tools like App AI Gateway for self-hosting, Windows, the web, Mac and Linux.
Open-source, OpenAI-compatible gateway for agent workflows that connects hosted, BYOK, local, and custom models through one API. It routes calls, enforces model access by user, agent, and use case, applies budgets, and attributes cost and usage to each request.
OpenRouter is an AI model aggregator service that provides developers and users access to a wide range of large language models and generative 3D object models through a unified API. It allows users to interact with various AI models, including those from major providers like...
United States
Spillway is an open-source, self-hosted AI gateway for teams that use cloud and local language models. It runs as a single Docker container with an admin UI and SQLite storage.
Georgia
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].
United States
Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.
Germany
EU
A unified, OpenAI-compatible gateway to every major LLM provider. One endpoint, one key, one bill - with automatic routing and failover.
Switzerland
OBEY API Gateway is an open-source (MIT), self-hosted AI gateway that gives you a single OpenAI-compatible endpoint in front of all your LLM providers. Just change your OPENAI_API_BASE to point at the gateway with no application code changes and gain automatic failover...
United States
