Open-source AI platform for running LLMs entirely on your own infrastructure, with an OpenAI-compatible API, management dashboard, and zero data egress.
Austria
EU

Apps similar to liteLLM include OpenRouter, which has a free version. Other options are Experiential, Spillway, CometAPI and IntentiAI. Large Language Model (LLM) Tools like liteLLM are a crowded field, with more than 50 alternatives for the web, self-hosting, Windows, Linux and Mac.
Open-source AI platform for running LLMs entirely on your own infrastructure, with an OpenAI-compatible API, management dashboard, and zero data egress.

Runs a private, cryptographically attested AI gateway inside Intel TDX enclaves, enabling use of Claude, GPT, and Gemini models from one OpenAI-compatible endpoint. Ensures prompts stay private and requires no rewrites for integration.

OpenRain is an OpenAI-compatible AI API gateway that lets developers access multiple major AI models through one API key and one unified endpoint.



Spend Brake is a self-hosted egress proxy that puts hard dollar caps on paid APIs. Swap one base URL and one key: every request is priced per SKU before it leaves, checked against your caps in one atomic step, and refused with a clear 402 once a cap would be crossed.




Kryvlo is the intelligent LLM gateway that eliminates the hidden cost of hardcoded AI models. Our platform analyzes every prompt in real time and automatically routes it to the most cost-effective model across 300+ options — from lightweight tasks to frontier-level reasoning.




TokenDos is an AI model Token sharing platform connecting idle API key providers with consumers. Supports OpenAI, Anthropic, Claude Code, Codex. Pay-per-token. Low-cost access to Claude Fable 5, Opus 4.8, GPT 5.6 and more.




Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

Self-hosted peer-to-peer routing layer that routes AI inference requests across an open market of independent providers instead of a central aggregator.