Apps tagged with 'LLM Gateway'

Open-source, OpenAI-compatible gateway that routes hosted, BYOK, local, and custom models with access controls, budgets, and usage attribution.

Spillway is an open-source, self-hosted AI gateway for teams that use cloud and local language models. It runs as a single Docker container with an admin UI and SQLite storage.

Open-source LLM-ops platform combining prompt management, an AI gateway, tracing, a tool catalog, and evaluation in one self-hostable platform.

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Free AI gateway allows your AI to work none stop: one endpoint, 350 providers (90+ free), 1200+ models Quota-aware, auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 450+ contributors.

Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.

Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

AI gateway written in Go. The fastest and the most resource-efficient. It serves OpenAI-compatible API and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI & Ollama.

OBEY API Gateway is an open-source (MIT), self-hosted AI gateway that gives you a single OpenAI-compatible endpoint in front of all your LLM providers. Just change your OPENAI_API_BASE to point at the gateway with no application code changes and gain automatic failover...

Bizgraph lets agencies set up automated custom pricing plans for each client—define your markup once, and every API call is tracked, priced, and invoiced automatically. Start with a 14-day free trial to see your profit margins grow.

Gonka Broker is a pay-as-you-go API for open-source language models served on the decentralized Gonka GPU network. It works as a drop-in replacement in most AI stacks: it exposes OpenAI-compatible Chat Completions and an Anthropic-compatible Messages endpoint, so switching...

The proxy server for AI-native apps. Arch handles the pesky low-level work in building agents like clariyfing vague user input, routing prompts to the right agents and unifying access to any LLM - all without locking you into a framework.

B-Lost AI is a next-generation, enterprise-grade AI API relay and aggregation platform designed for global developers, researchers, and AI startups.

SteadyRouter is an AI model API gateway: one key for hundreds of models in OpenAI, Anthropic and Gemini formats. Each model comes in groups, each a different upstream source with its own public price and 24-hour availability.

One OpenAI- and Anthropic-compatible API for text, image and video models from leading AI labs. One key, one prepaid USD balance, published per-token prices.

Self-hosted AI platform for organizations: Chat, Code and Agent workspaces built on an enterprise LLM gateway with centralized access control, budgets and usage visibility.

Kryvlo is the intelligent LLM gateway that eliminates the hidden cost of hardcoded AI models. Our platform analyzes every prompt in real time and automatically routes it to the most cost-effective model across 300+ options — from lightweight tasks to frontier-level reasoning.

App AI Gateway is an AI gateway for iOS apps. Your app calls the gateway instead of OpenAI, Anthropic, Google Gemini or another provider, so the provider keys stay on the server and never ship inside the app.

LowRouter gives teams and AI agents one API key and one bill in euros for language models from many providers, European and international.

AI gateway that governs model, tool and agent-to-agent calls, with a tamper-evident audit trail and policy and PII checks on every call.

Gateway offering EU-hosted, OpenAI-compatible API access to 700+ models from 30+ providers, with pay-as-you-go pricing, failover, tracing, and GDPR compliance.

A free, open-source app to discover, run, and use AI models on your own computer, with hardware-aware recommendations, easy setup, and advanced controls when needed.

flo2 is a cloud LLM gateway that routes one OpenAI- and Anthropic-compatible API key to many model providers, adding no token markup while handling smart routing, fallback, racing, A/B testing and per-call cost tracking.

Unified platform for routing LLM traffic, observability, evals, prompt management, tracing, and spend controls, reducing dashboard switching time.