Apps tagged with 'llm-gateway'

Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].

Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

Bizgraph lets agencies set up automated custom pricing plans for each client—define your markup once, and every API call is tracked, priced, and invoiced automatically. Start with a 14-day free trial to see your profit margins grow.

The proxy server for AI-native apps. Arch handles the pesky low-level work in building agents like clariyfing vague user input, routing prompts to the right agents and unifying access to any LLM - all without locking you into a framework.

A self-hosted, open-source (Apache 2.0) proxy for LLM's with prometheus metrics.