Apps tagged with 'llm-gateway'

All apps in Apps tagged with 'llm-gateway' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. liteLLM icon
     3 likes

    Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].

    Cost / License

    • Freemium
    • Open Source

    Platforms

    • Self-Hosted
    Playground
    Proxy Keys
    Usage
    +1
    Teams
    26 alternatives
  2. Lynkr icon
     1 like

    Streamline your workflow with Lynkr, a CLI tool that acts as an HTTP proxy for efficient code interactions using Claude Code CLI.

    Cost / License

    Platforms

    • Mac
    • Windows
    • Linux
    • JavaScript
    • Homebrew
    • Docker
    • npm
    Lynkr screenshot 1
    1 alternatives
  3. VoidLLM icon
     1 like

    Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Windows
    • Mac
    • Linux
    • Self-Hosted
    • Docker
    VoidLLM screenshot 1
    VoidLLM screenshot 1
    VoidLLM screenshot 2
    +1
    VoidLLM screenshot 3
    14 alternatives
  4. Bizgraph icon
     3 likes

    Bizgraph lets agencies set up automated custom pricing plans for each client—define your markup once, and every API call is tracked, priced, and invoiced automatically. Start with a 14-day free trial to see your profit margins grow.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Online
    Bizgraph screenshot 1
    13 alternatives
  5. GoModel icon
     1 like

    AI gateway written in Go. The fastest and the most resource-efficient. It serves OpenAI-compatible API and Anthropic-compatible API for OpenAI, Anthropic, Gemini, Groq, xAI & Ollama.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Mac
    • Windows
    • Linux
    • Self-Hosted
    • Docker
    AI Usage data
    AI Gateway - Latency and reliability
    Realtime Logs
    +2
    GoModel screenshot 3
    6 alternatives
  6. Arch icon
     Like

    The proxy server for AI-native apps. Arch handles the pesky low-level work in building agents like clariyfing vague user input, routing prompts to the right agents and unifying access to any LLM - all without locking you into a framework.

    Cost / License

    Platforms

    • Self-Hosted
    • Docker
    Arch screenshot 1
  7. Self-hosted AI platform for organizations: Chat, Code and Agent workspaces built on an enterprise LLM gateway with centralized access control, budgets and usage visibility.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Self-Hosted
    • Software as a Service (SaaS)
    Chat workspace: everyday AI for every employee
    Model selector with all connected providers in one place
    Control Tower: per-team budgets and usage visibility
    7 alternatives
  8. flo2 icon
     Like

    flo2 is a cloud LLM gateway that routes one OpenAI- and Anthropic-compatible API key to many model providers, adding no token markup while handling smart routing, fallback, racing, A/B testing and per-call cost tracking.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Online
    • Software as a Service (SaaS)
    Homepage
    How it works
    Usage
    4 alternatives
  9. Respan AI icon
     Like

    Unified platform for routing LLM traffic, observability, evals, prompt management, tracing, and spend controls, reducing dashboard switching time.

    Cost / License

    • Free
    • Proprietary

    Platforms

    • Online
    Respan AI screenshot 1
    Respan AI screenshot 1
    Respan AI screenshot 2
    +1
    Respan AI screenshot 3
    3 alternatives
  10. A self-hosted, open-source (Apache 2.0) proxy for LLM's with prometheus metrics.

    Cost / License

    Platforms

    • Self-Hosted
    Dashboard view
  11. Otari icon
     Like

    Open-source, OpenAI-compatible LLM gateway you run yourself. One endpoint for 40+ providers, with virtual keys, budgets, and usage tracking.

    Cost / License

    Platforms

    • Self-Hosted
    • Docker
    • Online
    • Software as a Service (SaaS)
    Otari screenshot 1
    16 alternatives