Apps tagged with 'vllm'

All apps in Apps tagged with 'vllm' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. vllm-playground icon

    vllm-playground

     2 likes

    A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes.

    Cost / License

    Application type

    Platforms

    • Python
    • Mac
    • Linux
    • Self-Hosted
    • Kubernetes
    • OpenShift
    MCP (Model Context Protocol) integration enables models to use external tools with human-in-the-loop approval.
    Tool Calling Support
    Structured Outputs Support
    +1
    vllm-playground screenshot 3
    15 alternatives
  2. VoidLLM icon

    VoidLLM

     1 like

    Privacy-first LLM proxy and AI gateway — load balancing, multi-provider routing, API key management, usage tracking, rate limiting. Self-hosted. Zero knowledge of your prompts.

    Cost / License

    • Free
    • Open Source

    Platforms

    • Windows
    • Mac
    • Linux
    • Self-Hosted
    • Docker
    VoidLLM screenshot 1
    VoidLLM screenshot 1
    VoidLLM screenshot 2
    +1
    VoidLLM screenshot 3
    6 alternatives