Promptfoo Alternatives

Promptfoo is described as 'Open-source tool for automated LLM prompt, agent, and RAG evaluation, supporting red teaming, multi-model comparisons, CI/CD, CLI, and vulnerability scanning' and is an app in the development category. There are 1 alternatives to Promptfoo for Web-based, Self-Hosted, SaaS, Cloudron and Docker. The best Promptfoo alternative is Langfuse, which is free.

More about Promptfoo
Copy a direct link to this comment to your clipboard
Promptfoo alternatives page was last updated

Alternatives list

  1. Langfuse icon

    Langfuse

     1 like

    Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more.

    11 Langfuse alternatives

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    • Self-Hosted
    • Software as a Service (SaaS)
    • Docker
    • Cloudron
    Create manual annotations to provide feedback, corrections, and improvements to your LLM outputs. Use annotations to build high-quality datasets and set a baseline for automated evals.
     
1 of 1 Promptfoo alternatives