Promptfoo Alternatives

Apps similar to Promptfoo include AgentInspect, which is free and open source. Other options are Langfuse, Provael, Corrath and Kiln AI. In total there are eight Large Language Model (LLM) Tools like Promptfoo for Mac, Windows, Linux, the web and self-hosting.

Copy a direct link to this comment to your clipboard
Alternatives
Promptfoo alternatives page was last updated

Alternatives list

  1. AgentInspect icon
     1 like

    AgentInspect captures framework-native TypeScript agent runs as local execution trees, derives deterministic TraceFacts and TraceContract checks for CI, and packages share-checked Evidence v2 artifacts for offline review.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
  2. Langfuse icon
     1 like

    Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more.

    Cost / License

    • Freemium (Subscription)
    • Proprietary

    Since

    • Since 2026

    Platforms

    • Online
    • Software as a Service (SaaS)
    • Self-Hosted
    • Docker
    • Cloudron
    Good alternative?
     
  3. Provael icon
     Like

    Red-team open vision-language-action robot policies in simulation and get an attack success rate with a matched benign control.

    Cost / License

    • Freemium (Pay once or Subscription)
    • Open Source (Apache-2.0)

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
  4. Corrath icon
     Like

    Corrath is an AI security gateway built for developers and organizations building with Large Language Models.

    Cost / License

    • Freemium (Subscription)
    • Proprietary

    Since

    • Since 2026

    Platforms

    • Online
    • Software as a Service (SaaS)
    Good alternative?
     
  5.  Like

    Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

    Cost / License

    • Freemium
    • Source Available

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    • Python
    Good alternative?
     
  6. Forecall icon
     Like

    Forecall is for people who build MCP servers and APIs that AI agents call. It checks the text an agent reads before it picks a tool, and measures what models actually do with it.

    Cost / License

    • Freemium (Subscription)
    • Proprietary

    Since

    • New

    Platforms

    • Online
    • Software as a Service (SaaS)
    Good alternative?
     
  7. Enoki is an AI red teaming platform that tests AI agents for security, safety and policy risks. It attacks the deployed agent through its endpoint the way an adversary would, over multiple turns, shows the exact attack and the agent's response behind every finding, and...

    Cost / License

    • Freemium (Usage-based)
    • Proprietary

    Since

    • Since 2026

    Platforms

    • Online
    • Software as a Service (SaaS)
    Good alternative?
     
  8. HandoffProbe is an open-source CLI for adversarial security testing of AI agent handoffs. It checks whether security properties such as delegated authority, principal identity, tenant continuity, approval and consent, credential audience, replay protection, cancellation, retry...

    Cost / License

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    Good alternative?
     
8 of 8 Promptfoo alternatives