Apps tagged with 'Evaluation Framework'

All apps in Apps tagged with 'Evaluation Framework' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. Opik icon
     1 like

    Opik is an open-source platform for evaluating, testing and monitoring LLM applications. Built by Comet.

    Cost / License

    Since

    • Since 2024

    Platforms

    • Self-Hosted
    • Docker
    Opik screenshot 1
    15 alternatives
  2. Relari.ai icon
     Like

    Harden your GenAI systems with synthetic data.

    Cost / License

    Since

    • Since 2024

    Platforms

    • Windows
    • Mac
    • Linux
    • BSD
    • Python
    • US flagUnited States
    Relari.ai screenshot 1
    7 alternatives
  3. LightEval icon
     Like

    LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

    Cost / License

    • Free
    • Open Source (MIT)

    Since

    • Since 2024

    Platforms

    • Self-Hosted
    • Python
    3 alternatives
  4. Promptfoo icon
     Like

    Open-source tool for automated LLM prompt, agent, and RAG evaluation, supporting red teaming, multi-model comparisons, CI/CD, CLI, and vulnerability scanning.

    Cost / License

    • Freemium
    • Open Source (MIT)

    Since

    • Since 2026

    Platforms

    • Online
    • Self-Hosted
    • US flagUnited States
    Promptfoo screenshot 1
    Promptfoo screenshot 1
    Promptfoo screenshot 2
    +1
    Promptfoo screenshot 3
    8 alternatives
  5.  Like

    Build, Evaluate, and Optimize AI Systems. Includes evals, RAG, agents, fine-tuning, synthetic data generation, dataset management, MCP, and more.

    Cost / License

    • Freemium
    • Source Available

    Since

    • New

    Platforms

    • Windows
    • Mac
    • Linux
    • Python
    • CA flagCanada
    Kiln AI screenshot 1
    8 alternatives
  6. Maxim AI icon
     Like

    Maxim is an end-to-end AI evaluation and observability platform that empowers modern AI teams to ship agents with quality, reliability, and speed.

    Cost / License

    • Subscription
    • Proprietary

    Since

    • Since 2025

    Platforms

    • Online
    • Software as a Service (SaaS)
    Maxim AI screenshot 1
    Maxim AI screenshot 1
    Maxim AI screenshot 2
    3 alternatives