Apps tagged with 'evaluation-framework'

All apps in Apps tagged with 'evaluation-framework' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. Opik icon
     1 like

    Opik is an open-source platform for evaluating, testing and monitoring LLM applications. Built by Comet.

    Cost / License

    Platforms

    • Self-Hosted
    • Docker
    Opik screenshot 1
    10 alternatives
  2. LightEval icon
     Like

    LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

    Cost / License

    • Free
    • Open Source (MIT)

    Platforms

    • Self-Hosted
    • Python
    3 alternatives
  3. Promptfoo icon
     Like

    Open-source tool for automated LLM prompt, agent, and RAG evaluation, supporting red teaming, multi-model comparisons, CI/CD, CLI, and vulnerability scanning.

    Cost / License

    • Freemium
    • Open Source (MIT)

    Platforms

    • Online
    • Self-Hosted
    Promptfoo screenshot 1
    Promptfoo screenshot 1
    Promptfoo screenshot 2
    +1
    Promptfoo screenshot 3
    2 alternatives
  4. Maxim AI icon
     Like

    Maxim is an end-to-end AI evaluation and observability platform that empowers modern AI teams to ship agents with quality, reliability, and speed.

    Cost / License

    • Paid
    • Proprietary

    Platforms

    • Software as a Service (SaaS)
    • Online
    Maxim AI screenshot 1
    Maxim AI screenshot 1
    Maxim AI screenshot 2
    1 alternatives