Apps tagged with 'llm-observability'

All apps in Apps tagged with 'llm-observability' category. Use the filters below to narrow down your search. 
Copy a direct link to this comment to your clipboard
  1. Mistral AI Studio icon

    Mistral AI Studio

     10 likes

    Mistral AI Studio is an enterprise platform for building, evaluating, and running AI applications in production. It combines model access with operational tooling so teams can design use cases, observe real usage, and deploy with privacy, security, and full data ownership across...

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Online
    Mistral AI Studio screenshot 1
    Mistral AI Studio screenshot 1
    Mistral AI Studio screenshot 2
    +1
    Mistral AI Studio screenshot 3
    8 alternatives
  2. Langfuse icon

    Langfuse

     1 like

    Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
    • Software as a Service (SaaS)
    • Self-Hosted
    • Docker
    Create manual annotations to provide feedback, corrections, and improvements to your LLM outputs. Use annotations to build high-quality datasets and set a baseline for automated evals.
    Run online/offline evals, via UI (experiment with prompts/models) and via SDKs (experiment with end-to-end application). Build datasets from traces to continuously improve your evals. View results in UI.
    Experiment with different prompts, models, and parameters in an interactive playground. Compare outputs, iterate on prompts, and save successful configurations to prompt management.
    +3
    Version-control prompts collaboratively, deploy/roll-back instantly to different environments, support for templates, variables, and A/B testing. Cached client-side for 0 latency/availability impact.
    2 alternatives
  5. Ambertrace icon

    Ambertrace

     Like

    Ambertrace is an LLM observability platform with an open source SDK that traces every AI agent call across OpenAI, Anthropic, and Google with zero code changes.

    Cost / License

    Platforms

    • Software as a Service (SaaS)
    • Self-Hosted
    Just need to add 2 lines of code to start tracking AI agents perfomance
    Track total traces, token consumption, average latency, and success rates across all providers. See exactly where your AI budget goes with per-provider breakdowns.
    Browse every request and response with full payloads, token counts, and timing data. Click any trace to inspect the complete conversation - prompts, completions, and errors.
    1 alternatives