Apps tagged with 'LLM Observability'

Mistral AI Studio is an enterprise platform for building, evaluating, and running AI applications in production. It combines model access with operational tooling so teams can design use cases, observe real usage, and deploy with privacy, security, and full data ownership across...

Open-source LLM-ops platform combining prompt management, an AI gateway, tracing, a tool catalog, and evaluation in one self-hostable platform.

ReclaimLLM (RCLM) is a developer-first AI Control Plane that captures, indexes, compresses, and governs AI sessions across CLI coding agents (Claude Code, Gemini CLI, Codex, Cursor, Antigravity), local API proxies, and browser tabs.

Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more.

Helicone is the open-source LLM observability platform for developers to monitor, debug, and improve production-ready applications.

Netra is the reliability platform for AI agents to observe, evaluate, simulate, and continuously improve every decision your agents make, so you can ship with confidence and catch regressions before your users do.

LLMxRay — Local LLM Observatory. Full observability interface for Ollama: chat, streaming, reasoning, RAG, introspection, metrics.

Proxy that logs every LLM prompt, response and tool call to an encrypted audit trail, and blocks or flags requests carrying PII, secrets or policy violations before they reach the provider.

A free, open-source app to discover, run, and use AI models on your own computer, with hardware-aware recommendations, easy setup, and advanced controls when needed.

Open-source platform that turns your LLM agent’s production traces into a specialised model you own, trained, benchmarked and served.

FutureAGI is an open-source, end-to-end AI agent engineering platform built for teams shipping production AI agents. It covers the full lifecycle: simulate edge cases before launch, evaluate every agent decision and trace, catch hallucinations in real time, auto-optimize, and...

Unified platform for routing LLM traffic, observability, evals, prompt management, tracing, and spend controls, reducing dashboard switching time.

Open-source LLM observability and evaluation: grade every AI agent trace, cluster the failures, and replay them as regression tests that block the pull request.

Ambertrace is an LLM observability platform with an open source SDK that traces every AI agent call across OpenAI, Anthropic, and Google with zero code changes.

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM observability all in one place.