Open-source LLM-ops platform combining prompt management, an AI gateway, tracing, a tool catalog, and evaluation in one self-hostable platform.
Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more.
Germany
EU
Helicone is the open-source LLM observability platform for developers to monitor, debug, and improve production-ready applications.
United States
Opik is an open-source platform for evaluating, testing and monitoring LLM applications. Built by Comet.
The agentic analyst for your agents. Your observability tool only tells you what happened. TwoTail figures out why, and what you should change.
DenmarkEU
Maxim is an end-to-end AI evaluation and observability platform that empowers modern AI teams to ship agents with quality, reliability, and speed.
Open-source solution for automated LLM prompt, agent, and RAG workflow testing, enabling red teaming, pentesting, and vulnerability scanning. Supports model comparisons across major AI providers with declarative configs, CI/CD, CLI, live reload, and web-based result sharing.
United States
United States
