Apps similar to LLMxRay include Open WebUI, which is free and open source. Other options are Langfuse and Opik. In total there are three Large Language Model (LLM) Tools like LLMxRay for self-hosting and the web.
Feature-rich offline AI platform with support for Ollama and OpenAI-compatible APIs, retrieval-augmented generation, text-to-image, cloud sync, privacy focus, ad-free experience, distraction-free and dark modes, no registration, easy deployment, and customizable UI.
United States
Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more.
Germany
EU
Opik is an open-source platform for evaluating, testing and monitoring LLM applications. Built by Comet.
