Sites and apps similar to Respan AI include OpenRouter, which has a free version. Other options are liteLLM, Langfuse, Helicone and Ambertrace. In total there are five Large Language Model (LLM) Tools like Respan AI for self-hosting.
OpenRouter is an AI model aggregator service that provides developers and users access to a wide range of large language models and generative 3D object models through a unified API. It allows users to interact with various AI models, including those from major providers like...
United States
Python SDK, Proxy Server (LLM Gateway) to call 100+ LLM APIs in OpenAI format - [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq].
United States
Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more.
Germany
EU
Helicone is the open-source LLM observability platform for developers to monitor, debug, and improve production-ready applications.
United States
Ambertrace is an LLM observability platform with an open source SDK that traces every AI agent call across OpenAI, Anthropic, and Google with zero code changes.
