Apps similar to Promptfoo include AgentInspect, which is free and open source. Other options are Langfuse, Provael, Corrath and Kiln AI. In total there are six Large Language Model (LLM) Tools like Promptfoo for Mac, Windows, Linux, the web and self-hosting.
AgentInspect captures framework-native TypeScript agent runs as local execution trees, derives deterministic TraceFacts and TraceContract checks for CI, and packages share-checked Evidence v2 artifacts for offline review.
Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more.
Germany
EU
Red-team open vision-language-action robot policies in simulation and get an attack success rate with a matched benign control.
India
Corrath is an AI security gateway built for developers and organizations building with Large Language Models.
India
HandoffProbe is an open-source CLI for adversarial security testing of AI agent handoffs. It checks whether security properties such as delegated authority, principal identity, tenant continuity, approval and consent, credential audience, replay protection, cancellation, retry...
AustriaEU
Canada
